Crate arrow_integration_test

Support for the Apache Arrow JSON test data format

These utilities define structs that read the integration JSON format for integration testing purposes.

This is not a canonical format, but provides a human-readable way of verifying language implementations

Modules

datatype 🔒

field 🔒

schema 🔒

Structs

ArrowJson

A struct that represents an Arrow file with a schema and record batches

ArrowJsonBatch

A struct that partially reads the Arrow JSON record batch

ArrowJsonColumn

A struct that partially reads the Arrow JSON column/array

ArrowJsonDictionaryBatch

A struct that partially reads the Arrow JSON dictionary batch

ArrowJsonField

Fields are left as JSON Value as they vary by DataType

ArrowJsonFieldDictionary

Represents a dictionary-encoded field in the Arrow JSON format

ArrowJsonSchema

A struct that partially reads the Arrow JSON schema.

DictionaryIndexType

Type of an index for a dictionary-encoded field in the Arrow JSON format

Functions

array_from_json

Construct an Arrow array from a partially typed JSON column

create_null_buf 🔒

A helper to create a null buffer from a Vec<bool>

data_type_from_json

Parse a data type from a JSON representation.

data_type_to_json

Generate a JSON representation of the data type.

dictionary_array_from_json

Construct a [DictionaryArray] from a partially typed JSON column

field_from_json

Parse a Field definition from a JSON representation.

field_to_json

Generate a JSON representation of the Field.

record_batch_from_json

Generates a [RecordBatch] from an Arrow JSON batch, given a schema

schema_from_json

Parse a Schema definition from a JSON representation.

schema_to_json

Generate a JSON representation of the Schema.