Crate arrow_integration_test

Source
Expand description

Support for the Apache Arrow JSON test data format

These utilities define structs that read the integration JSON format for integration testing purposes.

This is not a canonical format, but provides a human-readable way of verifying language implementations

Modulesยง

datatype ๐Ÿ”’
field ๐Ÿ”’
schema ๐Ÿ”’

Structsยง

ArrowJson
A struct that represents an Arrow file with a schema and record batches
ArrowJsonBatch
A struct that partially reads the Arrow JSON record batch
ArrowJsonColumn
A struct that partially reads the Arrow JSON column/array
ArrowJsonDictionaryBatch
A struct that partially reads the Arrow JSON dictionary batch
ArrowJsonField
Fields are left as JSON Value as they vary by DataType
ArrowJsonFieldDictionary
Represents a dictionary-encoded field in the Arrow JSON format
ArrowJsonSchema
A struct that partially reads the Arrow JSON schema.
DictionaryIndexType
Type of an index for a dictionary-encoded field in the Arrow JSON format

Functionsยง

array_from_json
Construct an Arrow array from a partially typed JSON column
create_null_buf ๐Ÿ”’
A helper to create a null buffer from a Vec<bool>
data_type_from_json
Parse a data type from a JSON representation.
data_type_to_json
Generate a JSON representation of the data type.
dictionary_array_from_json
Construct a [DictionaryArray] from a partially typed JSON column
field_from_json
Parse a Field definition from a JSON representation.
field_to_json
Generate a JSON representation of the Field.
record_batch_from_json
Generates a [RecordBatch] from an Arrow JSON batch, given a schema
schema_from_json
Parse a Schema definition from a JSON representation.
schema_to_json
Generate a JSON representation of the Schema.