Crate arrow_integration_test

Support for the Apache Arrow JSON test data format

These utilities define structs that read the integration JSON format for integration testing purposes.

This is not a canonical format, but provides a human-readable way of verifying language implementations

Modules

• datatype 🔒
• field 🔒
• schema 🔒

Structs

• ArrowJson
  A struct that represents an Arrow file with a schema and record batches
• ArrowJsonBatch
  A struct that partially reads the Arrow JSON record batch
• ArrowJsonColumn
  A struct that partially reads the Arrow JSON column/array
• ArrowJsonDictionaryBatch
  A struct that partially reads the Arrow JSON dictionary batch
• ArrowJsonField
  Fields are left as JSON Value as they vary by DataType
• ArrowJsonFieldDictionary
  Represents a dictionary-encoded field in the Arrow JSON format
• ArrowJsonSchema
  A struct that partially reads the Arrow JSON schema.
• DictionaryIndexType
  Type of an index for a dictionary-encoded field in the Arrow JSON format

Functions

• array_from_json
  Construct an Arrow array from a partially typed JSON column
• create_null_buf 🔒
  A helper to create a null buffer from a Vec<bool>
• data_type_from_json
  Parse a data type from a JSON representation.
• data_type_to_json
  Generate a JSON representation of the data type.
• dictionary_array_from_json
  Construct a [DictionaryArray] from a partially typed JSON column
• field_from_json
  Parse a Field definition from a JSON representation.
• field_to_json
  Generate a JSON representation of the Field.
• record_batch_from_json
  Generates a [RecordBatch] from an Arrow JSON batch, given a schema
• schema_from_json
  Parse a Schema definition from a JSON representation.
• schema_to_json
  Generate a JSON representation of the Schema.