Module shred_variant

Expand description

Module for shredding VariantArray with a given schema.

Re-exports§

use crate::type_conversion::VariantCastMode; 🔒
use crate::variant_array::ShreddedVariantFieldArray; 🔒
use crate::variant_to_arrow::ArrayVariantToArrowRowBuilder; 🔒
use crate::variant_to_arrow::PrimitiveVariantToArrowRowBuilder; 🔒
use crate::variant_to_arrow::make_primitive_variant_to_arrow_row_builder; 🔒
use crate::VariantArray; 🔒
use crate::VariantValueArrayBuilder; 🔒
use arrow::array::ArrayRef; 🔒
use arrow::array::BinaryViewArray; 🔒
use arrow::array::NullBufferBuilder; 🔒
use arrow::array::StructArrayAssembler; 🔒
use arrow::buffer::NullBuffer; 🔒
use arrow::compute::CastOptions; 🔒
use arrow::datatypes::DataType; 🔒
use arrow::datatypes::Field; 🔒
use arrow::datatypes::FieldRef; 🔒
use arrow::datatypes::Fields; 🔒
use arrow::datatypes::TimeUnit; 🔒
use arrow::error::ArrowError; 🔒
use arrow::error::Result; 🔒
use indexmap::IndexMap; 🔒
use parquet_variant::Variant; 🔒
use parquet_variant::VariantBuilderExt; 🔒
use parquet_variant::VariantPath; 🔒
use parquet_variant::VariantPathElement; 🔒
use std::collections::BTreeMap; 🔒
use std::sync::Arc; 🔒

ShreddedSchemaBuilder: Builder for constructing a variant shredding schema.
ShreddingField: Field configuration captured by the builder (data type + nullability).
VariantToShreddedArrayVariantRowBuilder 🔒
VariantToShreddedObjectVariantRowBuilder 🔒
VariantToShreddedPrimitiveVariantRowBuilder 🔒: A shredded primitive field builder.

NullValue 🔒: Controls how append_null is encoded for a shredded (value, typed_value) pair.
VariantSchemaNode 🔒: Internal tree node structure for building variant schemas.
VariantToShreddedVariantRowBuilder 🔒

IntoShreddingField: Convenience conversion to allow passing either FieldRef, DataType, or (DataType, bool).

make_variant_to_shredded_variant_arrow_row_builder 🔒
shred_variant: Shreds the input binary variant using a target shredding schema derived from the requested data type.
shred_variant_with_options 🔒