Module unshred_variant 

Module for unshredding VariantArray by folding typed_value columns back into the value column.

Re-exports

use crate::variant_array::binary_array_value; 🔒

use crate::variant_array::validate_binary_array; 🔒

use crate::VariantArray; 🔒

use crate::VariantValueArrayBuilder; 🔒

use arrow::array::Array; 🔒

use arrow::array::ArrayRef; 🔒

use arrow::array::AsArray as _; 🔒

use arrow::array::BinaryArray; 🔒

use arrow::array::BinaryViewArray; 🔒

use arrow::array::BooleanArray; 🔒

use arrow::array::FixedSizeBinaryArray; 🔒

use arrow::array::GenericListArray; 🔒

use arrow::array::GenericListViewArray; 🔒

use arrow::array::LargeBinaryArray; 🔒

use arrow::array::LargeStringArray; 🔒

use arrow::array::ListLikeArray; 🔒

use arrow::array::PrimitiveArray; 🔒

use arrow::array::StringArray; 🔒

use arrow::array::StringViewArray; 🔒

use arrow::array::StructArray; 🔒

use arrow::buffer::NullBuffer; 🔒

use arrow::datatypes::ArrowPrimitiveType; 🔒

use arrow::datatypes::DataType; 🔒

use arrow::datatypes::Date32Type; 🔒

use arrow::datatypes::Decimal32Type; 🔒

use arrow::datatypes::Decimal64Type; 🔒

use arrow::datatypes::Decimal128Type; 🔒

use arrow::datatypes::DecimalType; 🔒

use arrow::datatypes::Float32Type; 🔒

use arrow::datatypes::Float64Type; 🔒

use arrow::datatypes::Int8Type; 🔒

use arrow::datatypes::Int16Type; 🔒

use arrow::datatypes::Int32Type; 🔒

use arrow::datatypes::Int64Type; 🔒

use arrow::datatypes::Time64MicrosecondType; 🔒

use arrow::datatypes::TimeUnit; 🔒

use arrow::datatypes::TimestampMicrosecondType; 🔒

use arrow::datatypes::TimestampNanosecondType; 🔒

use arrow::error::ArrowError; 🔒

use arrow::error::Result; 🔒

use arrow::temporal_conversions::time64us_to_time; 🔒

use chrono::DateTime; 🔒

use chrono::Utc; 🔒

use indexmap::IndexMap; 🔒

use parquet_variant::ObjectFieldBuilder; 🔒

use parquet_variant::Variant; 🔒

use parquet_variant::VariantBuilderExt; 🔒

use parquet_variant::VariantDecimal4; 🔒

use parquet_variant::VariantDecimal8; 🔒

use parquet_variant::VariantDecimal16; 🔒

use parquet_variant::VariantDecimalType; 🔒

use parquet_variant::VariantMetadata; 🔒

use std::marker::PhantomData; 🔒

use std::sync::Arc; 🔒

use uuid::Uuid; 🔒

Macros

handle_unshredded_case 🔒

Macro that handles the unshredded case (typed_value is missing or NULL) and returns early if handled. If not handled (shredded case), validates and returns the extracted value.

impl_append_to_variant_builder 🔒

Structs

DecimalUnshredRowBuilder 🔒

Generic builder for decimal unshredding

ListUnshredVariantBuilder 🔒

Builder for unshredding list/array types with recursive element processing

NullUnshredVariantBuilder 🔒

Builder for arrays with neither typed_value nor value (all Variant::Null)

StructUnshredVariantBuilder 🔒

Builder for unshredding struct/object types with nested fields

TimestampUnshredRowBuilder 🔒

Generic builder for timestamp types that handles timezone-aware conversion

UnshredPrimitiveRowBuilder 🔒

Generic unshred builder that works with any Array implementing AppendToVariantBuilder

ValueOnlyUnshredVariantBuilder 🔒

Builder for arrays that only have value column (already unshredded)

Enums

UnshredVariantRowBuilder 🔒

Row builder for converting shredded VariantArray rows back to unshredded form

Traits

AppendToVariantBuilder 🔒

Extension trait that directly adds row builder support for arrays that correspond to primitive variant types.

TimestampType 🔒

Trait for timestamp types to handle conversion to DateTime<Utc>

Functions

unshred_variant

Removes all (nested) typed_value columns from a VariantArray by converting them back to binary variant and merging the resulting values back into the value column.

value_field_is_non_nullable 🔒

value_nulls_are_masked 🔒

Returns true if every null in value is masked by a parent null, i.e. the column may be annotated non-nullable.