Module encoder

Module encoder 

Source
Expand description

Encodes RecordBatch into the Avro binary format. Avro Encoder for Arrow types.

StructsΒ§

BinaryEncoder πŸ”’
Unified binary encoder generic over offset size (i32/i64).
BinaryViewEncoder πŸ”’
BinaryView (byte view) encoder.
BooleanEncoder πŸ”’
DecimalEncoder πŸ”’
Generic Avro decimal encoder over Arrow decimal arrays.
DurationEncoder πŸ”’
Single generic encoder used for all three interval units. Writes Avro fixed(12) as three little-endian u32 values in one call.
DurationParts πŸ”’
EnumEncoder πŸ”’
Avro enum encoder for Arrow DictionaryArray<Int32, Utf8>.
F32Encoder πŸ”’
F64Encoder πŸ”’
FieldBinding πŸ”’
FieldEncoder πŸ”’
Arrow to Avro FieldEncoder:
FixedEncoder πŸ”’
Avro fixed encoder for Arrow FixedSizeBinaryArray. Spec: a fixed is encoded as exactly size bytes, with no length prefix.
FixedSizeListEncoder πŸ”’
FixedSizeList encoder.
IntEncoder πŸ”’
Generic Avro int encoder for primitive arrays with i32 native values.
ListEncoder πŸ”’
ListViewEncoder πŸ”’
ListView encoder using (offset, size) buffers.
LongEncoder πŸ”’
Generic Avro long encoder for primitive arrays with i64 native values.
MapEncoder πŸ”’
RecordEncoder πŸ”’
A pre-computed plan for encoding a RecordBatch to Avro.
RecordEncoderBuilder πŸ”’
Builder for RecordEncoder write plan
RunEncodedEncoder πŸ”’
Generic encoder for Arrow RunArray<R>-based sites (run-end encoded). Follows the pattern used by other generic encoders (i.e., ListEncoder<O>), avoiding runtime branching on run-end width.
StructEncoder πŸ”’
Time32SecondsToMillisEncoder πŸ”’
Time32(Second) to Avro time-millis (int), via safe scaling by 1000
TimestampSecondsToMillisEncoder πŸ”’
Timestamp(Second) to Avro timestamp-millis (long), via safe scaling by 1000
UnionEncoder πŸ”’
Utf8GenericEncoder πŸ”’
Utf8ViewEncoder πŸ”’
StringView encoder.
UuidEncoder πŸ”’
Avro UUID logical type encoder: Arrow FixedSizeBinary(16) to Avro string (UUID). Spec: uuid is a logical type over string (RFC‑4122). We output hyphenated form.

EnumsΒ§

Encoder πŸ”’
FieldPlan πŸ”’
Per‑site encoder plan for a field. This mirrors the Avro structure, so nested optional branch order can be honored exactly as declared by the schema.
KeyKind πŸ”’
Internal key array kind used by Map encoder.
NullState πŸ”’

TraitsΒ§

DecimalBeBytes πŸ”’
Minimal trait to obtain a big-endian fixed-size byte array for a decimal’s unscaled integer value at idx.
IntervalToDurationParts πŸ”’
Trait mapping an Arrow interval native value to Avro duration (months, days, millis).

FunctionsΒ§

encode_blocked_range πŸ”’
Encode a blocked range of items with Avro array block framing.
find_map_value_field_index πŸ”’
find_struct_child_index πŸ”’
minimal_twos_complement πŸ”’
Minimal two’s-complement big-endian representation helper for Avro decimal (bytes).
prepare_value_site_encoder πŸ”’
union_value_branch_byte πŸ”’
write_bool πŸ”’
write_int πŸ”’
write_len_prefixed πŸ”’
write_long πŸ”’
Encode a single Avro-long using ZigZag + variable length, buffered.
write_optional_index πŸ”’
Write the union branch index for an optional field.
write_sign_extended πŸ”’
Sign-extend (or validate/truncate) big-endian integer bytes to exactly n bytes.

Type AliasesΒ§

Decimal32Encoder πŸ”’
Decimal64Encoder πŸ”’
Decimal128Encoder πŸ”’
Decimal256Encoder πŸ”’
ListEncoder32 πŸ”’
ListEncoder64 πŸ”’
ListViewEncoder32 πŸ”’
ListViewEncoder64 πŸ”’
RunEncodedEncoder16 πŸ”’
RunEncodedEncoder32 πŸ”’
RunEncodedEncoder64 πŸ”’
Utf8Encoder πŸ”’
Utf8LargeEncoder πŸ”’