Skip to main content

Module decoder

Module decoder 

Source

Re-exportsยง

use bytes::Bytes; ๐Ÿ”’
use crate::basic::Encoding; ๐Ÿ”’
use crate::basic::EncodingMask; ๐Ÿ”’
use crate::basic::Type; ๐Ÿ”’
use crate::data_type::DataType; ๐Ÿ”’
use crate::encodings::decoding::Decoder; ๐Ÿ”’
use crate::encodings::decoding::DictDecoder; ๐Ÿ”’
use crate::encodings::decoding::PlainDecoder; ๐Ÿ”’
use crate::encodings::decoding::get_decoder; ๐Ÿ”’
use crate::encodings::rle::RleDecoder; ๐Ÿ”’
use crate::errors::ParquetError; ๐Ÿ”’
use crate::errors::Result; ๐Ÿ”’
use crate::schema::types::ColumnDescPtr; ๐Ÿ”’
use crate::util::bit_util::BitReader; ๐Ÿ”’
use crate::util::bit_util::num_required_bits; ๐Ÿ”’

Structsยง

ColumnValueDecoderImpl
An implementation of ColumnValueDecoder for [T::T]
DefinitionLevelDecoderImpl
An implementation of DefinitionLevelDecoder for [i16]
PreparedFixedLenByteArrayPage ๐Ÿ”’
A value section ready for its ordinary decoder. When validate_count is set, account for its physical values during normal level decoding.
RepetitionLevelDecoderImpl
An implementation of RepetitionLevelDecoder for [i16]

Enumsยง

LevelDecoder ๐Ÿ”’

Constantsยง

ENCODING_SLOTS ๐Ÿ”’
Bucket-based storage for decoder instances keyed by Encoding.
REPETITION_LEVELS_BATCH_SIZE ๐Ÿ”’

Traitsยง

ColumnLevelDecoder
Decodes level data
ColumnValueDecoder
Decodes value data
DefinitionLevelDecoder
RepetitionLevelDecoder

Functionsยง

count_levels_eq ๐Ÿ”’
Returns the number of levels equal to level.
fixed_len_byte_array_payload_size ๐Ÿ”’
normalize_fixed_len_byte_array_data ๐Ÿ”’
Prepare a complete FLBA data-page value section after extracting the levels. PLAIN requires exact size validation; other compliant encodings are unchanged.
normalize_fixed_len_byte_array_payload ๐Ÿ”’
Validate a complete decompressed PLAIN FLBA value section, excluding levels. num_values must count physical non-null values, not rows or requested values. Canonical payloads are returned unchanged, even if values resemble prefixes.
prepare_v1_fixed_len_byte_array ๐Ÿ”’
Prepare V1 FLBA values without teaching the column reader historical layouts. definition_levels contains the maximum level, encoding and encoded levels; absent levels mean that the pageโ€™s physical count is already known.