Module reader

Expand description

Contains column reader API.

Re-exports§

use bytes::Bytes; 🔒
use super::page::Page; 🔒
use super::page::PageReader; 🔒
use crate::column::reader::decoder::ColumnValueDecoder; 🔒
use crate::column::reader::decoder::ColumnValueDecoderImpl; 🔒
use crate::column::reader::decoder::DefinitionLevelDecoder; 🔒
use crate::column::reader::decoder::DefinitionLevelDecoderImpl; 🔒
use crate::column::reader::decoder::RepetitionLevelDecoder; 🔒
use crate::column::reader::decoder::RepetitionLevelDecoderImpl; 🔒
use crate::column::reader::decoder::normalize_fixed_len_byte_array_data; 🔒
use crate::column::reader::decoder::prepare_v1_fixed_len_byte_array; 🔒
use crate::errors::ParquetError; 🔒
use crate::errors::Result; 🔒
use crate::schema::types::ColumnDescPtr; 🔒
use crate::util::bit_util::ceil; 🔒
use crate::util::bit_util::num_required_bits; 🔒
use crate::util::bit_util::read_num_bytes; 🔒
use crate::basic::*; 🔒
use crate::data_type::*; 🔒

decoder 🔒
legacy_fixed_len_byte_array 🔒: Temporary reader mitigation for arrow-rs #11261, fixed by #11262. These historical layouts are not additional Parquet encodings.

GenericColumnReader: Reads data for a given column chunk, using the provided decoders:

check_partial_record_fits 🔒: Checks that a partial record can still be flushed into the caller’s record budget.
get_column_reader: Gets a specific column reader corresponding to column descriptor col_descr. The column reader will read from pages in col_page_reader.
get_typed_column_reader: Gets a typed column reader for the specific type T, by “up-casting” col_reader of non-generic type to a generic column reader type ColumnReaderImpl.
parse_v1_level 🔒