Skip to main content

Module dictionary

Module dictionary 

Source
Expand description

Decoding a column chunk’s dictionary page directly into an Arrow array, independent of the row-by-row ArrayReader machinery.

This is useful for callers that want the set of distinct values stored in a dictionary-encoded column chunk without reading any data pages, e.g. to prune a row group when the query predicate’s literals are known not to be in the dictionary.

Re-exportsΒ§

use crate::arrow::ByteArrayDecoderPlain; πŸ”’
use crate::arrow::OffsetBuffer; πŸ”’
use crate::basic::Encoding; πŸ”’
use crate::basic::PageType; πŸ”’
use crate::basic::Type as PhysicalType; πŸ”’
use crate::column::page::Page; πŸ”’
use crate::compression::CodecOptions; πŸ”’
use crate::compression::create_codec; πŸ”’
use crate::encryption::decrypt::CryptoContext; πŸ”’
use crate::errors::ParquetError; πŸ”’
use crate::errors::Result; πŸ”’
use crate::file::metadata::ColumnChunkMetaData; πŸ”’
use crate::file::metadata::ParquetMetaData; πŸ”’
use crate::file::serialized_reader::SerializedPageReaderContext; πŸ”’
use crate::file::serialized_reader::decode_page; πŸ”’
use crate::file::serialized_reader::read_page_header_len_from_bytes; πŸ”’
use crate::file::serialized_reader::verify_page_size; πŸ”’
use arrow_array::ArrayRef; πŸ”’
use arrow_schema::DataType as ArrowType; πŸ”’
use bytes::Bytes; πŸ”’
use std::sync::Arc; πŸ”’

FunctionsΒ§

decode_dictionary_page πŸ”’
Decodes the dictionary page of a column chunk into an [ArrayRef].
dictionary_page_crypto_context πŸ”’
Builds the crypto context needed to decrypt the dictionary page of column_metadata, or None if the file (or this column) isn’t encrypted.