Module serialized_reader 

Contains implementations of the reader traits FileReader, RowGroupReader and PageReader Also contains implementations of the ChunkReader for files (with buffering) and byte arrays (RAM)

Re-exports

use crate::basic::PageType; 🔒

use crate::basic::Type; 🔒

use crate::bloom_filter::Sbbf; 🔒

use crate::column::page::Page; 🔒

use crate::column::page::PageMetadata; 🔒

use crate::column::page::PageReader; 🔒

use crate::compression::Codec; 🔒

use crate::compression::create_codec; 🔒

use crate::encryption::decrypt::CryptoContext; 🔒

use crate::encryption::decrypt::read_and_decrypt; 🔒

use crate::errors::ParquetError; 🔒

use crate::errors::Result; 🔒

use crate::file::metadata::page_index::RowGroupPageIndex; 🔒

use crate::file::metadata::thrift::PageHeader; 🔒

use crate::file::page_index::offset_index::PageLocation; 🔒

use crate::file::statistics; 🔒

use crate::file::properties::ReaderProperties; 🔒

use crate::file::properties::ReaderPropertiesPtr; 🔒

use crate::parquet_thrift::ThriftSliceInputProtocol; 🔒

use crate::parquet_thrift::ReadThrift; 🔒

use crate::parquet_thrift::ThriftReadInputProtocol; 🔒

use crate::record::Row; 🔒

use crate::record::reader::RowIter; 🔒

use crate::schema::types::SchemaDescPtr; 🔒

use crate::schema::types::Type as SchemaType; 🔒

use bytes::Bytes; 🔒

use std::collections::VecDeque; 🔒

use std::fs::File; 🔒

use std::io::Read; 🔒

use std::path::Path; 🔒

use std::sync::Arc; 🔒

use crate::file::metadata::*; 🔒

use crate::file::reader::*; 🔒

Structs

ReadOptions

A collection of options for reading a Parquet file.

ReadOptionsBuilder

A builder for ReadOptions. For the predicates that are added to the builder, they will be chained using ‘AND’ to filter the row groups.

SerializedFileReader

A serialized implementation for Parquet FileReader.

SerializedPageReader

A serialized implementation for Parquet PageReader.

SerializedPageReaderContext 🔒

SerializedRowGroupReader

A serialized implementation for Parquet RowGroupReader.

Enums

DeferredDictionaryPage 🔒

Location of a dictionary page skipped without decoding.

SerializedPageReaderState 🔒

Functions

decode_page 🔒

Decodes a Page from the provided buffer

get_midpoint_offset 🔒

Get midpoint offset for a row group

read_page_header_len_from_bytes 🔒

Reads (and decrypts, if context carries a crypto context) the page header stored at the front of buffer, returning the header and the number of bytes of buffer it occupies.

verify_page_header_len 🔒

verify_page_size 🔒

Type Aliases

ReadGroupPredicate

A predicate for filtering row groups, invoked with the metadata and index of each row group in the file. Only row groups for which the predicate evaluates to true will be scanned