Skip to main content

Module reader

Module reader 

Source

Re-exportsΒ§

use crate::arrow::ProjectionMask; πŸ”’
use crate::encryption::decrypt::FileDecryptionProperties; πŸ”’
use crate::errors::ParquetError; πŸ”’
use crate::errors::Result; πŸ”’
use crate::file::FOOTER_SIZE; πŸ”’
use crate::file::metadata::dictionary::decode_dictionary_page; πŸ”’
use crate::file::metadata::page_index::PageIndex; πŸ”’
use crate::file::metadata::page_index::PageIndexProvider; πŸ”’
use crate::file::metadata::parser::decode_metadata; πŸ”’
use crate::file::metadata::thrift::parquet_schema_from_bytes; πŸ”’
use crate::file::metadata::FooterTail; πŸ”’
use crate::file::metadata::ParquetMetaData; πŸ”’
use crate::file::metadata::ParquetMetaDataOptions; πŸ”’
use crate::file::metadata::ParquetMetaDataPushDecoder; πŸ”’
use crate::file::reader::ChunkReader; πŸ”’
use crate::schema::types::SchemaDescriptor; πŸ”’
use arrow_array::ArrayRef; πŸ”’
use bytes::Bytes; πŸ”’
use std::collections::BTreeSet; πŸ”’
use std::iter::FusedIterator; πŸ”’
use std::slice::Iter; πŸ”’
use std::sync::Arc; πŸ”’
use std::io::Read; πŸ”’
use std::ops::Range; πŸ”’
use crate::DecodeResult; πŸ”’
use crate::arrow::async_reader::MetadataFetch; πŸ”’
use crate::arrow::async_reader::MetadataSuffixFetch; πŸ”’

StructsΒ§

ColumnChunkMask
A cheaply cloneable struct to specify column chunks for which metadata is required.
ParquetMetaDataReader
Reads ParquetMetaData from a byte stream, with either synchronous or asynchronous I/O.

EnumsΒ§

AxisIndices πŸ”’
NeedsIndexData πŸ”’
The bounds needed to read page indexes
PageIndexPolicy
Describes the policy for reading page indexes

FunctionsΒ§

dictionary_page_byte_range πŸ”’
Returns the [start, end) byte range of a column chunk’s dictionary page, or None if the column chunk has no dictionary page or is not a BYTE_ARRAY column (the only physical type decode_dictionary_page currently supports).
needs_page_index_data πŸ”’
Determines a single combined range of bytes needed to read the page indexes, or returns the metadata and decoded page index if no additional data is needed.
parse_page_index_data πŸ”’
Given a push decoder that has had the needed ranges pushed to it, decode and return the metadata and page indexes.