Skip to main content

Module reader

Module reader 

Source

StructsΒ§

ColumnChunkMask
A cheaply cloneable struct to specify column chunks for which metadata is required.
ParquetMetaDataReader
Reads ParquetMetaData from a byte stream, with either synchronous or asynchronous I/O.

EnumsΒ§

AxisIndices πŸ”’
NeedsIndexData πŸ”’
The bounds needed to read page indexes
PageIndexPolicy
Describes the policy for reading page indexes

FunctionsΒ§

dictionary_page_byte_range πŸ”’
Returns the [start, end) byte range of a column chunk’s dictionary page, or None if the column chunk has no dictionary page or is not a BYTE_ARRAY column (the only physical type decode_dictionary_page currently supports).
needs_page_index_data πŸ”’
Determines a single combined range of bytes needed to read the page indexes, or returns the metadata and decoded page index if no additional data is needed.
parse_page_index_data πŸ”’
Given a push decoder that has had the needed ranges pushed to it, decode and return the metadata and page indexes.