Expand description
This module is the bridge between a Parquet file’s thrift encoded metadata and this crate’s Parquet metadata API. It contains objects and functions used to serialize/deserialize metadata objects into/from the Thrift compact protocol format as defined by the Parquet specification.
Modules§
- encryption 🔒
- Encryption support for Thrift serialization
Structs§
- Bounding
Box 🔒 - Data
Page 🔒Header - Data
Page 🔒Header V2 - Dictionary
Page 🔒Header - File
Meta 🔒 - Geospatial
Statistics 🔒 - Index
Page 🔒Header - Page
Header 🔒 - Page
Statistics 🔒 - Statistics for the page header.
- Schema
Element 🔒 - Size
Statistics 🔒 - Statistics 🔒
Constants§
- COL_
META_ 🔒ALL_ REQUIRED - COL_
META_ 🔒CODEC - COL_
META_ 🔒DATA_ PAGE_ OFFSET - COL_
META_ 🔒ENCODINGS - COL_
META_ 🔒NUM_ VALUES - COL_
META_ 🔒TOTAL_ COMP_ SZ - COL_
META_ 🔒TOTAL_ UNCOMP_ SZ - COL_
META_ 🔒TYPE
Functions§
- convert_
bounding_ 🔒box - convert_
geo_ 🔒stats - convert_
stats 🔒 - Create a
crate::file::statistics::Statistics
from a thriftStatistics
object. - parquet_
metadata_ 🔒from_ bytes - Create
ParquetMetaData
from thrift input. Note that this only decodes the file metadata in the Parquet footer. Page indexes will need to be added later. - read_
column_ 🔒chunk - read_
column_ 🔒metadata - read_
row_ 🔒group - serialize_
column_ 🔒meta_ data - validate_
column_ 🔒metadata - write_
schema 🔒 - write_
schema_ 🔒helper