Expand description
SerializedFileWriter: Low level Parquet writer API
Structsยง
- Page
Encryptor ๐Context - Context required to create a
PageEncryptorfor a column - Serialized
Column Writer - A wrapper around a
ColumnWriterthat invokes a callback onSelf::close - Serialized
File Writer - Parquet file writer API.
- Serialized
Page Writer - A serialized implementation for Parquet
PageWriter. Writes and serializes pages and metadata into output stream. - Serialized
RowGroup Writer - Parquet row group writer API.
- Tracked
Write - A wrapper around a
Writethat keeps track of the number of bytes that have been written. The givenWriteis wrapped with aBufWriterto optimize writing performance.
Functionsยง
- get_
file_ ๐magic - Get the magic bytes at the start and end of the file that identify this as a Parquet file.
- write_
bloom_ ๐filters - Serialize all the bloom filters of the given row group to the given buffer, and returns the updated row group metadata.
Type Aliasesยง
- OnClose
Column Chunk - Callback invoked on closing a column chunk
- OnClose
RowGroup - Callback invoked on closing a row group, arguments are: