Module writer

Module writer 

Source
Expand description

SerializedFileWriter: Low level Parquet writer API

Structsยง

PageEncryptorContext ๐Ÿ”’
Context required to create a PageEncryptor for a column
SerializedColumnWriter
A wrapper around a ColumnWriter that invokes a callback on Self::close
SerializedFileWriter
Parquet file writer API.
SerializedPageWriter
A serialized implementation for Parquet PageWriter. Writes and serializes pages and metadata into output stream.
SerializedRowGroupWriter
Parquet row group writer API.
TrackedWrite
A wrapper around a Write that keeps track of the number of bytes that have been written. The given Write is wrapped with a BufWriter to optimize writing performance.

Functionsยง

get_file_magic ๐Ÿ”’
Get the magic bytes at the start and end of the file that identify this as a Parquet file.
write_bloom_filters ๐Ÿ”’
Serialize all the bloom filters of the given row group to the given buffer, and returns the updated row group metadata.

Type Aliasesยง

OnCloseColumnChunk
Callback invoked on closing a column chunk
OnCloseRowGroup
Callback invoked on closing a row group, arguments are: