Skip to main content

Module push_decoder

Module push_decoder 

Source
Expand description

ParquetPushDecoder: decodes Parquet data with data provided by the caller (rather than from an underlying reader).

Re-exports§

pub use crate::arrow::arrow_reader::RowGroupSelection;

Modules§

reader_builder 🔒
remaining 🔒
scan_plan 🔒
ScanPlan: the byte ranges that a push decoder may still read.

Structs§

ParquetPushDecoder
A push based Parquet Decoder
PlannedRange
One item of a ScanPlan.
PushBuffers
Holds multiple non-contiguous, caller-provided buffers of file data.
PushDecoderInput
The input of a ParquetPushDecoderBuilder.
ScanPlan
The byte ranges that a push decoder may still read, in the order that decoding needs them.

Enums§

PageKind
What a PlannedRange contains.
ParquetDecoderState 🔒
Internal state machine for the ParquetPushDecoder

Functions§

builder_from_remaining 🔒
Reassemble a ParquetPushDecoderBuilder from a decoder’s not-yet-decoded state — the inverse of ParquetPushDecoderBuilder::build. The rebuilt builder carries the remaining row-group plan, offset/limit budget, and buffered bytes.

Type Aliases§

ParquetPushDecoderBuilder
A builder for ParquetPushDecoder.