Expand description
ParquetPushDecoder: decodes Parquet data with data provided by the
caller (rather than from an underlying reader).
Re-exportsΒ§
use crate::DecodeResult;πpub use crate::arrow::arrow_reader::RowGroupSelection;use crate::arrow::arrow_reader::ArrowReaderBuilder;πuse crate::arrow::arrow_reader::ArrowReaderMetadata;πuse crate::arrow::arrow_reader::ArrowReaderOptions;πuse crate::arrow::arrow_reader::ParquetRecordBatchReader;πuse crate::errors::ParquetError;πuse crate::file::metadata::ParquetMetaData;πuse arrow_array::RecordBatch;πuse bytes::Bytes;πuse reader_builder::RowGroupReaderBuilder;πuse reader_builder::RowGroupReaderBuilderParts;πuse remaining::RemainingRowGroups;πuse remaining::RemainingRowGroupsParts;πuse scan_plan::RowBudget;πpub use scan_plan::PageKind;pub use scan_plan::PlannedRange;pub use scan_plan::ScanPlan;use std::ops::Range;πuse std::sync::Arc;π
ModulesΒ§
- reader_
builder π - remaining π
- scan_
plan π ScanPlan: the byte ranges that a push decoder may still read.
StructsΒ§
- Parquet
Push Decoder - A push based Parquet Decoder
- Push
Buffers - Holds multiple non-contiguous, caller-provided buffers of file data.
- Push
Decoder Input - The
inputof aParquetPushDecoderBuilder.
EnumsΒ§
- Parquet
Decoder πState - Internal state machine for the
ParquetPushDecoder
FunctionsΒ§
- builder_
from_ πremaining - Reassemble a
ParquetPushDecoderBuilderfrom a decoderβs not-yet-decoded state β the inverse ofParquetPushDecoderBuilder::build. The rebuilt builder carries the remaining row-group plan, offset/limit budget, and buffered bytes.
Type AliasesΒ§
- Parquet
Push Decoder Builder - A builder for
ParquetPushDecoder.