Skip to main content

Module push_decoder

Module push_decoder 

Source
Expand description

ParquetPushDecoder: decodes Parquet data with data provided by the caller (rather than from an underlying reader).

Re-exportsΒ§

use crate::DecodeResult; πŸ”’
pub use crate::arrow::arrow_reader::RowGroupSelection;
use crate::arrow::arrow_reader::ArrowReaderBuilder; πŸ”’
use crate::arrow::arrow_reader::ArrowReaderMetadata; πŸ”’
use crate::arrow::arrow_reader::ArrowReaderOptions; πŸ”’
use crate::arrow::arrow_reader::ParquetRecordBatchReader; πŸ”’
use crate::errors::ParquetError; πŸ”’
use crate::file::metadata::ParquetMetaData; πŸ”’
use arrow_array::RecordBatch; πŸ”’
use bytes::Bytes; πŸ”’
use reader_builder::RowGroupReaderBuilder; πŸ”’
use reader_builder::RowGroupReaderBuilderParts; πŸ”’
use remaining::RemainingRowGroups; πŸ”’
use remaining::RemainingRowGroupsParts; πŸ”’
use scan_plan::RowBudget; πŸ”’
pub use scan_plan::PageKind;
pub use scan_plan::PlannedRange;
pub use scan_plan::ScanPlan;
use std::ops::Range; πŸ”’
use std::sync::Arc; πŸ”’

ModulesΒ§

reader_builder πŸ”’
remaining πŸ”’
scan_plan πŸ”’
ScanPlan: the byte ranges that a push decoder may still read.

StructsΒ§

ParquetPushDecoder
A push based Parquet Decoder
PushBuffers
Holds multiple non-contiguous, caller-provided buffers of file data.
PushDecoderInput
The input of a ParquetPushDecoderBuilder.

EnumsΒ§

ParquetDecoderState πŸ”’
Internal state machine for the ParquetPushDecoder

FunctionsΒ§

builder_from_remaining πŸ”’
Reassemble a ParquetPushDecoderBuilder from a decoder’s not-yet-decoded state β€” the inverse of ParquetPushDecoderBuilder::build. The rebuilt builder carries the remaining row-group plan, offset/limit budget, and buffered bytes.

Type AliasesΒ§

ParquetPushDecoderBuilder
A builder for ParquetPushDecoder.