Skip to main content

Module reader_builder

Module reader_builder 

Source

Re-exportsยง

use crate::arrow::ProjectionMask; ๐Ÿ”’
use crate::arrow::array_reader::ArrayReaderBuilder; ๐Ÿ”’
use crate::arrow::array_reader::CacheOptions; ๐Ÿ”’
use crate::arrow::array_reader::RowGroupCache; ๐Ÿ”’
use crate::arrow::arrow_reader::metrics::ArrowReaderMetrics; ๐Ÿ”’
use crate::arrow::arrow_reader::selection::LoadedRowRanges; ๐Ÿ”’
use crate::arrow::arrow_reader::selection::RowSelectionStrategy; ๐Ÿ”’
use crate::arrow::arrow_reader::ParquetRecordBatchReader; ๐Ÿ”’
use crate::arrow::arrow_reader::PredicateOptions; ๐Ÿ”’
use crate::arrow::arrow_reader::ReadPlanBuilder; ๐Ÿ”’
use crate::arrow::arrow_reader::RowFilter; ๐Ÿ”’
use crate::arrow::arrow_reader::RowSelection; ๐Ÿ”’
use crate::arrow::arrow_reader::RowSelectionPolicy; ๐Ÿ”’
use crate::arrow::in_memory_row_group::ColumnChunkData; ๐Ÿ”’
use crate::arrow::push_decoder::reader_builder::data::DataRequestBuilder; ๐Ÿ”’
use crate::arrow::push_decoder::reader_builder::filter::CacheInfo; ๐Ÿ”’
use crate::arrow::push_decoder::scan_plan::BudgetedReadPlan; ๐Ÿ”’
use crate::arrow::push_decoder::scan_plan::RowBudget; ๐Ÿ”’
use crate::arrow::push_decoder::scan_plan::RowGroupFrontier; ๐Ÿ”’
use crate::arrow::push_decoder::scan_plan::ScanPlanBuilder; ๐Ÿ”’
use crate::arrow::schema::ParquetField; ๐Ÿ”’
use crate::errors::ParquetError; ๐Ÿ”’
use crate::file::metadata::page_index::RowGroupPageIndex; ๐Ÿ”’
use crate::file::metadata::ColumnChunkMetaData; ๐Ÿ”’
use crate::file::metadata::ParquetMetaData; ๐Ÿ”’
use crate::util::push_buffers::PushBuffers; ๐Ÿ”’
use bytes::Bytes; ๐Ÿ”’
use data::DataRequest; ๐Ÿ”’
use filter::AdvanceResult; ๐Ÿ”’
use filter::FilterInfo; ๐Ÿ”’
pub(crate) use stages::Stage; ๐Ÿ”’
pub(crate) use stages::StageSchedule; ๐Ÿ”’
use std::ops::Range; ๐Ÿ”’
use std::sync::Arc; ๐Ÿ”’
use std::sync::RwLock; ๐Ÿ”’

Modulesยง

data ๐Ÿ”’
DataRequest tracks and holds data needed to construct InMemoryRowGroups
filter ๐Ÿ”’
FilterInfo state machine for evaluating row filters
stages ๐Ÿ”’
StageSchedule: what each decoding stage of a row group fetches.

Structsยง

NextState ๐Ÿ”’
Result of a state transition
RowGroupInfo ๐Ÿ”’
The current row group being read, its read plan, and its offset/limit budget.
RowGroupReaderBuilder ๐Ÿ”’
Builder for ParquetRecordBatchReader for a single row group
RowGroupReaderBuilderParts ๐Ÿ”’
The parts of a RowGroupReaderBuilder needed to rebuild it, recovered by RowGroupReaderBuilder::into_parts.

Enumsยง

RowGroupBuildResult ๐Ÿ”’
RowGroupDecoderState ๐Ÿ”’
This is the inner state machine for reading a single row group.

Functionsยง

column_chunk_range ๐Ÿ”’
The byte range of a column chunk in the file.
loaded_row_ranges_for_projection ๐Ÿ”’
Computes row ranges for which every projected column has page data loaded.
prepare_selection_for_page_skipping ๐Ÿ”’
Prepare row selection execution when page pruning produced sparse column data.