Struct RemainingRowGroups 

pub(crate) struct RemainingRowGroups {
    parquet_metadata: Arc<ParquetMetaData>,
    row_groups: VecDeque<usize>,
    selection: Option<RowSelection>,
    row_group_reader_builder: RowGroupReaderBuilder,
}

State machine that tracks the remaining high level chunks (row groups) of Parquet data are left to read.

This is currently a row group, but the author aspires to extend the pattern to data boundaries other than RowGroups in the future.

Fields

parquet_metadata: Arc<ParquetMetaData>

The underlying Parquet metadata

row_groups: VecDeque<usize>

The row groups that have not yet been read

selection: Option<RowSelection>

Remaining selection to apply to the next row groups

row_group_reader_builder: RowGroupReaderBuilder

State for building the reader for the current row group

Implementations

impl RemainingRowGroups

pub fn new( parquet_metadata: Arc<ParquetMetaData>, row_groups: Vec<usize>, selection: Option<RowSelection>, row_group_reader_builder: RowGroupReaderBuilder, ) -> Self

pub fn push_data(&mut self, ranges: Vec<Range<u64>>, buffers: Vec<Bytes>)

Push new data buffers that can be used to satisfy pending requests

pub fn buffered_bytes(&self) -> u64

Return the total number of bytes buffered so far

pub fn try_next_reader( &mut self, ) -> Result<DecodeResult<ParquetRecordBatchReader>, ParquetError>

returns ParquetRecordBatchReader suitable for reading the next group of rows from the Parquet data, or the list of data ranges still needed to proceed

Trait Implementations

impl Debug for RemainingRowGroups

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.