Re-exportsยง
use crate::arrow::ProjectionMask;๐use crate::arrow::array_reader::RowGroups;๐use crate::arrow::arrow_reader::RowSelection;๐use crate::column::page::PageIterator;๐use crate::column::page::PageReader;๐use crate::errors::ParquetError;๐use crate::file::metadata::page_index::RowGroupPageIndex;๐use crate::file::metadata::ParquetMetaData;๐use crate::file::metadata::RowGroupMetaData;๐use crate::file::page_index::offset_index::PageLocation;๐use crate::file::reader::ChunkReader;๐use crate::file::reader::Length;๐use crate::file::reader::SerializedPageReader;๐use bytes::Buf;๐use bytes::Bytes;๐use std::ops::Range;๐use std::sync::Arc;๐
Structsยง
- Column
Chunk ๐Iterator - Implements
PageIteratorfor a single column chunk, yielding a singlePageReader - Fetch
Ranges ๐ - What ranges to fetch for the columns in this row group
- InMemory
RowGroup ๐ - An in-memory collection of column chunks
Enumsยง
- Column
Chunk ๐Data - An in-memory column chunk. This allows us to hold either dense column chunks or sparse column chunks and easily access them by offset.
- Column
Fetch ๐ - What
InMemoryRowGroup::fetch_rangesfetches for one column chunk.
Functionsยง
- column_
selection ๐ - The selection that
InMemoryRowGroup::fetch_rangesuses to choose the pages of columnidx:expanded_selection(the selection expanded to batch boundaries) ifcache_maskincludes the column, elseselection. - columns_
to_ ๐fetch - The leaf columns in
projectionthat are not yet read, in column order. - dictionary_
range ๐ - Byte range of the dictionary page of a column chunk that starts at
chunk_start: the bytes before the first data page, if any. - page_
range ๐ - Byte range of a data page.