Expand description
Contains reader which reads parquet data into arrow [RecordBatch]
Modulesยง
- filter ๐
- metrics
- ArrowReaderMetrics for collecting metrics about the Arrow reader
- read_
plan ๐ ReadPlanandReadPlanBuilderfor determining which rows to read from a Parquet file- selection ๐
- statistics
StatisticsConverterto convert statistics in parquet format to arrow [ArrayRef].
Structsยง
- Arrow
Predicate Fn - An
ArrowPredicatecreated from anFnMutand aProjectionMask - Arrow
Reader Builder - Builder for constructing Parquet readers that decode into Apache Arrow arrays.
- Arrow
Reader Metadata - The metadata necessary to construct a
ArrowReaderBuilder - Arrow
Reader Options - Options that control how metadata is read for a parquet file
- Parquet
Record Batch Reader - An
Iterator<Item = ArrowResult<RecordBatch>>that yields [RecordBatch] read from a parquet data source - Read
Plan - A plan reading specific rows from a Parquet Row Group.
- Read
Plan Builder - A builder for
ReadPlan - Reader
Page ๐Iterator - Reader
RowGroups ๐ - RowFilter
- Filter applied during the parquet read process
- RowSelection
RowSelectionallows selecting or skipping a provided number of rows when scanning the parquet file.- RowSelector
RowSelectionis a collection ofRowSelectorused to skip rows when scanning a parquet file
Traitsยง
- Arrow
Predicate - A predicate operating on [
RecordBatch] - RowGroups
- Interface for reading data pages from the columns of one or more RowGroups.
Type Aliasesยง
- Parquet
Record Batch Reader Builder - A synchronous builder used to construct
ParquetRecordBatchReaderfor a file