Module async_reader 

async API for reading Parquet files as [RecordBatch]es

See the crate-level documentation for more details.

See example on ParquetRecordBatchStreamBuilder::new

Re-exports

use std::fmt::Formatter; 🔒

use std::io::SeekFrom; 🔒

use std::ops::Range; 🔒

use std::pin::Pin; 🔒

use std::sync::Arc; 🔒

use std::task::Context; 🔒

use std::task::Poll; 🔒

use bytes::Bytes; 🔒

use futures::future::BoxFuture; 🔒

use futures::future::FutureExt; 🔒

use futures::stream::Stream; 🔒

use tokio::io::AsyncRead; 🔒

use tokio::io::AsyncReadExt; 🔒

use tokio::io::AsyncSeek; 🔒

use tokio::io::AsyncSeekExt; 🔒

use arrow_array::ArrayRef; 🔒

use arrow_array::RecordBatch; 🔒

use arrow_schema::Schema; 🔒

use arrow_schema::SchemaRef; 🔒

use crate::arrow::arrow_reader::ArrowReaderBuilder; 🔒

use crate::arrow::arrow_reader::ArrowReaderMetadata; 🔒

use crate::arrow::arrow_reader::ArrowReaderOptions; 🔒

use crate::arrow::arrow_reader::ParquetRecordBatchReader; 🔒

use crate::bloom_filter::Sbbf; 🔒

use crate::errors::ParquetError; 🔒

use crate::errors::Result; 🔒

use crate::file::metadata::ParquetMetaData; 🔒

use crate::file::metadata::ParquetMetaDataReader; 🔒

pub use spawn::SpawnedReader;

pub use crate::arrow::arrow_reader::RowGroupSelection;

use crate::DecodeResult; 🔒

use crate::arrow::push_decoder::ParquetPushDecoder; 🔒

use crate::arrow::push_decoder::ParquetPushDecoderBuilder; 🔒

use crate::arrow::push_decoder::PushDecoderInput; 🔒

Modules

metadata 🔒

spawn 🔒

store 🔒

Structs

ParquetObjectReaderDeprecated

Reads Parquet files in object storage using [ObjectStore].

ParquetRecordBatchStream

An asynchronous Streamof [RecordBatch] constructed using ParquetRecordBatchStreamBuilder to read parquet files.

Enums

RequestState 🔒

State machine that tracks outstanding requests to fetch data

Traits

AsyncFileReader

The asynchronous interface used by ParquetRecordBatchStream to read parquet files

MetadataFetch

A data source that can be used with ParquetMetaDataReader to load ParquetMetaData

MetadataSuffixFetch

A data source that can be used with ParquetMetaDataReader to load ParquetMetaData via suffix requests, without knowing the file size

Type Aliases

ParquetRecordBatchStreamBuilder

A builder for reading parquet files from an async source as ParquetRecordBatchStream