Module async_reader 

Asynchronous implementation of Avro file reader.

This module provides AsyncAvroFileReader, which supports reading and decoding the Avro OCF format from any source that implements AsyncFileReader.

Re-exports

use crate::compression::CompressionCodec; 🔒

use crate::reader::Decoder; 🔒

use crate::reader::block::BlockDecoder; 🔒

use crate::reader::block::BlockDecoderState; 🔒

use arrow_array::RecordBatch; 🔒

use arrow_schema::ArrowError; 🔒

use arrow_schema::SchemaRef; 🔒

use bytes::Bytes; 🔒

use futures::future::BoxFuture; 🔒

use futures::FutureExt; 🔒

use futures::Stream; 🔒

use std::mem; 🔒

use std::ops::Range; 🔒

use std::pin::Pin; 🔒

use std::task::Context; 🔒

use std::task::Poll; 🔒

use crate::errors::AvroError; 🔒

Modules

async_file_reader 🔒

builder 🔒

spawn 🔒

store 🔒

Structs

AsyncAvroFileReader

An asynchronous Avro file reader that implements Stream<Item = Result<RecordBatch, ArrowError>>. This uses an AsyncFileReader to fetch data ranges as needed, starting with fetching the header, then reading all the blocks in the provided range where:

AvroObjectReaderDeprecated

An implementation of an AsyncFileReader using the [ObjectStore] API.

ReaderBuilder

Builder for an asynchronous Avro file reader.

SpawnedReader

An AsyncFileReader that performs I/O on a separate tokio runtime.

Enums

FetchNextBehaviour 🔒

ReaderState 🔒

Traits

AsyncFileReader

The asynchronous interface used by super::AsyncAvroFileReader to read avro files

Functions

read_header_info

Reads the Avro file header (magic, metadata, sync marker) asynchronously from reader.