Skip to main content

Module async_reader

Module async_reader 

Source
Expand description

Asynchronous implementation of Avro file reader.

This module provides AsyncAvroFileReader, which supports reading and decoding the Avro OCF format from any source that implements AsyncFileReader.

Modulesยง

async_file_reader ๐Ÿ”’
builder ๐Ÿ”’
store ๐Ÿ”’

Structsยง

AsyncAvroFileReader
An asynchronous Avro file reader that implements Stream<Item = Result<RecordBatch, ArrowError>>. This uses an AsyncFileReader to fetch data ranges as needed, starting with fetching the header, then reading all the blocks in the provided range where:
AvroObjectReader
An implementation of an AsyncFileReader using the [ObjectStore] API.
ReaderBuilder
Builder for an asynchronous Avro file reader.

Enumsยง

FetchNextBehaviour ๐Ÿ”’
ReaderState ๐Ÿ”’

Traitsยง

AsyncFileReader
The asynchronous interface used by super::AsyncAvroFileReader to read avro files

Functionsยง

read_header_info
Reads the Avro file header (magic, metadata, sync marker) asynchronously from reader.