Struct AvroObjectReader 

pub struct AvroObjectReader {
    store: Arc<dyn ObjectStore>,
    path: Path,
    runtime: Option<Handle>,
}

An implementation of an AsyncFileReader using the [ObjectStore] API.

Fields

store: Arc<dyn ObjectStore>

path: Path

runtime: Option<Handle>

Implementations

impl AvroObjectReader

pub fn new(store: Arc<dyn ObjectStore>, path: Path) -> Self

Creates a new Self from a store implementation and file location.

pub fn with_runtime(self, handle: Handle) -> Self

Perform IO on the provided tokio runtime

Tokio is a cooperative scheduler, and relies on tasks yielding in a timely manner to service IO. Therefore, running IO and CPU-bound tasks, such as avro decoding, on the same tokio runtime can lead to degraded throughput, dropped connections and other issues. For more information see here.

fn spawn<F, O, E>(&self, f: F) -> BoxFuture<'_, Result<O, AvroError>>

where F: for<'a> FnOnce(&'a Arc<dyn ObjectStore>, &'a Path) -> BoxFuture<'a, Result<O, E>> + Send + 'static, O: Send + 'static, E: Error + Send + 'static,

Trait Implementations

impl AsyncFileReader for AvroObjectReader

fn get_bytes( &mut self, range: Range<u64>, ) -> BoxFuture<'_, Result<Bytes, AvroError>>

Retrieve the bytes in range

fn get_byte_ranges( &mut self, ranges: Vec<Range<u64>>, ) -> BoxFuture<'_, Result<Vec<Bytes>, AvroError>>

where Self: Send,

Retrieve multiple byte ranges. The default implementation will call get_bytes sequentially