Struct MetadataLoader

pub struct MetadataLoader<F> {
    fetch: F,
    metadata: ParquetMetaData,
    remainder: Option<(usize, Bytes)>,
}

An asynchronous interface to load ParquetMetaData from an async source

Fields

fetch: F

Function that fetches byte ranges asynchronously

metadata: ParquetMetaData

The in-progress metadata

remainder: Option<(usize, Bytes)>

The offset and bytes of remaining unparsed data

Implementations

impl<F: MetadataFetch> MetadataLoader<F>

pub async fn load( fetch: F, file_size: usize, prefetch: Option<usize>, ) -> Result<Self>

👎Deprecated since 53.1.0: Use ParquetMetaDataReader

Create a new MetadataLoader by reading the footer information

See fetch_parquet_metadata for the meaning of the individual parameters

pub fn new(fetch: F, metadata: ParquetMetaData) -> Self

👎Deprecated since 53.1.0: Use ParquetMetaDataReader

Create a new MetadataLoader from an existing ParquetMetaData

pub async fn load_page_index( &mut self, column_index: bool, offset_index: bool, ) -> Result<()>

👎Deprecated since 53.1.0: Use ParquetMetaDataReader

Loads the page index, if any

• column_index: if true will load column index
• offset_index: if true will load offset index

pub fn finish(self) -> ParquetMetaData

Returns the finished ParquetMetaData