Module ffi_stream 

Contains declarations to bind to the C Stream Interface.

This module has two main interfaces: One interface maps C ABI to native Rust types, i.e. convert c-pointers, c_char, to native rust. This is handled by FFI_ArrowArrayStream.

The second interface is used to import FFI_ArrowArrayStream as a Rust reader. A stream whose top-level type is Struct can be read as RecordBatch by RecordBatchStreamReader; a stream of any type can be read as ArrayRef by ArrayStreamReader.

// create an record batch reader natively
let file = File::open("arrow_file").unwrap();
let reader = Box::new(FileReader::try_new(file).unwrap());

// export it
let mut stream = FFI_ArrowArrayStream::empty();
unsafe { export_reader_into_raw(reader, &mut stream) };

// consumed and used by something else...

// import it
let stream_reader = unsafe { RecordBatchStreamReader::from_raw(&mut stream).unwrap() };
let imported_schema = stream_reader.schema();

let mut produced_batches = vec![];
for batch in stream_reader {
     produced_batches.push(batch.unwrap());
}
Ok(())
}

Structs

ArrayStreamReader

An ArrayReader which imports arrays from an FFI_ArrowArrayStream.

FFI_ArrowArrayStream

ABI-compatible struct for ArrayStream from C Stream Interface See https://arrow.apache.org/docs/format/CStreamInterface.html#structure-definitions This was created by bindgen

RecordBatchStreamReader

A RecordBatchReader which imports Arrays from FFI_ArrowArrayStream.

Type Aliases

ArrowArrayStreamReaderDeprecated

Renamed to RecordBatchStreamReader, to distinguish it from ArrayStreamReader.