Skip to main content

Module encode

Module encode 

Source
Expand description

Encoder to create FlightData streams from RecordBatch streams. See FlightDataEncoderBuilder.

Re-exportsยง

use std::collections::VecDeque; ๐Ÿ”’
use std::fmt::Debug; ๐Ÿ”’
use std::fmt::Debug; ๐Ÿ”’
use std::pin::Pin; ๐Ÿ”’
use std::sync::Arc; ๐Ÿ”’
use std::task::Poll; ๐Ÿ”’
use crate::FlightData; ๐Ÿ”’
use crate::FlightDescriptor; ๐Ÿ”’
use crate::SchemaAsIpc; ๐Ÿ”’
use crate::error::Result; ๐Ÿ”’
use arrow_array::Array; ๐Ÿ”’
use arrow_array::ArrayRef; ๐Ÿ”’
use arrow_array::RecordBatch; ๐Ÿ”’
use arrow_array::RecordBatchOptions; ๐Ÿ”’
use arrow_array::UnionArray; ๐Ÿ”’
use arrow_ipc::writer::DictionaryTracker; ๐Ÿ”’
use arrow_ipc::writer::IpcDataGenerator; ๐Ÿ”’
use arrow_ipc::writer::IpcWriteContext; ๐Ÿ”’
use arrow_ipc::writer::IpcWriteOptions; ๐Ÿ”’
use arrow_schema::ArrowError; ๐Ÿ”’
use arrow_schema::DataType; ๐Ÿ”’
use arrow_schema::Field; ๐Ÿ”’
use arrow_schema::FieldRef; ๐Ÿ”’
use arrow_schema::Fields; ๐Ÿ”’
use arrow_schema::Schema; ๐Ÿ”’
use arrow_schema::SchemaRef; ๐Ÿ”’
use arrow_schema::UnionMode; ๐Ÿ”’
use bytes::Bytes; ๐Ÿ”’
use futures::Stream; ๐Ÿ”’
use futures::StreamExt; ๐Ÿ”’
use futures::ready; ๐Ÿ”’
use futures::stream::BoxStream; ๐Ÿ”’

Structsยง

FlightDataEncoder
Stream that encodes a stream of record batches to flight data.
FlightDataEncoderBuilder
Creates a [Stream] of FlightDatas from a Stream of Result<RecordBatch, FlightError>.
FlightIpcEncoder ๐Ÿ”’
The data needed to encode a stream of flight data, holding on to shared Dictionaries.

Enumsยง

DictionaryHandling
Defines how a FlightDataEncoder encodes DictionaryArrays

Constantsยง

GRPC_TARGET_MAX_FLIGHT_SIZE_BYTES
Default target size for encoded FlightData.

Functionsยง

hydrate_dictionaries ๐Ÿ”’
Hydrates any dictionaries arrays in batch to its underlying type. See hydrate_dictionary for more information.
hydrate_dictionary ๐Ÿ”’
Hydrates a dictionary to its underlying type.
prepare_field_for_flight ๐Ÿ”’
prepare_schema_for_flight ๐Ÿ”’
Prepare an arrow Schema for transport over the Arrow Flight protocol
split_batch_for_grpc_response ๐Ÿ”’
Split RecordBatch so it hopefully fits into a gRPC response.