Expand description
BatchCoalescer concatenates multiple [RecordBatch]es after
operations such as filter and take.
Re-exportsยง
use crate::filter::FilterBuilder;๐use crate::filter::FilterPredicate;๐use crate::filter::FilterSelection;๐use crate::interleave::interleave_record_batch;๐use crate::take::take_record_batch;๐use arrow_array::types::BinaryViewType;๐use arrow_array::types::GenericBinaryType;๐use arrow_array::types::GenericStringType;๐use arrow_array::types::StringViewType;๐use arrow_array::Array;๐use arrow_array::ArrayRef;๐use arrow_array::BooleanArray;๐use arrow_array::RecordBatch;๐use arrow_array::downcast_primitive;๐use arrow_schema::ArrowError;๐use arrow_schema::DataType;๐use arrow_schema::SchemaRef;๐use std::collections::VecDeque;๐use std::sync::Arc;๐use boolean::InProgressBooleanArray;๐use byte::InProgressByteArray;๐use byte_view::InProgressByteViewArray;๐use dictionary::create_in_progress_dictionary;๐use fixed_size_binary::InProgressFixedSizeBinaryArray;๐use generic::GenericInProgressArray;๐use list::InProgressListArray;๐use primitive::InProgressPrimitiveArray;๐
Modulesยง
- boolean ๐
- byte ๐
- byte_
view ๐ - dictionary ๐
- fixed_
size_ ๐binary - generic ๐
- list ๐
- primitive ๐
Structsยง
- Batch
Coalescer - Concatenate multiple [
RecordBatch]es
Constantsยง
- BYTE_
ARRAY_ ๐DIRECT_ COPY_ MAX_ SELECTIVITY_ DENOMINATOR - SPARSE_
FILTER_ ๐COPY_ MAX_ SELECTIVITY_ DENOMINATOR - Maximum selected row fraction for the fused sparse-filter copy path.
Traitsยง
- InProgress
Array ๐ - Incrementally builds up arrays
Functionsยง
- check_
filter_ ๐len - Return an error if
filteris longer than the source array it is applied to. - create_
in_ ๐progress_ array - Return a new
InProgressArrayfor the given data type - has_
sparse_ ๐filter_ copy - should_
use_ ๐byte_ array_ direct_ copy - should_
use_ ๐sparse_ filter_ copy