Skip to main content

Module coalesce

Module coalesce 

Source
Expand description

BatchCoalescer concatenates multiple [RecordBatch]es after operations such as filter and take.

Re-exportsยง

use crate::filter::FilterBuilder; ๐Ÿ”’
use crate::filter::FilterPredicate; ๐Ÿ”’
use crate::filter::FilterSelection; ๐Ÿ”’
use crate::interleave::interleave_record_batch; ๐Ÿ”’
use crate::take::take_record_batch; ๐Ÿ”’
use arrow_array::types::BinaryViewType; ๐Ÿ”’
use arrow_array::types::GenericBinaryType; ๐Ÿ”’
use arrow_array::types::GenericStringType; ๐Ÿ”’
use arrow_array::types::StringViewType; ๐Ÿ”’
use arrow_array::Array; ๐Ÿ”’
use arrow_array::ArrayRef; ๐Ÿ”’
use arrow_array::BooleanArray; ๐Ÿ”’
use arrow_array::RecordBatch; ๐Ÿ”’
use arrow_array::downcast_primitive; ๐Ÿ”’
use arrow_schema::ArrowError; ๐Ÿ”’
use arrow_schema::DataType; ๐Ÿ”’
use arrow_schema::SchemaRef; ๐Ÿ”’
use std::collections::VecDeque; ๐Ÿ”’
use std::sync::Arc; ๐Ÿ”’
use boolean::InProgressBooleanArray; ๐Ÿ”’
use byte::InProgressByteArray; ๐Ÿ”’
use byte_view::InProgressByteViewArray; ๐Ÿ”’
use dictionary::create_in_progress_dictionary; ๐Ÿ”’
use fixed_size_binary::InProgressFixedSizeBinaryArray; ๐Ÿ”’
use generic::GenericInProgressArray; ๐Ÿ”’
use list::InProgressListArray; ๐Ÿ”’
use primitive::InProgressPrimitiveArray; ๐Ÿ”’

Modulesยง

boolean ๐Ÿ”’
byte ๐Ÿ”’
byte_view ๐Ÿ”’
dictionary ๐Ÿ”’
fixed_size_binary ๐Ÿ”’
generic ๐Ÿ”’
list ๐Ÿ”’
primitive ๐Ÿ”’

Structsยง

BatchCoalescer
Concatenate multiple [RecordBatch]es

Constantsยง

BYTE_ARRAY_DIRECT_COPY_MAX_SELECTIVITY_DENOMINATOR ๐Ÿ”’
SPARSE_FILTER_COPY_MAX_SELECTIVITY_DENOMINATOR ๐Ÿ”’
Maximum selected row fraction for the fused sparse-filter copy path.

Traitsยง

InProgressArray ๐Ÿ”’
Incrementally builds up arrays

Functionsยง

check_filter_len ๐Ÿ”’
Return an error if filter is longer than the source array it is applied to.
create_in_progress_array ๐Ÿ”’
Return a new InProgressArray for the given data type
has_sparse_filter_copy ๐Ÿ”’
should_use_byte_array_direct_copy ๐Ÿ”’
should_use_sparse_filter_copy ๐Ÿ”’