Struct InProgressDictionaryArray 

struct InProgressDictionaryArray<K: ArrowDictionaryKeyType> {
    source: Option<ArrayRef>,
    len: usize,
    empty_values: ArrayRef,
    sources: Vec<ArrayRef>,
    source_ids: HashMap<usize, usize, RandomState>,
    chunks: Vec<KeyChunk<K>>,
}

Fields

source: Option<ArrayRef>

Dictionary currently selected by InProgressArray::set_source.

len: usize

Number of output rows retained across chunks.

empty_values: ArrayRef

Typed empty values array used when finishing without any rows.

sources: Vec<ArrayRef>

Distinct dictionary values arrays retained by buffer identity.

source_ids: HashMap<usize, usize, RandomState>

Maps each retained values Arc address to its index in sources.

chunks: Vec<KeyChunk<K>>

Zero-copy key slices in output order, tagged with their values source.

Implementations

impl<K: ArrowDictionaryKeyType> InProgressDictionaryArray<K>

fn new(value_type: &DataType) -> Self

fn source_id(&mut self, values: ArrayRef) -> usize

Returns a stable index for values, reusing a source when either its Arc pointer or its backing buffer pointers match.

fn merge_sources( sources: &[ArrayRef], chunks: &[KeyChunk<K>], len: usize, ) -> Result<(Vec<K::Native>, ArrayRef), ArrowError>

Compacts referenced values and remaps source-local keys while preserving chunk order. Equal referenced values are only deduplicated when their count would overflow K’s key space.

fn build_nulls(chunks: &[KeyChunk<K>], len: usize) -> Option<NullBuffer>

Concatenates chunk validity in output order, omitting it when all keys are valid.

Trait Implementations

impl<K: ArrowDictionaryKeyType> Debug for InProgressDictionaryArray<K>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<K: ArrowDictionaryKeyType> InProgressArray for InProgressDictionaryArray<K>

fn size(&self) -> usize

Estimates memory retained by the source, value arrays, key slices, and bookkeeping.

fn set_source(&mut self, source: Option<ArrayRef>)

Set the source array.

fn copy_rows(&mut self, offset: usize, len: usize) -> Result<(), ArrowError>

Copy rows from the current source array into the in-progress array

fn finish(&mut self) -> Result<ArrayRef, ArrowError>

Finish the currently in-progress array and return it as an ArrayRef

fn copy_rows_by_filter( &mut self, filter: &FilterPredicate, ) -> Result<(), ArrowError>

Copy rows selected by filter from the current source array.

fn copy_rows_by_filter_from( &mut self, source: ArrayRef, filter: &FilterPredicate, ) -> Result<(), ArrowError>

Copy rows selected by a FilterPredicate from source.

fn copy_rows_by_selection( &mut self, selection: FilterSelection<'_>, ) -> Result<(), ArrowError>

Copy rows described by a FilterSelection from the current source array.