arrow_select::filter

Constant FILTER_SLICES_SELECTIVITY_THRESHOLD

Source
const FILTER_SLICES_SELECTIVITY_THRESHOLD: f64 = 0.8;
Expand description

If the filter selects more than this fraction of rows, use SlicesIterator to copy ranges of values. Otherwise iterate over individual rows using IndexIterator

Threshold of 0.8 chosen based on https://dl.acm.org/doi/abs/10.1145/3465998.3466009