Struct PackedDecoder

struct PackedDecoder {
    data: Bytes,
    data_offset: usize,
    rle_left: usize,
    rle_value: bool,
    packed_count: usize,
    packed_offset: usize,
}

An optimized decoder for decoding RLE and BIT_PACKED data with a bit width of 1 directly into a bitmask

This is significantly faster than decoding the data into [i16] and then computing a bitmask from this, as not only can it skip this buffer allocation and construction, but it can exploit properties of the encoded data to reduce work further

In particular:

• Packed runs are already bitmask encoded and can simply be appended
• Runs of 1 or 0 bits can be efficiently appended with byte (or larger) operations

Fields

data: Bytes

data_offset: usize

rle_left: usize

rle_value: bool

packed_count: usize

packed_offset: usize

Implementations

impl PackedDecoder

fn next_rle_block(&mut self) -> Result<()>

fn decode_header(&mut self) -> Result<i64>

Decodes a VLQ encoded little endian integer and returns it

impl PackedDecoder

fn new() -> Self

fn set_data(&mut self, encoding: Encoding, data: Bytes)

fn read( &mut self, buffer: &mut BooleanBufferBuilder, len: usize, ) -> Result<usize>

fn skip(&mut self, level_num: usize) -> Result<(usize, usize)>

Skips level_num definition levels

Returns the number of values skipped and the number of levels skipped