Struct BufferBuilder 

pub struct BufferBuilder<T>
where
    T: ArrowNativeType,
{
    buffer: MutableBuffer,
    len: usize,
    _marker: PhantomData<T>,
}

Builder for creating Arrow Buffer objects

A Buffer is the underlying data structure of Arrow’s Arrays.

For all supported types, there are type definitions for the generic version of BufferBuilder<T>, e.g. BufferBuilder.

Note it is typically faster to create buffers directly from Vec. See example on Buffer.

See Also

• BooleanBufferBuilder: for packing bits in BooleanBuffers
• NullBufferBuilder: for creating NullBuffers of null values

Example:

let mut builder = BufferBuilder::<u8>::new(100);
builder.append_slice(&[42, 43, 44]);
builder.append(45);
let buffer = builder.finish();
assert_eq!(unsafe { buffer.typed_data::<u8>() }, &[42, 43, 44, 45]);

Fields

buffer: MutableBuffer

len: usize

_marker: PhantomData<T>

Implementations

impl<T> BufferBuilder<T>

where T: ArrowNativeType,

pub fn new(capacity: usize) -> BufferBuilder<T>

Creates a new builder with initial capacity for at least capacity elements of type T.

The capacity can later be manually adjusted with the reserve() method. Also the append(), append_slice() and advance() methods automatically increase the capacity if needed.

Example:

let mut builder = BufferBuilder::<u8>::new(10);

assert!(builder.capacity() >= 10);

pub fn new_from_buffer(buffer: MutableBuffer) -> BufferBuilder<T>

Creates a new builder from a MutableBuffer

pub fn len(&self) -> usize

Returns the current number of array elements in the internal buffer.

Example:

let mut builder = BufferBuilder::<u8>::new(10);
builder.append(42);

assert_eq!(builder.len(), 1);

pub fn is_empty(&self) -> bool

Returns whether the internal buffer is empty.

Example:

let mut builder = BufferBuilder::<u8>::new(10);
builder.append(42);

assert_eq!(builder.is_empty(), false);

pub fn capacity(&self) -> usize

Returns the actual capacity (number of elements) of the internal buffer.

Note: the internal capacity returned by this method might be larger than what you’d expect after setting the capacity in the new() or reserve() functions.

pub fn advance(&mut self, i: usize)

Increases the number of elements in the internal buffer by n and resizes the buffer as needed.

The values of the newly added elements are 0. This method is usually used when appending NULL values to the buffer as they still require physical memory space.

Example:

let mut builder = BufferBuilder::<u8>::new(10);
builder.advance(2);

assert_eq!(builder.len(), 2);

pub fn reserve(&mut self, n: usize)

Reserves memory for at least n more elements of type T.

Example:

let mut builder = BufferBuilder::<u8>::new(10);
builder.reserve(10);

assert!(builder.capacity() >= 20);

pub fn append(&mut self, v: T)

Appends a value of type T into the builder, growing the internal buffer as needed.

Example:

let mut builder = BufferBuilder::<u8>::new(10);
builder.append(42);

assert_eq!(builder.len(), 1);

pub fn append_n(&mut self, n: usize, v: T)

Appends a value of type T into the builder N times, growing the internal buffer as needed.

Example:

let mut builder = BufferBuilder::<u8>::new(10);
builder.append_n(10, 42);

assert_eq!(builder.len(), 10);

pub fn append_n_zeroed(&mut self, n: usize)

Appends n, zero-initialized values

Example:

let mut builder = BufferBuilder::<u32>::new(10);
builder.append_n_zeroed(3);

assert_eq!(builder.len(), 3);
assert_eq!(builder.as_slice(), &[0, 0, 0])

pub fn append_slice(&mut self, slice: &[T])

Appends a slice of type T, growing the internal buffer as needed.

Example:

let mut builder = BufferBuilder::<u8>::new(10);
builder.append_slice(&[42, 44, 46]);

assert_eq!(builder.len(), 3);

pub fn as_slice(&self) -> &[T]

View the contents of this buffer as a slice

let mut builder = BufferBuilder::<f64>::new(10);
builder.append(1.3);
builder.append_n(2, 2.3);

assert_eq!(builder.as_slice(), &[1.3, 2.3, 2.3]);

pub fn as_slice_mut(&mut self) -> &mut [T]

View the contents of this buffer as a mutable slice

Example:

let mut builder = BufferBuilder::<f32>::new(10);

builder.append_slice(&[1., 2., 3.4]);
assert_eq!(builder.as_slice(), &[1., 2., 3.4]);

builder.as_slice_mut()[1] = 4.2;
assert_eq!(builder.as_slice(), &[1., 4.2, 3.4]);

pub fn truncate(&mut self, len: usize)

Shorten this BufferBuilder to len items

If len is greater than the builder’s current length, this has no effect

Example:

let mut builder = BufferBuilder::<u16>::new(10);

builder.append_slice(&[42, 44, 46]);
assert_eq!(builder.as_slice(), &[42, 44, 46]);

builder.truncate(2);
assert_eq!(builder.as_slice(), &[42, 44]);

builder.append(12);
assert_eq!(builder.as_slice(), &[42, 44, 12]);

pub unsafe fn append_trusted_len_iter( &mut self, iter: impl IntoIterator<Item = T>, )

Safety

This requires the iterator be a trusted length. This could instead require the iterator implement TrustedLen once that is stabilized.

pub fn finish(&mut self) -> Buffer

Resets this builder and returns an immutable Buffer.

Use Self::build when you don’t need to reuse this builder.

Example:

let mut builder = BufferBuilder::<u8>::new(10);
builder.append_slice(&[42, 44, 46]);
let buffer = builder.finish();
assert_eq!(unsafe { buffer.typed_data::<u8>() }, &[42, 44, 46]);

pub fn build(self) -> Buffer

Builds an immutable Buffer without resetting the builder.

This consumes the builder. Use Self::finish to reuse it.

Example:

let mut builder = BufferBuilder::<u8>::new(10);
builder.append_slice(&[42, 44, 46]);
let buffer = builder.build();
assert_eq!(unsafe { buffer.typed_data::<u8>() }, &[42, 44, 46]);

Trait Implementations

impl<T> Debug for BufferBuilder<T>

where T: Debug + ArrowNativeType,

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<T> Default for BufferBuilder<T>

where T: ArrowNativeType,

fn default() -> BufferBuilder<T>

Returns the “default value” for a type.

impl<T> Extend<T> for BufferBuilder<T>

where T: ArrowNativeType,

fn extend<I>(&mut self, iter: I)

where I: IntoIterator<Item = T>,

Extends a collection with the contents of an iterator.

fn extend_one(&mut self, item: A)

🔬This is a nightly-only experimental API. (extend_one)

Extends a collection with exactly one element.

fn extend_reserve(&mut self, additional: usize)

🔬This is a nightly-only experimental API. (extend_one)

Reserves capacity in a collection for the given number of additional elements.

impl<T> From<BufferBuilder<T>> for Buffer

where T: ArrowNativeType,

fn from(value: BufferBuilder<T>) -> Buffer

Converts to this type from the input type.

impl<T> From<BufferBuilder<T>> for ScalarBuffer<T>

where T: ArrowNativeType,

fn from(value: BufferBuilder<T>) -> ScalarBuffer<T>

Converts to this type from the input type.

impl<T> From<Vec<T>> for BufferBuilder<T>

where T: ArrowNativeType,

fn from(value: Vec<T>) -> BufferBuilder<T>

Converts to this type from the input type.

impl<T> FromIterator<T> for BufferBuilder<T>

where T: ArrowNativeType,

fn from_iter<I>(iter: I) -> BufferBuilder<T>

where I: IntoIterator<Item = T>,

Creates a value from an iterator.