Uses of Class
org.apache.arrow.memory.ArrowBuf
Package
Description
Memory Allocation, Accounting and Management.
-
Uses of ArrowBuf in io.netty.buffer
Modifier and TypeMethodDescriptionstatic NettyArrowBuf
NettyArrowBuf.unwrapBuffer
(ArrowBuf buf) unwrap arrow buffer into a netty buffer.ModifierConstructorDescriptionNettyArrowBuf
(ArrowBuf arrowBuf, BufferAllocator bufferAllocator, int length) Constructs a new instance. -
Uses of ArrowBuf in org.apache.arrow.compression
Modifier and TypeMethodDescriptionprotected ArrowBuf
Lz4CompressionCodec.doCompress
(BufferAllocator allocator, ArrowBuf uncompressedBuffer) protected ArrowBuf
ZstdCompressionCodec.doCompress
(BufferAllocator allocator, ArrowBuf uncompressedBuffer) protected ArrowBuf
Lz4CompressionCodec.doDecompress
(BufferAllocator allocator, ArrowBuf compressedBuffer) protected ArrowBuf
ZstdCompressionCodec.doDecompress
(BufferAllocator allocator, ArrowBuf compressedBuffer) Modifier and TypeMethodDescriptionprotected ArrowBuf
Lz4CompressionCodec.doCompress
(BufferAllocator allocator, ArrowBuf uncompressedBuffer) protected ArrowBuf
ZstdCompressionCodec.doCompress
(BufferAllocator allocator, ArrowBuf uncompressedBuffer) protected ArrowBuf
Lz4CompressionCodec.doDecompress
(BufferAllocator allocator, ArrowBuf compressedBuffer) protected ArrowBuf
ZstdCompressionCodec.doDecompress
(BufferAllocator allocator, ArrowBuf compressedBuffer) -
Uses of ArrowBuf in org.apache.arrow.flight
Modifier and TypeMethodDescriptionPutResult.getApplicationMetadata()
Get the metadata in this message.FlightStream.getLatestMetadata()
Get the most recent metadata sent from the server.Modifier and TypeMethodDescriptionstatic PutResult
Create a PutResult with application-specific metadata.void
OutboundStreamListener.putMetadata
(ArrowBuf metadata) Send a pure metadata message without any associated data.void
Send the current contents of the associatedVectorSchemaRoot
alongside application-defined metadata. -
Uses of ArrowBuf in org.apache.arrow.flight.grpc
Modifier and TypeMethodDescriptionstatic void
GetReadableBuffer.readIntoBuffer
(InputStream stream, ArrowBuf buf, int size, boolean fastPath) Helper method to read a gRPC-provided InputStream into an ArrowBuf. -
Uses of ArrowBuf in org.apache.arrow.flight.sql
Modifier and TypeMethodDescriptionstatic NullableVarCharHolder
SqlInfoBuilder.getHolderForUtf8
(String string, ArrowBuf buf) -
Uses of ArrowBuf in org.apache.arrow.memory
Modifier and TypeMethodDescriptionAllocationReservation.allocateBuffer()
Allocate a buffer whose size is the total of all the add()s made.BufferAllocator.buffer
(long size) Allocate a new or reused buffer of the provided size.BufferAllocator.buffer
(long size, BufferManager manager) Allocate a new or reused buffer of the provided size.ArrowBuf.capacity
(long newCapacity) Adjusts the capacity of this buffer.ArrowBuf.clear()
BufferLedger.deriveBuffer
(ArrowBuf sourceBuffer, long index, long length) Derive a new ArrowBuf from a given source ArrowBuf.ReferenceManager.deriveBuffer
(ArrowBuf sourceBuffer, long index, long length) Derive a new ArrowBuf from a given source ArrowBuf.AllocationManager.Factory.empty()
BufferAllocator.getEmpty()
Get a reference to the empty buffer associated with this allocator.BufferManager.getManagedBuffer()
Get a managed buffer of indeterminate size.BufferManager.getManagedBuffer
(long size) Get a managed buffer of at least a certain size.BufferLedger.TransferResult.getTransferredBuffer()
OwnershipTransferNOOP.getTransferredBuffer()
OwnershipTransferResult.getTransferredBuffer()
ArrowBuf.readerIndex
(long readerIndex) Set the reader index for this ArrowBuf.ArrowBuf.reallocIfNeeded
(long size) Returnsthis
if size is less thancapacity()
, otherwise delegates toBufferManager.replace(ArrowBuf, long)
to get a new buffer.Replace an old buffer with a new version at least of the provided size.BufferLedger.retain
(ArrowBuf srcBuffer, BufferAllocator target) Create a new ArrowBuf that is associated with an alternative allocator for the purposes of memory ownership and accounting.ReferenceManager.retain
(ArrowBuf srcBuffer, BufferAllocator targetAllocator) Create a new ArrowBuf that is associated with an alternative allocator for the purposes of memory ownership and accounting.ArrowBuf.setOne
(int index, int length) Deprecated.ArrowBuf.setOne
(long index, long length) Sets all bits to one in the specified range.ArrowBuf.setZero
(long index, long length) Zero-out the bytes in this ArrowBuf starting at the given index for the given length.ArrowBuf.slice()
Returns a slice of only the readable bytes in the buffer.ArrowBuf.slice
(long index, long length) Returns a slice (view) starting atindex
with the givenlength
.default ArrowBuf
BufferAllocator.wrapForeignAllocation
(ForeignAllocation allocation) EXPERIMENTAL: Wrap an allocation created outside this BufferAllocator.ArrowBuf.writerIndex
(long writerIndex) Set the writer index for this ArrowBuf.Modifier and TypeMethodDescriptionBufferLedger.deriveBuffer
(ArrowBuf sourceBuffer, long index, long length) Derive a new ArrowBuf from a given source ArrowBuf.ReferenceManager.deriveBuffer
(ArrowBuf sourceBuffer, long index, long length) Derive a new ArrowBuf from a given source ArrowBuf.void
Copy a given length of data from this ArrowBuf starting at a given index into a dst ArrowBuf at dstIndex.Replace an old buffer with a new version at least of the provided size.BufferLedger.retain
(ArrowBuf srcBuffer, BufferAllocator target) Create a new ArrowBuf that is associated with an alternative allocator for the purposes of memory ownership and accounting.ReferenceManager.retain
(ArrowBuf srcBuffer, BufferAllocator targetAllocator) Create a new ArrowBuf that is associated with an alternative allocator for the purposes of memory ownership and accounting.void
Set the buffer to the contents of the given ArrowBuf.void
Copy readableBytes() number of bytes from src ArrowBuf starting from its readerIndex into this ArrowBuf starting at the given index.void
Copy data from src ArrowBuf starting at index srcIndex into this ArrowBuf at given index.BufferLedger.transferOwnership
(ArrowBuf srcBuffer, BufferAllocator target) Transfer the memory accounting ownership of this ArrowBuf to another allocator.ReferenceManager.transferOwnership
(ArrowBuf sourceBuffer, BufferAllocator targetAllocator) Duplicate the memory accounting ownership of the backing allocation of the given ArrowBuf in another allocator. -
Uses of ArrowBuf in org.apache.arrow.memory.netty
-
Uses of ArrowBuf in org.apache.arrow.memory.unsafe
-
Uses of ArrowBuf in org.apache.arrow.memory.util
Modifier and TypeMethodDescription@Nullable ArrowBuf
ArrowBufPointer.getBuf()
Gets the underlying buffer, or null if the underlying data is invalid or null.Modifier and TypeMethodDescriptionstatic int
ByteFunctionHelpers.compare
(ArrowBuf left, int lStart, int lEnd, byte[] right, int rStart, int rEnd) Helper function to compare a set of bytes in ArrowBuf to a ByteArray.static int
ByteFunctionHelpers.compare
(ArrowBuf left, long lStart, long lEnd, ArrowBuf right, long rStart, long rEnd) Helper function to compare a set of bytes in two ArrowBufs.static int
ByteFunctionHelpers.equal
(ArrowBuf left, long lStart, long lEnd, ArrowBuf right, long rStart, long rEnd) Helper function to check for equality of bytes in two ArrowBufs.static int
Compute hashCode with the givenArrowBuf
and start/end index.static final int
ByteFunctionHelpers.hash
(ArrowBufHasher hasher, ArrowBuf buf, long start, long end) Compute hashCode with the givenArrowBufHasher
,ArrowBuf
and start/end index.void
Sets this pointer.ModifierConstructorDescriptionArrowBufPointer
(ArrowBuf buf, long offset, long length) Constructs an Arrow buffer pointer.ArrowBufPointer
(ArrowBuf buf, long offset, long length, ArrowBufHasher hasher) Constructs an Arrow buffer pointer. -
Uses of ArrowBuf in org.apache.arrow.memory.util.hash
Modifier and TypeMethodDescriptionint
Calculates the hash code for a memory region.int
static int
Calculates the hash code for a memory region.int
Calculates the hash code for a memory region. -
Uses of ArrowBuf in org.apache.arrow.vector
Modifier and TypeFieldDescriptionprotected ArrowBuf
BaseLargeVariableWidthVector.offsetBuffer
protected ArrowBuf
BaseVariableWidthVector.offsetBuffer
protected ArrowBuf
BaseFixedWidthVector.validityBuffer
protected ArrowBuf
BaseLargeVariableWidthVector.validityBuffer
protected ArrowBuf
BaseVariableWidthVector.validityBuffer
protected ArrowBuf
BaseVariableWidthViewVector.validityBuffer
protected ArrowBuf
BaseFixedWidthVector.valueBuffer
protected ArrowBuf
BaseLargeVariableWidthVector.valueBuffer
protected ArrowBuf
BaseVariableWidthVector.valueBuffer
protected ArrowBuf
BaseVariableWidthViewVector.viewBuffer
Modifier and TypeMethodDescriptionprotected ArrowBuf
BaseVariableWidthViewVector.allocateOrGetLastDataBuffer
(int length) Decimal256Vector.get
(int index) Get the element at the given index from the vector.DecimalVector.get
(int index) Get the element at the given index from the vector.DurationVector.get
(int index) Get the element at the given index from the vector.IntervalDayVector.get
(int index) Get the element at the given index from the vector.IntervalMonthDayNanoVector.get
(int index) Get the element at the given index from the vector.ArrowBuf[]
BaseFixedWidthVector.getBuffers
(boolean clear) Return the underlying buffers associated with this vector.ArrowBuf[]
BaseLargeVariableWidthVector.getBuffers
(boolean clear) Return the underlying buffers associated with this vector.ArrowBuf[]
BaseVariableWidthVector.getBuffers
(boolean clear) Return the underlying buffers associated with this vector.ArrowBuf[]
BaseVariableWidthViewVector.getBuffers
(boolean clear) Return the underlying buffers associated with this vector.ArrowBuf[]
ExtensionTypeVector.getBuffers
(boolean clear) ArrowBuf[]
NullVector.getBuffers
(boolean clear) ArrowBuf[]
ValueVector.getBuffers
(boolean clear) Return the underlying buffers associated with this vector.BaseFixedWidthVector.getDataBuffer()
Get the buffer that stores the data for elements in the vector.BaseLargeVariableWidthVector.getDataBuffer()
Get the buffer that stores the data for elements in the vector.BaseVariableWidthVector.getDataBuffer()
Get the buffer that stores the data for elements in the vector.BaseVariableWidthViewVector.getDataBuffer()
Get the buffer that stores the data for elements in the vector.ExtensionTypeVector.getDataBuffer()
NullVector.getDataBuffer()
ValueVector.getDataBuffer()
Gets the underlying buffer associated with data vector.BaseFixedWidthVector.getOffsetBuffer()
buffer that stores the offsets for elements in the vector.BaseLargeVariableWidthVector.getOffsetBuffer()
buffer that stores the offsets for elements in the vector.BaseVariableWidthVector.getOffsetBuffer()
buffer that stores the offsets for elements in the vector.BaseVariableWidthViewVector.getOffsetBuffer()
BaseVariableWidthViewVector doesn't support offset buffer.ExtensionTypeVector.getOffsetBuffer()
NullVector.getOffsetBuffer()
ValueVector.getOffsetBuffer()
Gets the underlying buffer associated with offset vector.BaseFixedWidthVector.getValidityBuffer()
Get buffer that manages the validity (NULL or NON-NULL nature) of elements in the vector.BaseLargeVariableWidthVector.getValidityBuffer()
Get buffer that manages the validity (NULL or NON-NULL nature) of elements in the vector.BaseVariableWidthVector.getValidityBuffer()
Get buffer that manages the validity (NULL or NON-NULL nature) of elements in the vector.BaseVariableWidthViewVector.getValidityBuffer()
Get buffer that manages the validity (NULL or NON-NULL nature) of elements in the vector.ExtensionTypeVector.getValidityBuffer()
NullVector.getValidityBuffer()
ValueVector.getValidityBuffer()
Gets the underlying buffer associated with validity vector.static ArrowBuf
BitVectorHelper.loadValidityBuffer
(ArrowFieldNode fieldNode, ArrowBuf sourceValidityBuffer, BufferAllocator allocator) Returns a new buffer if the source validity buffer is either all null or all not-null, otherwise returns a buffer pointing to the same memory as source.protected ArrowBuf
BaseValueVector.releaseBuffer
(ArrowBuf buffer) static ArrowBuf
BaseLargeVariableWidthVector.set
(ArrowBuf buffer, BufferAllocator allocator, int valueCount, int index, long value) Method used by Json Reader to explicitly set the offsets of the variable width vector data.static ArrowBuf
BaseVariableWidthVector.set
(ArrowBuf buffer, BufferAllocator allocator, int valueCount, int index, int value) Method used by Json Reader to explicitly set the offsets of the variable width vector data.static ArrowBuf
BitVectorHelper.setValidityBit
(ArrowBuf validityBuffer, BufferAllocator allocator, int valueCount, int index, int value) Set the bit at a given index to provided value (1 or 0).static ArrowBuf
BaseValueVector.transferBuffer
(ArrowBuf srcBuffer, BufferAllocator targetAllocator) BufferBacked.unLoad()
Modifier and TypeMethodDescriptionBaseVariableWidthViewVector.getDataBuffers()
Get the buffers that store the data for views in the vector.BaseFixedWidthVector.getFieldBuffers()
Get the buffers belonging to this vector.BaseLargeVariableWidthVector.getFieldBuffers()
Get the buffers belonging to this vector.BaseVariableWidthVector.getFieldBuffers()
Get the buffers belonging to this vector.BaseVariableWidthViewVector.getFieldBuffers()
Get the buffers belonging to this vector.ExtensionTypeVector.getFieldBuffers()
FieldVector.getFieldBuffers()
Get the buffers of the fields, (same size as getFieldVectors() since it is their content).NullVector.getFieldBuffers()
Modifier and TypeMethodDescriptionstatic boolean
BitVectorHelper.checkAllBitsEqualTo
(ArrowBuf validityBuffer, int valueCount, boolean checkOneBits) Tests if all bits in a validity buffer are equal 0 or 1, according to the specified parameter.static void
BitVectorHelper.concatBits
(ArrowBuf input1, int numBits1, ArrowBuf input2, int numBits2, ArrowBuf output) Concat two validity buffers.default void
FieldVector.exportBuffer
(ArrowBuf buffer, List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue, boolean retain) Export a given buffer and its memory address into a list of buffers and a pointer to the list of buffers.void
BaseLargeVariableWidthVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Export the buffers of the fields for C Data Interface.void
BaseVariableWidthVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Export the buffers of the fields for C Data Interface.void
BaseVariableWidthViewVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Get the data buffer of the vector.default void
FieldVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Export the buffers of the fields for C Data Interface.static byte[]
Method used by Json Writer to read a variable width element from the variable width vector and write to Json.static byte[]
Method used by Json Writer to read a variable width element from the variable width vector and write to Json.static long
Given a data buffer, get the value stored at a particular position in the vector.static int
Check if a bit at a given index is set or not.static int
Given a data buffer, get the value stored at a particular position in the vector.static long
Given a data buffer, get the value stored at a particular position in the vector.static long
Given a data buffer, get the value stored at a particular position in the vector.static byte[]
Given a data buffer, get the value stored at a particular position in the vector.static float
Given a data buffer, get the value stored at a particular position in the vector.static double
Given a data buffer, get the value stored at a particular position in the vector.static int
Given a data buffer, get the value stored at a particular position in the vector.static short
Given a data buffer, get the value stored at a particular position in the vector.static long
Given a data buffer, get the value stored at a particular position in the vector.static int
Given a data buffer, get the value stored at a particular position in the vector.static long
Given a data buffer, get the value stored at a particular position in the vector.static int
Given a data buffer, get the value stored at a particular position in the vector.static long
Given a data buffer, get the value stored at a particular position in the vector.static byte
Given a data buffer, get the value stored at a particular position in the vector.static char
Given a data buffer, get the value stored at a particular position in the vector.static byte
BitVectorHelper.getBitsFromCurrentByte
(ArrowBuf data, int index, int offset) Returns the byte at index from data right-shifted by offset.static byte
BitVectorHelper.getBitsFromNextByte
(ArrowBuf data, int index, int offset) Returns the byte atindex
from left-shifted by (8 -offset
).static int
Given a data buffer, get the number of days stored at a particular position in the vector.static int
Given a data buffer, get the number of days stored at a particular position in the vector.static int
IntervalDayVector.getMilliseconds
(ArrowBuf buffer, int index) Given a data buffer, get the get the number of milliseconds stored at a particular position in the vector.static int
Given a data buffer, get the number of months stored at a particular position in the vector.static long
IntervalMonthDayNanoVector.getNanoseconds
(ArrowBuf buffer, int index) Given a data buffer, get the get the number of nanoseconds stored at a particular position in the vector.static short
UInt1Vector.getNoOverflow
(ArrowBuf buffer, int index) Given a data buffer, get the value stored at a particular position in the vector.static long
UInt4Vector.getNoOverflow
(ArrowBuf buffer, int index) Given a data buffer, get the value stored at a particular position in the vector.static BigInteger
UInt8Vector.getNoOverflow
(ArrowBuf buffer, int index) Given a data buffer, get the value stored at a particular position in the vector.static int
BitVectorHelper.getNullCount
(ArrowBuf validityBuffer, int valueCount) Given a validity buffer, find the number of bits that are not set.static int
IntervalYearVector.getTotalMonths
(ArrowBuf buffer, int index) Given a data buffer, get the value stored at a particular position in the vector.void
BufferBacked.load
(ArrowFieldNode fieldNode, ArrowBuf data) static ArrowBuf
BitVectorHelper.loadValidityBuffer
(ArrowFieldNode fieldNode, ArrowBuf sourceValidityBuffer, BufferAllocator allocator) Returns a new buffer if the source validity buffer is either all null or all not-null, otherwise returns a buffer pointing to the same memory as source.protected ArrowBuf
BaseValueVector.releaseBuffer
(ArrowBuf buffer) void
Store the given value at a particular position in the vector.void
Store the given value at a particular position in the vector.static ArrowBuf
BaseLargeVariableWidthVector.set
(ArrowBuf buffer, BufferAllocator allocator, int valueCount, int index, long value) Method used by Json Reader to explicitly set the offsets of the variable width vector data.void
Store the given value at a particular position in the vector.void
Store the given value at a particular position in the vector.static ArrowBuf
BaseVariableWidthVector.set
(ArrowBuf buffer, BufferAllocator allocator, int valueCount, int index, int value) Method used by Json Reader to explicitly set the offsets of the variable width vector data.void
Store the given value at a particular position in the vector.void
Store the given value at a particular position in the vector.void
Store the given value at a particular position in the vector.void
Set the element at the given index to the given value.void
Set the element at the given index to the given value.void
Store the given value at a particular position in the vector.void
Set the element at the given index to the given value.void
Set the element at the given index to the given value.void
Set the element at the given index to the given value.void
Set the element at the given index to the given value.void
Set the element at the given index to the given value.void
Set the element at the given index to the given value.void
Set the element at the given index to the given value.void
Decimal256Vector.setBigEndianSafe
(int index, long start, ArrowBuf buffer, int length) Sets the element at given index using the buffer whose size maybe <= 32 bytes.void
DecimalVector.setBigEndianSafe
(int index, long start, ArrowBuf buffer, int length) Sets the element at given index using the buffer whose size maybe <= 16 bytes.static void
Set the bit at provided index to 1.protected final void
This method is used to create a view buffer for a variable width vector.void
Same asBaseLargeVariableWidthVector.set(int, int, long, long, ArrowBuf)
except that it handles the case when index is greater than or equal to current value capacity of the vector.void
Same asBaseLargeVariableWidthVector.set(int, int, long, long, ArrowBuf)
except that it handles the case when index is greater than or equal to current value capacity of the vector.void
Same asBaseVariableWidthVector.set(int, int, int, int, ArrowBuf)
except that it handles the case when index is greater than or equal to current value capacity of the vector.void
Same asBaseVariableWidthVector.set(int, int, int, int, ArrowBuf)
except that it handles the case when index is greater than or equal to current value capacity of the vector.void
Same asBaseVariableWidthViewVector.set(int, int, int, int, ArrowBuf)
except that it handles the case when index is greater than or equal to current value capacity of the vector.void
Same asBaseVariableWidthViewVector.set(int, int, int, int, ArrowBuf)
except that it handles the case when index is greater than or equal to current value capacity of the vector.void
Same asDecimal256Vector.setSafe(int, int, int, ArrowBuf)
except that it handles the case when the position of new value is beyond the current value capacity of the vector.void
Same asDecimal256Vector.set(int, int, ArrowBuf)
except that it handles the case when index is greater than or equal to existing value capacityBaseFixedWidthVector.getValueCapacity()
.void
Sets the element at given index using the buffer whose size maybe <= 32 bytes.void
Same asDecimal256Vector.set(int, ArrowBuf)
except that it handles the case when index is greater than or equal to existing value capacityBaseFixedWidthVector.getValueCapacity()
.void
Same asDecimalVector.set(int, int, long, ArrowBuf)
except that it handles the case when the position of new value is beyond the current value capacity of the vector.void
Same asDecimalVector.set(int, long, ArrowBuf)
except that it handles the case when index is greater than or equal to existing value capacityBaseFixedWidthVector.getValueCapacity()
.void
Sets the element at given index using the buffer whose size maybe <= 16 bytes.void
Same asDecimalVector.set(int, ArrowBuf)
except that it handles the case when index is greater than or equal to existing value capacityBaseFixedWidthVector.getValueCapacity()
.void
Same asDurationVector.set(int, ArrowBuf)
except that it handles the case when index is greater than or equal to existing value capacityBaseFixedWidthVector.getValueCapacity()
.void
Same asFixedSizeBinaryVector.set(int, ArrowBuf)
except that it handles the case when index is greater than or equal to existing value capacityBaseFixedWidthVector.getValueCapacity()
.void
Same asFixedSizeBinaryVector.set(int, ArrowBuf)
except that it handles the case when index is greater than or equal to existing value capacityBaseFixedWidthVector.getValueCapacity()
.void
Same asIntervalDayVector.set(int, ArrowBuf)
except that it handles the case when index is greater than or equal to existing value capacityBaseFixedWidthVector.getValueCapacity()
.void
Same asIntervalMonthDayNanoVector.set(int, ArrowBuf)
except that it handles the case when index is greater than or equal to existing value capacityBaseFixedWidthVector.getValueCapacity()
.static void
BitVectorHelper.setValidityBit
(ArrowBuf validityBuffer, int index, int value) Set the bit at a given index to provided value (1 or 0).static ArrowBuf
BitVectorHelper.setValidityBit
(ArrowBuf validityBuffer, BufferAllocator allocator, int valueCount, int index, int value) Set the bit at a given index to provided value (1 or 0).static ArrowBuf
BaseValueVector.transferBuffer
(ArrowBuf srcBuffer, BufferAllocator targetAllocator) static void
Set the bit at provided index to 0.Modifier and TypeMethodDescriptiondefault void
FieldVector.exportBuffer
(ArrowBuf buffer, List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue, boolean retain) Export a given buffer and its memory address into a list of buffers and a pointer to the list of buffers.void
BaseLargeVariableWidthVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Export the buffers of the fields for C Data Interface.void
BaseVariableWidthVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Export the buffers of the fields for C Data Interface.void
BaseVariableWidthViewVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Get the data buffer of the vector.default void
FieldVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Export the buffers of the fields for C Data Interface.void
BaseFixedWidthVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) Load the buffers of this vector with provided source buffers.void
BaseLargeVariableWidthVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) Load the buffers of this vector with provided source buffers.void
BaseVariableWidthVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) Load the buffers of this vector with provided source buffers.void
BaseVariableWidthViewVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) Load the buffers of this vector with provided source buffers.void
ExtensionTypeVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) void
FieldVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) Loads data in the vectors.void
NullVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) -
Uses of ArrowBuf in org.apache.arrow.vector.complex
Modifier and TypeFieldDescriptionprotected ArrowBuf
BaseRepeatedValueVector.offsetBuffer
protected ArrowBuf
BaseRepeatedValueViewVector.offsetBuffer
protected ArrowBuf
LargeListVector.offsetBuffer
protected ArrowBuf
BaseRepeatedValueViewVector.sizeBuffer
protected ArrowBuf
UnionVector.typeBuffer
protected ArrowBuf
LargeListVector.validityBuffer
protected ArrowBuf
ListVector.validityBuffer
protected ArrowBuf
ListViewVector.validityBuffer
protected ArrowBuf
StructVector.validityBuffer
Modifier and TypeMethodDescriptionprotected ArrowBuf
BaseRepeatedValueVector.allocateOffsetBuffer
(long size) protected ArrowBuf
LargeListVector.allocateOffsetBuffer
(long size) ArrowBuf[]
AbstractStructVector.getBuffers
(boolean clear) ArrowBuf[]
BaseRepeatedValueVector.getBuffers
(boolean clear) ArrowBuf[]
BaseRepeatedValueViewVector.getBuffers
(boolean clear) ArrowBuf[]
DenseUnionVector.getBuffers
(boolean clear) ArrowBuf[]
FixedSizeListVector.getBuffers
(boolean clear) ArrowBuf[]
LargeListVector.getBuffers
(boolean clear) Return the underlying buffers associated with this vector.ArrowBuf[]
ListVector.getBuffers
(boolean clear) Return the underlying buffers associated with this vector.ArrowBuf[]
ListViewVector.getBuffers
(boolean clear) Return the underlying buffers associated with this vector.ArrowBuf[]
StructVector.getBuffers
(boolean clear) Return the underlying buffers associated with this vector.ArrowBuf[]
UnionVector.getBuffers
(boolean clear) DenseUnionVector.getDataBuffer()
FixedSizeListVector.getDataBuffer()
LargeListVector.getDataBuffer()
ListVector.getDataBuffer()
ListViewVector.getDataBuffer()
NonNullableStructVector.getDataBuffer()
StructVector.getDataBuffer()
UnionVector.getDataBuffer()
DenseUnionVector.getOffsetBuffer()
FixedSizeListVector.getOffsetBuffer()
LargeListVector.getOffsetBuffer()
ListVector.getOffsetBuffer()
ListViewVector.getOffsetBuffer()
NonNullableStructVector.getOffsetBuffer()
StructVector.getOffsetBuffer()
UnionVector.getOffsetBuffer()
ListViewVector.getSizeBuffer()
DenseUnionVector.getTypeBuffer()
UnionVector.getTypeBuffer()
DenseUnionVector.getValidityBuffer()
FixedSizeListVector.getValidityBuffer()
LargeListVector.getValidityBuffer()
ListVector.getValidityBuffer()
ListViewVector.getValidityBuffer()
NonNullableStructVector.getValidityBuffer()
StructVector.getValidityBuffer()
UnionVector.getValidityBuffer()
Modifier and TypeMethodDescriptionDenseUnionVector.getFieldBuffers()
FixedSizeListVector.getFieldBuffers()
LargeListVector.getFieldBuffers()
Get the buffers belonging to this vector.ListVector.getFieldBuffers()
Get the buffers belonging to this vector.ListViewVector.getFieldBuffers()
StructVector.getFieldBuffers()
UnionVector.getFieldBuffers()
Modifier and TypeMethodDescriptionvoid
LargeListVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Export the buffers of the fields for C Data Interface.void
ListVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Export the buffers of the fields for C Data Interface.void
ListViewVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Export the buffers of the fields for C Data Interface.Modifier and TypeMethodDescriptionvoid
LargeListVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Export the buffers of the fields for C Data Interface.void
ListVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Export the buffers of the fields for C Data Interface.void
ListViewVector.exportCDataBuffers
(List<ArrowBuf> buffers, ArrowBuf buffersPtr, long nullValue) Export the buffers of the fields for C Data Interface.void
DenseUnionVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) void
FixedSizeListVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) void
LargeListVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) Load the buffers of this vector with provided source buffers.void
ListVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) Load the buffers of this vector with provided source buffers.void
ListViewVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) Load the buffers associated with this Field.void
StructVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) void
UnionVector.loadFieldBuffers
(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) -
Uses of ArrowBuf in org.apache.arrow.vector.complex.impl
Modifier and TypeMethodDescriptionvoid
DecimalWriterImpl.writeDecimal
(long start, ArrowBuf buffer) void
DecimalWriterImpl.writeDecimal
(long start, ArrowBuf buffer, ArrowType arrowType) void
DenseUnionWriter.writeDecimal
(long start, ArrowBuf buffer, byte typeId, ArrowType arrowType) void
PromotableWriter.writeDecimal
(long start, ArrowBuf buffer, ArrowType arrowType) void
UnionFixedSizeListWriter.writeDecimal
(long start, ArrowBuf buffer, ArrowType arrowType) void
UnionLargeListWriter.writeDecimal
(long start, ArrowBuf buffer) void
UnionLargeListWriter.writeDecimal
(long start, ArrowBuf buffer, ArrowType arrowType) void
UnionListViewWriter.writeDecimal
(long start, ArrowBuf buffer) void
UnionListViewWriter.writeDecimal
(long start, ArrowBuf buffer, ArrowType arrowType) void
UnionListWriter.writeDecimal
(long start, ArrowBuf buffer) void
UnionListWriter.writeDecimal
(long start, ArrowBuf buffer, ArrowType arrowType) void
UnionWriter.writeDecimal
(long start, ArrowBuf buffer, ArrowType arrowType) void
Decimal256WriterImpl.writeDecimal256
(long start, ArrowBuf buffer) void
Decimal256WriterImpl.writeDecimal256
(long start, ArrowBuf buffer, ArrowType arrowType) void
DenseUnionWriter.writeDecimal256
(long start, ArrowBuf buffer, byte typeId, ArrowType arrowType) void
PromotableWriter.writeDecimal256
(long start, ArrowBuf buffer, ArrowType arrowType) void
UnionFixedSizeListWriter.writeDecimal256
(long start, ArrowBuf buffer, ArrowType arrowType) void
UnionLargeListWriter.writeDecimal256
(long start, ArrowBuf buffer) void
UnionLargeListWriter.writeDecimal256
(long start, ArrowBuf buffer, ArrowType arrowType) void
UnionListViewWriter.writeDecimal256
(long start, ArrowBuf buffer) void
UnionListViewWriter.writeDecimal256
(long start, ArrowBuf buffer, ArrowType arrowType) void
UnionListWriter.writeDecimal256
(long start, ArrowBuf buffer) void
UnionListWriter.writeDecimal256
(long start, ArrowBuf buffer, ArrowType arrowType) void
UnionWriter.writeDecimal256
(long start, ArrowBuf buffer, ArrowType arrowType) void
FixedSizeBinaryWriterImpl.writeFixedSizeBinary
(ArrowBuf buffer) void
UnionLargeListWriter.writeFixedSizeBinary
(ArrowBuf buffer) void
UnionListViewWriter.writeFixedSizeBinary
(ArrowBuf buffer) void
UnionListWriter.writeFixedSizeBinary
(ArrowBuf buffer) void
UnionWriter.writeFixedSizeBinary
(ArrowBuf buffer) void
DenseUnionWriter.writeLargeVarBinary
(long start, long end, ArrowBuf buffer, byte typeId) void
LargeVarBinaryWriterImpl.writeLargeVarBinary
(long start, long end, ArrowBuf buffer) void
UnionFixedSizeListWriter.writeLargeVarBinary
(long start, long end, ArrowBuf buffer) void
UnionLargeListWriter.writeLargeVarBinary
(long start, long end, ArrowBuf buffer) void
UnionListViewWriter.writeLargeVarBinary
(long start, long end, ArrowBuf buffer) void
UnionListWriter.writeLargeVarBinary
(long start, long end, ArrowBuf buffer) void
UnionWriter.writeLargeVarBinary
(long start, long end, ArrowBuf buffer) void
DenseUnionWriter.writeLargeVarChar
(long start, long end, ArrowBuf buffer, byte typeId) void
LargeVarCharWriterImpl.writeLargeVarChar
(long start, long end, ArrowBuf buffer) void
UnionFixedSizeListWriter.writeLargeVarChar
(long start, long end, ArrowBuf buffer) void
UnionLargeListWriter.writeLargeVarChar
(long start, long end, ArrowBuf buffer) void
UnionListViewWriter.writeLargeVarChar
(long start, long end, ArrowBuf buffer) void
UnionListWriter.writeLargeVarChar
(long start, long end, ArrowBuf buffer) void
UnionWriter.writeLargeVarChar
(long start, long end, ArrowBuf buffer) void
DenseUnionWriter.writeVarBinary
(int start, int end, ArrowBuf buffer, byte typeId) void
UnionFixedSizeListWriter.writeVarBinary
(int start, int end, ArrowBuf buffer) void
UnionLargeListWriter.writeVarBinary
(int start, int end, ArrowBuf buffer) void
UnionListViewWriter.writeVarBinary
(int start, int end, ArrowBuf buffer) void
UnionListWriter.writeVarBinary
(int start, int end, ArrowBuf buffer) void
UnionWriter.writeVarBinary
(int start, int end, ArrowBuf buffer) void
VarBinaryWriterImpl.writeVarBinary
(int start, int end, ArrowBuf buffer) void
DenseUnionWriter.writeVarChar
(int start, int end, ArrowBuf buffer, byte typeId) void
UnionFixedSizeListWriter.writeVarChar
(int start, int end, ArrowBuf buffer) void
UnionLargeListWriter.writeVarChar
(int start, int end, ArrowBuf buffer) void
UnionListViewWriter.writeVarChar
(int start, int end, ArrowBuf buffer) void
UnionListWriter.writeVarChar
(int start, int end, ArrowBuf buffer) void
UnionWriter.writeVarChar
(int start, int end, ArrowBuf buffer) void
VarCharWriterImpl.writeVarChar
(int start, int end, ArrowBuf buffer) void
DenseUnionWriter.writeViewVarBinary
(int start, int end, ArrowBuf buffer, byte typeId) void
UnionFixedSizeListWriter.writeViewVarBinary
(int start, int end, ArrowBuf buffer) void
UnionLargeListWriter.writeViewVarBinary
(int start, int end, ArrowBuf buffer) void
UnionListViewWriter.writeViewVarBinary
(int start, int end, ArrowBuf buffer) void
UnionListWriter.writeViewVarBinary
(int start, int end, ArrowBuf buffer) void
UnionWriter.writeViewVarBinary
(int start, int end, ArrowBuf buffer) void
ViewVarBinaryWriterImpl.writeViewVarBinary
(int start, int end, ArrowBuf buffer) void
DenseUnionWriter.writeViewVarChar
(int start, int end, ArrowBuf buffer, byte typeId) void
UnionFixedSizeListWriter.writeViewVarChar
(int start, int end, ArrowBuf buffer) void
UnionLargeListWriter.writeViewVarChar
(int start, int end, ArrowBuf buffer) void
UnionListViewWriter.writeViewVarChar
(int start, int end, ArrowBuf buffer) void
UnionListWriter.writeViewVarChar
(int start, int end, ArrowBuf buffer) void
UnionWriter.writeViewVarChar
(int start, int end, ArrowBuf buffer) void
ViewVarCharWriterImpl.writeViewVarChar
(int start, int end, ArrowBuf buffer) -
Uses of ArrowBuf in org.apache.arrow.vector.complex.writer
Modifier and TypeMethodDescriptionvoid
DecimalWriter.writeDecimal
(long start, ArrowBuf buffer) Deprecated.The holder version should be used instead because the plain value version does not contain enough information to fully specify this field type.void
DecimalWriter.writeDecimal
(long start, ArrowBuf buffer, ArrowType arrowType) void
Decimal256Writer.writeDecimal256
(long start, ArrowBuf buffer) Deprecated.The holder version should be used instead because the plain value version does not contain enough information to fully specify this field type.void
Decimal256Writer.writeDecimal256
(long start, ArrowBuf buffer, ArrowType arrowType) void
FixedSizeBinaryWriter.writeFixedSizeBinary
(ArrowBuf buffer) Deprecated.The holder version should be used instead because the plain value version does not contain enough information to fully specify this field type.void
LargeVarBinaryWriter.writeLargeVarBinary
(long start, long end, ArrowBuf buffer) void
LargeVarCharWriter.writeLargeVarChar
(long start, long end, ArrowBuf buffer) void
VarBinaryWriter.writeVarBinary
(int start, int end, ArrowBuf buffer) void
VarCharWriter.writeVarChar
(int start, int end, ArrowBuf buffer) void
ViewVarBinaryWriter.writeViewVarBinary
(int start, int end, ArrowBuf buffer) void
ViewVarCharWriter.writeViewVarChar
(int start, int end, ArrowBuf buffer) -
Uses of ArrowBuf in org.apache.arrow.vector.compression
Modifier and TypeMethodDescriptionAbstractCompressionCodec.compress
(BufferAllocator allocator, ArrowBuf uncompressedBuffer) CompressionCodec.compress
(BufferAllocator allocator, ArrowBuf uncompressedBuffer) Compress a buffer.NoCompressionCodec.compress
(BufferAllocator allocator, ArrowBuf uncompressedBuffer) AbstractCompressionCodec.decompress
(BufferAllocator allocator, ArrowBuf compressedBuffer) CompressionCodec.decompress
(BufferAllocator allocator, ArrowBuf compressedBuffer) Decompress a buffer.NoCompressionCodec.decompress
(BufferAllocator allocator, ArrowBuf compressedBuffer) protected abstract ArrowBuf
AbstractCompressionCodec.doCompress
(BufferAllocator allocator, ArrowBuf uncompressedBuffer) The method that actually performs the data compression.protected abstract ArrowBuf
AbstractCompressionCodec.doDecompress
(BufferAllocator allocator, ArrowBuf compressedBuffer) The method that actually performs the data decompression.static ArrowBuf
CompressionUtil.extractUncompressedBuffer
(ArrowBuf inputBuffer) Process decompression by slicing the buffer that contains the uncompressed bytes.static ArrowBuf
CompressionUtil.packageRawBuffer
(BufferAllocator allocator, ArrowBuf inputBuffer) Process compression by compressing the buffer as is.Modifier and TypeMethodDescriptionAbstractCompressionCodec.compress
(BufferAllocator allocator, ArrowBuf uncompressedBuffer) CompressionCodec.compress
(BufferAllocator allocator, ArrowBuf uncompressedBuffer) Compress a buffer.NoCompressionCodec.compress
(BufferAllocator allocator, ArrowBuf uncompressedBuffer) AbstractCompressionCodec.decompress
(BufferAllocator allocator, ArrowBuf compressedBuffer) CompressionCodec.decompress
(BufferAllocator allocator, ArrowBuf compressedBuffer) Decompress a buffer.NoCompressionCodec.decompress
(BufferAllocator allocator, ArrowBuf compressedBuffer) protected abstract ArrowBuf
AbstractCompressionCodec.doCompress
(BufferAllocator allocator, ArrowBuf uncompressedBuffer) The method that actually performs the data compression.protected abstract ArrowBuf
AbstractCompressionCodec.doDecompress
(BufferAllocator allocator, ArrowBuf compressedBuffer) The method that actually performs the data decompression.static ArrowBuf
CompressionUtil.extractUncompressedBuffer
(ArrowBuf inputBuffer) Process decompression by slicing the buffer that contains the uncompressed bytes.static ArrowBuf
CompressionUtil.packageRawBuffer
(BufferAllocator allocator, ArrowBuf inputBuffer) Process compression by compressing the buffer as is.protected long
AbstractCompressionCodec.readUncompressedLength
(ArrowBuf compressedBuffer) protected void
AbstractCompressionCodec.writeUncompressedLength
(ArrowBuf compressedBuffer, long uncompressedLength) -
Uses of ArrowBuf in org.apache.arrow.vector.holders
Modifier and TypeFieldDescriptionDecimal256Holder.buffer
DecimalHolder.buffer
FixedSizeBinaryHolder.buffer
LargeVarBinaryHolder.buffer
LargeVarCharHolder.buffer
NullableDecimal256Holder.buffer
NullableDecimalHolder.buffer
NullableFixedSizeBinaryHolder.buffer
NullableLargeVarBinaryHolder.buffer
NullableLargeVarCharHolder.buffer
NullableVarBinaryHolder.buffer
NullableVarCharHolder.buffer
NullableViewVarBinaryHolder.buffer
NullableViewVarCharHolder.buffer
VarBinaryHolder.buffer
VarCharHolder.buffer
ViewVarBinaryHolder.buffer
ViewVarCharHolder.buffer
-
Uses of ArrowBuf in org.apache.arrow.vector.ipc
-
Uses of ArrowBuf in org.apache.arrow.vector.ipc.message
Modifier and TypeMethodDescriptionMessageResult.getBodyBuffer()
Get the message body data.static ArrowBuf
MessageSerializer.readMessageBody
(ReadChannel in, long bodyLength, BufferAllocator allocator) Read a Message body from the in channel into an ArrowBuf.Modifier and TypeMethodDescriptionstatic ArrowDictionaryBatch
MessageSerializer.deserializeDictionaryBatch
(Message message, ArrowBuf bodyBuffer) Deserializes an ArrowDictionaryBatch from a dictionary batch Message and data in an ArrowBuf.static ArrowDictionaryBatch
MessageSerializer.deserializeDictionaryBatch
(MessageMetadataResult message, ArrowBuf bodyBuffer) Deserializes an ArrowDictionaryBatch from a dictionary batch Message and data in an ArrowBuf.static ArrowRecordBatch
MessageSerializer.deserializeRecordBatch
(Message recordBatchMessage, ArrowBuf bodyBuffer) Deserializes an ArrowRecordBatch from a record batch message and data in an ArrowBuf.static ArrowRecordBatch
MessageSerializer.deserializeRecordBatch
(RecordBatch recordBatchFB, ArrowBuf body) Deserializes an ArrowRecordBatch given the Flatbuffer metadata and in-memory body.static ArrowRecordBatch
MessageSerializer.deserializeRecordBatch
(MessageMetadataResult serializedMessage, ArrowBuf underlying) Reads a record batch based on the metadata in serializedMessage and the underlying data buffer. -
Uses of ArrowBuf in org.apache.arrow.vector.table
Modifier and TypeMethodDescriptionRow.getDecimal
(int columnIndex) Returns an ArrowBuf from the column with the given index at the current row.Row.getDecimal
(String columnName) Returns an ArrowBuf from the column of the given name at the current row.Row.getDuration
(int columnIndex) Returns an ArrowBuf from the column with the given index at the current row.Row.getDuration
(String columnName) Returns an ArrowBuf from the column of the given name at the current row.Row.getIntervalDay
(int columnIndex) Returns an ArrowBuf from the column with the given index at the current row.Row.getIntervalDay
(String columnName) Returns an ArrowBuf from the column of the given name at the current row.Row.getIntervalMonthDayNano
(int columnIndex) Returns an ArrowBuf from the column with the given index at the current row.Row.getIntervalMonthDayNano
(String columnName) Returns an ArrowBuf from the column of the given name at the current row. -
Uses of ArrowBuf in org.apache.arrow.vector.util
Modifier and TypeMethodDescriptionstatic BigDecimal
DecimalUtility.getBigDecimalFromArrowBuf
(ArrowBuf bytebuf, int index, int scale, int byteWidth) Read an ArrowType.Decimal at the given value index in the ArrowBuf and convert to a BigDecimal with the given scale.static byte[]
DecimalUtility.getByteArrayFromArrowBuf
(ArrowBuf bytebuf, int index, int byteWidth) Read an ArrowType.Decimal from the ArrowBuf at the given value index and return it as a byte array.void
static void
DecimalUtility.writeBigDecimalToArrowBuf
(BigDecimal value, ArrowBuf bytebuf, int index, int byteWidth) Write the given BigDecimal to the ArrowBuf at the given value index.static void
DecimalUtility.writeByteArrayToArrowBuf
(byte[] bytes, ArrowBuf bytebuf, int index, int byteWidth) Write the given byte array to the ArrowBuf at the given value index.static void
DecimalUtility.writeLongToArrowBuf
(long value, ArrowBuf bytebuf, int index, int byteWidth) Write the given long to the ArrowBuf at the given value index.
setOne(long, long)
instead.