Skip to main content

Module byte_array

Module byte_array 

Source

Re-exportsΒ§

use crate::basic::Encoding; πŸ”’
use crate::bloom_filter::Sbbf; πŸ”’
use crate::column::writer::encoder::ColumnValueEncoder; πŸ”’
use crate::column::writer::encoder::DataPageValues; πŸ”’
use crate::column::writer::encoder::DictionaryPage; πŸ”’
use crate::column::writer::encoder::create_bloom_filter; πŸ”’
use crate::column::writer::compare_greater_byte_array_decimals; πŸ”’
use crate::column::writer::is_decimal_descr; πŸ”’
use crate::data_type::AsBytes; πŸ”’
use crate::data_type::ByteArray; πŸ”’
use crate::data_type::Int32Type; πŸ”’
use crate::encodings::encoding::DeltaBitPackEncoder; πŸ”’
use crate::encodings::encoding::Encoder; πŸ”’
use crate::encodings::rle::RleEncoder; πŸ”’
use crate::errors::ParquetError; πŸ”’
use crate::errors::Result; πŸ”’
use crate::file::properties::EnabledStatistics; πŸ”’
use crate::file::properties::ResolvedColumnProperties; πŸ”’
use crate::file::properties::WriterProperties; πŸ”’
use crate::file::properties::WriterVersion; πŸ”’
use crate::geospatial::accumulator::GeoStatsAccumulator; πŸ”’
use crate::geospatial::accumulator::try_new_geo_stats_accumulator; πŸ”’
use crate::geospatial::statistics::GeospatialStatistics; πŸ”’
use crate::schema::types::ColumnDescPtr; πŸ”’
use crate::util::bit_util::num_required_bits; πŸ”’
use crate::util::prefix::common_prefix_length; πŸ”’
use arrow_array::cast::AsArray; πŸ”’
use arrow_array::types::ArrowDictionaryKeyType; πŸ”’
use arrow_array::types::ByteArrayType; πŸ”’
use arrow_array::Array; πŸ”’
use arrow_array::ArrayAccessor; πŸ”’
use arrow_array::ArrayRef; πŸ”’
use arrow_array::BinaryArray; πŸ”’
use arrow_array::BinaryViewArray; πŸ”’
use arrow_array::DictionaryArray; πŸ”’
use arrow_array::FixedSizeBinaryArray; πŸ”’
use arrow_array::GenericByteArray; πŸ”’
use arrow_array::LargeBinaryArray; πŸ”’
use arrow_array::LargeStringArray; πŸ”’
use arrow_array::StringArray; πŸ”’
use arrow_array::StringViewArray; πŸ”’
use arrow_array::TypedDictionaryArray; πŸ”’
use arrow_buffer::ArrowNativeType; πŸ”’
use arrow_buffer::Buffer; πŸ”’
use arrow_schema::DataType; πŸ”’
use std::sync::Arc; πŸ”’
use std::sync::Weak; πŸ”’

MacrosΒ§

downcast_dict_impl πŸ”’
downcast_dict_op πŸ”’
downcast_dict_values_op πŸ”’
downcast_op πŸ”’

StructsΒ§

ByteArrayEncoder
ByteArrayInterner πŸ”’
ByteArrayInternerIterator πŸ”’
Iterates the values of a ByteArrayInterner’s dictionary page
DictEncoder πŸ”’
A dictionary encoder for byte array data
DictionaryCache πŸ”’
The interned index of each value of an arrow dictionary, so each value is hashed once rather than once per row that references it
Entry πŸ”’
Entry in the hash table
FallbackEncoder πŸ”’
A fallback encoder, i.e. non-dictionary, for ByteArray
OffsetOrInlineView πŸ”’
Either offset to the dictionary page bytes or inline bytes when the bytes are short enough to avoid doing the indirection

EnumsΒ§

FallbackEncoderImpl πŸ”’
The fallback encoder in use

ConstantsΒ§

SHORT_VALUE_LEN πŸ”’
Maximum size of a value that can be inlined in the hash table

FunctionsΒ§

compute_min_max πŸ”’
Computes the min and max for the provided array and indices
count_within_budget_offsets πŸ”’
Number of leading indices whose cumulative plain-encoded size fits byte_budget (boundary value included), for offset-buffer byte arrays (Utf8/LargeUtf8/Binary/LargeBinary).
count_within_budget_views πŸ”’
Number of leading indices whose cumulative plain-encoded size fits byte_budget (boundary value included), for view arrays (Utf8View, BinaryView).
encode πŸ”’
Encodes the provided values and indices to encoder
encode_with_dictionary_cache πŸ”’
Encodes the rows of an arrow dictionary at indices to encoder, which must have a dictionary encoder
is_greater πŸ”’
Returns true if a > b.
max_view_value_len πŸ”’
Upper bound on any single value’s byte length in a view array.
maybe_inline_value πŸ”’
update_geo_stats_accumulator πŸ”’
Updates geospatial statistics for the provided array and indices
update_statistics πŸ”’
Updates the statistics of encoder with the values at indices