Module bloom_filter 

Check Arrow arrays against Parquet bloom filters

Re-exports

use arrow_array::builder::BooleanBuilder; 🔒

use arrow_array::cast::AsArray; 🔒

use arrow_array::types::Float32Type; 🔒

use arrow_array::types::Float64Type; 🔒

use arrow_array::types::RunEndIndexType; 🔒

use arrow_array::Array; 🔒

use arrow_array::BooleanArray; 🔒

use arrow_array::RunArray; 🔒

use arrow_array::downcast_run_array; 🔒

use arrow_buffer::ArrowNativeType; 🔒

use arrow_buffer::BooleanBuffer; 🔒

use arrow_schema::DataType; 🔒

use arrow_schema::Field; 🔒

use crate::arrow::arrow_writer::FixedLenByteArrayVisitor; 🔒

use crate::arrow::arrow_writer::PrimitiveVisitor; 🔒

use crate::arrow::arrow_writer::visit_fixed_len_byte_array; 🔒

use crate::arrow::arrow_writer::visit_i32; 🔒

use crate::arrow::arrow_writer::visit_i64; 🔒

use crate::arrow::schema::arrow_to_parquet_type; 🔒

use crate::basic::ConvertedType; 🔒

use crate::basic::LogicalType; 🔒

use crate::basic::TimeUnit; 🔒

use crate::basic::Type as PhysicalType; 🔒

use crate::bloom_filter::Sbbf; 🔒

use crate::data_type::AsBytes; 🔒

use crate::errors::ParquetError; 🔒

use crate::errors::Result; 🔒

use crate::schema::types::ColumnDescriptor; 🔒

use crate::schema::types::Type; 🔒

Structs

ArrowSbbf

A Parquet bloom filter (Sbbf) that can be checked with Arrow arrays

CheckFixedLenByteArray 🔒

Checks the FIXED_LEN_BYTE_ARRAY values passed to it against a bloom filter

CheckPrimitive 🔒

Checks the INT32, INT64, FLOAT or DOUBLE values passed to it against a bloom filter

Functions

check_byte_array 🔒

Checks the values of a BYTE_ARRAY column, which are stored as they are

check_bytes 🔒

decimal_scale 🔒

Returns the scale of a decimal type, or None if t is not a decimal

describe 🔒

Describes the parts of column’s type that determine how its values are stored

is_stored_as 🔒

Returns whether values written to a column of type written can be checked against the bloom filter of a column of type column

time_unit 🔒

Returns the unit of a TIME or TIMESTAMP type, or None if t has no unit

type_length 🔒

type_mismatch 🔒

validate 🔒

Returns an error unless ArrowWriter stores values of arrow_type in the same way as values of column, so that they can be checked against its bloom filter

value_type 🔒

Returns the type of the values of a dictionary or run-end encoded data_type, or data_type itself