Skip to main content

Module statistics

Module statistics 

Source
Expand description

StatisticsConverter to convert statistics in parquet format to arrow [ArrayRef].

Macrosยง

get_data_page_statistics ๐Ÿ”’
get_statistics ๐Ÿ”’
Special macro to combine the statistics iterators for min and max. This is used to avoid repeating the same code for min and max statistics extractions
make_decimal_stats_iterator ๐Ÿ”’
Special iterator adapter for extracting i128 values from from an iterator of ParquetStatistics
make_stats_iterator ๐Ÿ”’
Define an adapter iterator for extracting statistics from an iterator of ParquetStatistics

Structsยง

MaxBooleanStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxByteArrayStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxDecimal32StatsIterator ๐Ÿ”’
MaxDecimal64StatsIterator ๐Ÿ”’
MaxDecimal128StatsIterator ๐Ÿ”’
MaxDecimal256StatsIterator ๐Ÿ”’
MaxDoubleStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxFixedLenByteArrayStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxFloatStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxInt32StatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxInt64StatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinBooleanStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinByteArrayStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinDecimal32StatsIterator ๐Ÿ”’
MinDecimal64StatsIterator ๐Ÿ”’
MinDecimal128StatsIterator ๐Ÿ”’
MinDecimal256StatsIterator ๐Ÿ”’
MinDoubleStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinFixedLenByteArrayStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinFloatStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinInt32StatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinInt64StatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
StatisticsConverter
Extracts Parquet statistics as Arrow arrays

Functionsยง

from_bytes_to_f16 ๐Ÿ”’
from_bytes_to_i32 ๐Ÿ”’
from_bytes_to_i64 ๐Ÿ”’
from_bytes_to_i128 ๐Ÿ”’
from_bytes_to_i256 ๐Ÿ”’
max_page_statistics ๐Ÿ”’
Extracts the max statistics from an iterator of parquet page ColumnIndexMetaDataโ€™s to an [ArrayRef]
max_statistics ๐Ÿ”’
Extracts the max statistics from an iterator of ParquetStatistics to an [ArrayRef]
min_page_statistics ๐Ÿ”’
Extracts the min statistics from an iterator of parquet page ColumnIndexMetaDataโ€™s to an [ArrayRef]
min_statistics ๐Ÿ”’
Extracts the min statistics from an iterator of ParquetStatistics to an [ArrayRef]
null_counts_page_statistics ๐Ÿ”’
Extracts the null count statistics from an iterator of parquet page ColumnIndexMetaDataโ€™s to an [ArrayRef]