Module statistics

Source
Expand description

StatisticsConverter to convert statistics in parquet format to arrow [ArrayRef].

Macros§

get_data_page_statistics πŸ”’
get_decimal_page_stats_iterator πŸ”’
get_statistics πŸ”’
Special macro to combine the statistics iterators for min and max using the paste macro. This is used to avoid repeating the same code for min and max statistics extractions
make_data_page_stats_iterator πŸ”’
make_decimal_stats_iterator πŸ”’
Special iterator adapter for extracting i128 values from from an iterator of ParquetStatistics
make_stats_iterator πŸ”’
Define an adapter iterator for extracting statistics from an iterator of ParquetStatistics

Structs§

MaxBooleanDataPageStatsIterator πŸ”’
MaxBooleanStatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxByteArrayDataPageStatsIterator πŸ”’
MaxByteArrayStatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxDecimal128DataPageStatsIterator πŸ”’
MaxDecimal128StatsIterator πŸ”’
MaxDecimal256DataPageStatsIterator πŸ”’
MaxDecimal256StatsIterator πŸ”’
MaxDoubleStatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxFixedLenByteArrayDataPageStatsIterator πŸ”’
MaxFixedLenByteArrayStatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxFloat16DataPageStatsIterator πŸ”’
MaxFloat32DataPageStatsIterator πŸ”’
MaxFloat64DataPageStatsIterator πŸ”’
MaxFloatStatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxInt32DataPageStatsIterator πŸ”’
MaxInt32StatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxInt64DataPageStatsIterator πŸ”’
MaxInt64StatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinBooleanDataPageStatsIterator πŸ”’
MinBooleanStatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinByteArrayDataPageStatsIterator πŸ”’
MinByteArrayStatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinDecimal128DataPageStatsIterator πŸ”’
MinDecimal128StatsIterator πŸ”’
MinDecimal256DataPageStatsIterator πŸ”’
MinDecimal256StatsIterator πŸ”’
MinDoubleStatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinFixedLenByteArrayDataPageStatsIterator πŸ”’
MinFixedLenByteArrayStatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinFloat16DataPageStatsIterator πŸ”’
MinFloat32DataPageStatsIterator πŸ”’
MinFloat64DataPageStatsIterator πŸ”’
MinFloatStatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinInt32DataPageStatsIterator πŸ”’
MinInt32StatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinInt64DataPageStatsIterator πŸ”’
MinInt64StatsIterator πŸ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
StatisticsConverter
Extracts Parquet statistics as Arrow arrays

Functions§

from_bytes_to_f16 πŸ”’
from_bytes_to_i128 πŸ”’
from_bytes_to_i256 πŸ”’
max_page_statistics πŸ”’
Extracts the max statistics from an iterator of parquet page Index’es to an [ArrayRef]
max_statistics πŸ”’
Extracts the max statistics from an iterator of ParquetStatistics to an [ArrayRef]
min_page_statistics πŸ”’
Extracts the min statistics from an iterator of parquet page Index’es to an [ArrayRef]
min_statistics πŸ”’
Extracts the min statistics from an iterator of ParquetStatistics to an [ArrayRef]
null_counts_page_statistics πŸ”’
Extracts the null count statistics from an iterator of parquet page Index’es to an [ArrayRef]