Module statistics

Module statistics 

Source
Expand description

StatisticsConverter to convert statistics in parquet format to arrow [ArrayRef].

Macrosยง

get_data_page_statistics ๐Ÿ”’
get_decimal_page_stats_iterator ๐Ÿ”’
get_statistics ๐Ÿ”’
Special macro to combine the statistics iterators for min and max using the paste macro. This is used to avoid repeating the same code for min and max statistics extractions
make_data_page_stats_iterator ๐Ÿ”’
make_decimal_stats_iterator ๐Ÿ”’
Special iterator adapter for extracting i128 values from from an iterator of ParquetStatistics
make_stats_iterator ๐Ÿ”’
Define an adapter iterator for extracting statistics from an iterator of ParquetStatistics

Structsยง

MaxBooleanDataPageStatsIterator ๐Ÿ”’
MaxBooleanStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxByteArrayDataPageStatsIterator ๐Ÿ”’
MaxByteArrayStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxDecimal32DataPageStatsIterator ๐Ÿ”’
MaxDecimal32StatsIterator ๐Ÿ”’
MaxDecimal64DataPageStatsIterator ๐Ÿ”’
MaxDecimal64StatsIterator ๐Ÿ”’
MaxDecimal128DataPageStatsIterator ๐Ÿ”’
MaxDecimal128StatsIterator ๐Ÿ”’
MaxDecimal256DataPageStatsIterator ๐Ÿ”’
MaxDecimal256StatsIterator ๐Ÿ”’
MaxDoubleStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxFixedLenByteArrayDataPageStatsIterator ๐Ÿ”’
MaxFixedLenByteArrayStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxFloat16DataPageStatsIterator ๐Ÿ”’
MaxFloat32DataPageStatsIterator ๐Ÿ”’
MaxFloat64DataPageStatsIterator ๐Ÿ”’
MaxFloatStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxInt32DataPageStatsIterator ๐Ÿ”’
MaxInt32StatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxInt64DataPageStatsIterator ๐Ÿ”’
MaxInt64StatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinBooleanDataPageStatsIterator ๐Ÿ”’
MinBooleanStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinByteArrayDataPageStatsIterator ๐Ÿ”’
MinByteArrayStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinDecimal32DataPageStatsIterator ๐Ÿ”’
MinDecimal32StatsIterator ๐Ÿ”’
MinDecimal64DataPageStatsIterator ๐Ÿ”’
MinDecimal64StatsIterator ๐Ÿ”’
MinDecimal128DataPageStatsIterator ๐Ÿ”’
MinDecimal128StatsIterator ๐Ÿ”’
MinDecimal256DataPageStatsIterator ๐Ÿ”’
MinDecimal256StatsIterator ๐Ÿ”’
MinDoubleStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinFixedLenByteArrayDataPageStatsIterator ๐Ÿ”’
MinFixedLenByteArrayStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinFloat16DataPageStatsIterator ๐Ÿ”’
MinFloat32DataPageStatsIterator ๐Ÿ”’
MinFloat64DataPageStatsIterator ๐Ÿ”’
MinFloatStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinInt32DataPageStatsIterator ๐Ÿ”’
MinInt32StatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinInt64DataPageStatsIterator ๐Ÿ”’
MinInt64StatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
StatisticsConverter
Extracts Parquet statistics as Arrow arrays

Functionsยง

from_bytes_to_f16 ๐Ÿ”’
from_bytes_to_i32 ๐Ÿ”’
from_bytes_to_i64 ๐Ÿ”’
from_bytes_to_i128 ๐Ÿ”’
from_bytes_to_i256 ๐Ÿ”’
max_page_statistics ๐Ÿ”’
Extracts the max statistics from an iterator of parquet page ColumnIndexMetaDataโ€™s to an [ArrayRef]
max_statistics ๐Ÿ”’
Extracts the max statistics from an iterator of ParquetStatistics to an [ArrayRef]
min_page_statistics ๐Ÿ”’
Extracts the min statistics from an iterator of parquet page ColumnIndexMetaDataโ€™s to an [ArrayRef]
min_statistics ๐Ÿ”’
Extracts the min statistics from an iterator of ParquetStatistics to an [ArrayRef]
null_counts_page_statistics ๐Ÿ”’
Extracts the null count statistics from an iterator of parquet page ColumnIndexMetaDataโ€™s to an [ArrayRef]