Skip to main content

Module statistics

Module statistics 

Source
Expand description

StatisticsConverter to convert statistics in parquet format to arrow [ArrayRef].

Macrosยง

get_data_page_statistics ๐Ÿ”’
get_statistics ๐Ÿ”’
Special macro to combine the statistics iterators for min and max using the paste macro. This is used to avoid repeating the same code for min and max statistics extractions
make_decimal_stats_iterator ๐Ÿ”’
Special iterator adapter for extracting i128 values from from an iterator of ParquetStatistics
make_stats_iterator ๐Ÿ”’
Define an adapter iterator for extracting statistics from an iterator of ParquetStatistics

Structsยง

MaxBooleanStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxByteArrayStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxDecimal32StatsIterator ๐Ÿ”’
MaxDecimal64StatsIterator ๐Ÿ”’
MaxDecimal128StatsIterator ๐Ÿ”’
MaxDecimal256StatsIterator ๐Ÿ”’
MaxDoubleStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxFixedLenByteArrayStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxFloatStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxInt32StatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MaxInt64StatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinBooleanStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinByteArrayStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinDecimal32StatsIterator ๐Ÿ”’
MinDecimal64StatsIterator ๐Ÿ”’
MinDecimal128StatsIterator ๐Ÿ”’
MinDecimal256StatsIterator ๐Ÿ”’
MinDoubleStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinFixedLenByteArrayStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinFloatStatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinInt32StatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
MinInt64StatsIterator ๐Ÿ”’
Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
StatisticsConverter
Extracts Parquet statistics as Arrow arrays

Functionsยง

from_bytes_to_f16 ๐Ÿ”’
from_bytes_to_i32 ๐Ÿ”’
from_bytes_to_i64 ๐Ÿ”’
from_bytes_to_i128 ๐Ÿ”’
from_bytes_to_i256 ๐Ÿ”’
max_page_statistics ๐Ÿ”’
Extracts the max statistics from an iterator of parquet page ColumnIndexMetaDataโ€™s to an [ArrayRef]
max_statistics ๐Ÿ”’
Extracts the max statistics from an iterator of ParquetStatistics to an [ArrayRef]
min_page_statistics ๐Ÿ”’
Extracts the min statistics from an iterator of parquet page ColumnIndexMetaDataโ€™s to an [ArrayRef]
min_statistics ๐Ÿ”’
Extracts the min statistics from an iterator of ParquetStatistics to an [ArrayRef]
null_counts_page_statistics ๐Ÿ”’
Extracts the null count statistics from an iterator of parquet page ColumnIndexMetaDataโ€™s to an [ArrayRef]