Module statistics

StatisticsConverter to convert statistics in parquet format to arrow [ArrayRef].

Macros

• get_data_page_statistics 🔒
• get_decimal_page_stats_iterator 🔒
• get_statistics 🔒
  Special macro to combine the statistics iterators for min and max using the paste macro. This is used to avoid repeating the same code for min and max statistics extractions
• make_data_page_stats_iterator 🔒
• make_decimal_stats_iterator 🔒
  Special iterator adapter for extracting i128 values from from an iterator of ParquetStatistics
• make_stats_iterator 🔒
  Define an adapter iterator for extracting statistics from an iterator of ParquetStatistics

Structs

• MaxBooleanDataPageStatsIterator 🔒
• MaxBooleanStatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• MaxByteArrayDataPageStatsIterator 🔒
• MaxByteArrayStatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• MaxDecimal128DataPageStatsIterator 🔒
• MaxDecimal128StatsIterator 🔒
• MaxDecimal256DataPageStatsIterator 🔒
• MaxDecimal256StatsIterator 🔒
• MaxDoubleStatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• MaxFixedLenByteArrayDataPageStatsIterator 🔒
• MaxFixedLenByteArrayStatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• MaxFloat16DataPageStatsIterator 🔒
• MaxFloat32DataPageStatsIterator 🔒
• MaxFloat64DataPageStatsIterator 🔒
• MaxFloatStatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• MaxInt32DataPageStatsIterator 🔒
• MaxInt32StatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• MaxInt64DataPageStatsIterator 🔒
• MaxInt64StatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• MinBooleanDataPageStatsIterator 🔒
• MinBooleanStatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• MinByteArrayDataPageStatsIterator 🔒
• MinByteArrayStatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• MinDecimal128DataPageStatsIterator 🔒
• MinDecimal128StatsIterator 🔒
• MinDecimal256DataPageStatsIterator 🔒
• MinDecimal256StatsIterator 🔒
• MinDoubleStatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• MinFixedLenByteArrayDataPageStatsIterator 🔒
• MinFixedLenByteArrayStatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• MinFloat16DataPageStatsIterator 🔒
• MinFloat32DataPageStatsIterator 🔒
• MinFloat64DataPageStatsIterator 🔒
• MinFloatStatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• MinInt32DataPageStatsIterator 🔒
• MinInt32StatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• MinInt64DataPageStatsIterator 🔒
• MinInt64StatsIterator 🔒
  Maps an iterator of ParquetStatistics into an iterator of `&$stat_value_type``
• StatisticsConverter
  Extracts Parquet statistics as Arrow arrays

Functions

• from_bytes_to_f16 🔒
• from_bytes_to_i128 🔒
• from_bytes_to_i256 🔒
• max_page_statistics 🔒
  Extracts the max statistics from an iterator of parquet page Index’es to an [ArrayRef]
• max_statistics 🔒
  Extracts the max statistics from an iterator of ParquetStatistics to an [ArrayRef]
• min_page_statistics 🔒
  Extracts the min statistics from an iterator of parquet page Index’es to an [ArrayRef]
• min_statistics 🔒
  Extracts the min statistics from an iterator of ParquetStatistics to an [ArrayRef]
• null_counts_page_statistics 🔒
  Extracts the null count statistics from an iterator of parquet page Index’es to an [ArrayRef]