Skip to main content

Crate parquet_concat

Crate parquet_concat 

Source
Expand description

Binary that concatenates the column data of one or more parquet files

ยงInstall

parquet-concat can be installed using cargo:

cargo install parquet --features=cli

After this parquet-concat should be available:

parquet-concat out.parquet a.parquet b.parquet

The binary can also be built from the source code and run as follows:

cargo run --features=cli --bin parquet-concat out.parquet a.parquet b.parquet

Note: this does not currently support preserving the page index or bloom filters

Re-exportsยง

pub(crate) use clap::Parser; ๐Ÿ”’
pub(crate) use parquet::bloom_filter::Sbbf; ๐Ÿ”’
pub(crate) use parquet::column::writer::ColumnCloseResult; ๐Ÿ”’
pub(crate) use ParquetError; ๐Ÿ”’
pub(crate) use Result; ๐Ÿ”’
pub(crate) use ColumnChunkMetaData; ๐Ÿ”’
pub(crate) use PageIndexPolicy; ๐Ÿ”’
pub(crate) use ParquetMetaDataReader; ๐Ÿ”’
pub(crate) use parquet::file::properties::WriterProperties; ๐Ÿ”’
pub(crate) use parquet::file::reader::ChunkReader; ๐Ÿ”’
pub(crate) use parquet::file::writer::SerializedFileWriter; ๐Ÿ”’
pub(crate) use std::fs::File; ๐Ÿ”’
pub(crate) use std::sync::Arc; ๐Ÿ”’

Structsยง

Args ๐Ÿ”’
Concatenates one or more parquet files

Functionsยง

main ๐Ÿ”’
read_bloom_filter ๐Ÿ”’