Expand description
Binary that concatenates the column data of one or more parquet files
ยงInstall
parquet-concat can be installed using cargo:
cargo install parquet --features=cliAfter this parquet-concat should be available:
parquet-concat out.parquet a.parquet b.parquetThe binary can also be built from the source code and run as follows:
cargo run --features=cli --bin parquet-concat out.parquet a.parquet b.parquetNote: this does not currently support preserving the page index or bloom filters
Re-exportsยง
pub(crate) use clap::Parser;๐pub(crate) use parquet::bloom_filter::Sbbf;๐pub(crate) use parquet::column::writer::ColumnCloseResult;๐pub(crate) use ParquetError;๐pub(crate) use Result;๐pub(crate) use ColumnChunkMetaData;๐pub(crate) use PageIndexPolicy;๐pub(crate) use ParquetMetaDataReader;๐pub(crate) use parquet::file::properties::WriterProperties;๐pub(crate) use parquet::file::reader::ChunkReader;๐pub(crate) use parquet::file::writer::SerializedFileWriter;๐pub(crate) use std::fs::File;๐pub(crate) use std::sync::Arc;๐
Structsยง
- Args ๐
- Concatenates one or more parquet files
Functionsยง
- main ๐
- read_
bloom_ ๐filter