Struct ArrowRowGroupWriter 

struct ArrowRowGroupWriter {
    writers: Vec<ArrowColumnWriter>,
    schema: SchemaRef,
    buffered_rows: usize,
}

Encodes [RecordBatch] to a parquet row group

Note: this structure is created by ArrowRowGroupWriterFactory internally used to create ArrowRowGroupWriters, but it is not exposed publicly.

See the example on ArrowColumnWriter for how to encode columns in parallel

Fields

writers: Vec<ArrowColumnWriter>

schema: SchemaRef

buffered_rows: usize

Implementations

impl ArrowRowGroupWriter

fn new(writers: Vec<ArrowColumnWriter>, arrow: &SchemaRef) -> Self

fn write(&mut self, batch: &RecordBatch) -> Result<()>

fn write_with_chunkers( &mut self, batch: &RecordBatch, chunkers: &mut [ContentDefinedChunker], ) -> Result<()>

fn get_estimated_total_bytes(&self) -> usize

Returns the estimated total encoded bytes for this row group

fn close(self) -> Result<Vec<ArrowColumnChunk>>

Trait Implementations

impl Debug for ArrowRowGroupWriter

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.