Skip to main content

Module byte_budget_chunker

Module byte_budget_chunker 

Source
Expand description

See ByteBudgetChunker for byte-budget-aware mini-batch sizing.

Re-exportsยง

use crate::basic::Type; ๐Ÿ”’
use crate::column::writer::LevelDataRef; ๐Ÿ”’
use crate::column::writer::encoder::ColumnValueEncoder; ๐Ÿ”’
use crate::file::properties::ResolvedColumnProperties; ๐Ÿ”’
use crate::schema::types::ColumnDescriptor; ๐Ÿ”’

Structsยง

ByteBudgetChunker ๐Ÿ”’
Picks byte-budget-aware mini-batch sizes for one column.

Enumsยง

SubBatchStrategy ๐Ÿ”’
How write_granular_chunk should cut mini-batch windows in one chunk.