pyarrow.dataset.FileFormat

class pyarrow.dataset.FileFormat

Bases: pyarrow.lib._Weakrefable

__init__(*args, **kwargs)

Methods

__init__(*args, **kwargs)

inspect(self, file[, filesystem])

Infer the schema of a file.

make_fragment(self, file[, filesystem])

Make a FileFragment of this FileFormat.

make_write_options(self)

Attributes

default_extname

default_fragment_scan_options

default_extname
default_fragment_scan_options
inspect(self, file, filesystem=None)

Infer the schema of a file.

make_fragment(self, file, filesystem=None, Expression partition_expression=None)

Make a FileFragment of this FileFormat. The filter may not reference fields absent from the provided schema. If no schema is provided then one will be inferred.

make_write_options(self)