pyarrow.csv.open_csv¶

pyarrow.csv.open_csv(input_file, read_options=None, parse_options=None, convert_options=None, MemoryPool memory_pool=None)¶

Open a streaming reader of CSV data.

Reading using this function is always single-threaded.

Parameters:

input_filestr, path or file-like object: The location of CSV data. If a string or path, and if it ends with a recognized compressed file extension (e.g. “.gz” or “.bz2”), the data is automatically decompressed when reading.
read_optionspyarrow.csv.ReadOptions, optional: Options for the CSV reader (see pyarrow.csv.ReadOptions constructor for defaults)
parse_optionspyarrow.csv.ParseOptions, optional: Options for the CSV parser (see pyarrow.csv.ParseOptions constructor for defaults)
convert_optionspyarrow.csv.ConvertOptions, optional: Options for converting CSV data (see pyarrow.csv.ConvertOptions constructor for defaults)
memory_poolMemoryPool, optional: Pool to allocate Table memory from

Returns:

pyarrow.csv.WriteOptions

pyarrow.csv.read_csv