pyarrow.NativeFile

class pyarrow.NativeFile

Bases: object

__init__()

Initialize self. See help(type(self)) for accurate signature.

Methods

close(self)
download(self, stream_or_path[, buffer_size]) Read file completely to local path (rather than reading completely into memory).
flush(self) Flush the buffer stream, if applicable.
read(self[, nbytes]) Read indicated number of bytes from file, or read all remaining bytes if no argument passed
read1(self[, nbytes]) Read and return up to n bytes.
read_buffer(self[, nbytes])
readable(self)
seek(self, int64_t position, int whence=0) Change current file stream position
seekable(self)
size(self) Return file size
tell(self) Return current stream position
upload(self, stream[, buffer_size]) Pipe file-like object to file
writable(self)
write(self, data) Write byte from any object implementing buffer protocol (bytes, bytearray, ndarray, pyarrow.Buffer)

Attributes

closed
mode The file mode.Currently instances of NativeFile may support –.
close(self)
closed
download(self, stream_or_path, buffer_size=None)

Read file completely to local path (rather than reading completely into memory). First seeks to the beginning of the file.

flush(self)

Flush the buffer stream, if applicable.

No-op to match the IOBase interface.

mode

The file mode. Currently instances of NativeFile may support

  • rb: binary read
  • wb: binary write
  • rb+: binary read and write
read(self, nbytes=None)

Read indicated number of bytes from file, or read all remaining bytes if no argument passed

Parameters:nbytes (int, default None) –
Returns:data (bytes)
read1(self, nbytes=None)

Read and return up to n bytes.

Alias for read, needed to match the IOBase interface.

read_buffer(self, nbytes=None)
readable(self)
seek(self, int64_t position, int whence=0)

Change current file stream position

Parameters:
  • position (int) – Byte offset, interpreted relative to value of whence argument
  • whence (int, default 0) – Point of reference for seek offset

Notes

Values of whence: * 0 – start of stream (the default); offset should be zero or positive * 1 – current stream position; offset may be negative * 2 – end of stream; offset is usually negative

Returns:new_position (the new absolute stream position)
seekable(self)
size(self)

Return file size

tell(self)

Return current stream position

upload(self, stream, buffer_size=None)

Pipe file-like object to file

writable(self)
write(self, data)

Write byte from any object implementing buffer protocol (bytes, bytearray, ndarray, pyarrow.Buffer)