Filesystems

Interface

FileInfo(path, FileType type=FileType.Unknown)	FileSystem entry info.
FileSelector(base_dir, …)	File and directory selector.
FileSystem()	Abstract file system API.

Concrete Subclasses

LocalFileSystem([use_mmap])	A FileSystem implementation accessing files on the local machine.
S3FileSystem([access_key, secret_key, …])	S3-backed FileSystem implementation
HadoopFileSystem(unicode host, …[, …])	HDFS backed FileSystem implementation
SubTreeFileSystem(base_path, FileSystem base_fs)	Delegates to another implementation after prepending a fixed base path.

To define filesystems with behavior implemented in Python:

PyFileSystem(handler)	A FileSystem with behavior implemented in Python.
FileSystemHandler()	An abstract class exposing methods to implement PyFileSystem’s behavior.
FSSpecHandler(fs)	Handler for fsspec-based Python filesystems.

previous

pyarrow.orc.ORCFile

next

pyarrow.fs.FileInfo