Apache Arrow DataFusion

DataFusion is a very fast, extensible query engine for building high-quality data-centric systems in Rust, using the Apache Arrow in-memory format.

DataFusion offers SQL and Dataframe APIs, excellent performance, built-in support for CSV, Parquet, JSON, and Avro, extensive customization, and a great community.

The example usage section in the user guide and the datafusion-examples code in the crate contain information on using DataFusion.

The developer’s guide contains information on how to contribute.

Links

• Github and Issue Tracker
• crates.io
• API Docs
• Code of conduct

User Guide

• Introduction
• Example Usage
• datafusion-cli
• DataFrame API
• Expression API
• SQL Reference
• Configuration Settings
• Frequently Asked Questions
• How does DataFusion Compare with XYZ?

Contributor Guide

• Introduction
• Developer’s guide
• Communication
• Architecture
• Roadmap
• Quarterly Roadmap
• Specifications

next

Introduction