Apache Arrow Flight SQL adapter for PostgreSQL 0.1.0 Release

Published 13 Sep 2023
By The Apache Arrow PMC (pmc)

The Apache Arrow team is pleased to announce the 0.1.0 release of the Apache Arrow Flight SQL adapter for PostgreSQL. This includes 60 commits from 1 distinct contributors.

The release notes below are not exhaustive and only expose selected highlights of the release. Many other bug fixes and improvements have been made: we refer you to the complete release notes.

What is Apache Arrow Flight SQL adapter for PostgreSQL?

Apache Arrow Flight SQL adapter for PostgreSQL is a PostgreSQL extension that adds an Apache Arrow Flight SQL endpoint to PostgreSQL.

Apache Arrow Flight SQL is a protocol to use Apache Arrow format to interact with SQL databases. You can use Apache Arrow Flight SQL instead of the PostgreSQL wire protocol to interact with PostgreSQL by Apache Arrow Flight SQL adapter for PostgreSQL.

Apache Arrow format is designed for fast typed table data exchange. If you want to get large data by SELECT or INSERT/UPDATE large data, Apache Arrow Flight SQL will be faster than the PostgreSQL wire protocol.

Release Highlights

This is the initial release!

This includes the following basic features. Other features will be implemented in the future releases.

  • Literal SELECT/INSERT/UPDATE/DELETE
  • Prepared SELECT/INSERT/UPDATE/DELETE
  • password/trust authentications
  • TLS connection
  • Integer family types
  • Floating point family types
  • Text family types
  • Binary family types
  • Timestamp with time zone type

Packages for Debian GNU/Linux bookworm and Ubuntu 22.04 are available.

Install

See the install document for details.

Contributors

$ git shortlog --perl-regexp --author=^((?!dependabot\[bot\]).*)$ -sn dc7f34e2636732acd0d015a7cd8259334f1acb16...0.1.0
    59	Sutou Kouhei

Roadmap

  • Add support for more data types
  • Add support for mTLS
  • Add support for Apache Arrow Flight SQL commands to fetch metadata
  • Add support for Apache Arrow Flight SQL transaction related APIs
  • Add support for canceling a query
  • Add more benchmark results
  • Document architecture

Getting Involved

We welcome questions and contributions from all interested. Issues can be filed on GitHub, and questions can be directed to GitHub or the Apache Arrow mailing lists.