Apache Arrow ADBC 0.8.0 (Libraries) Release

Published 09 Nov 2023
By The Apache Arrow PMC (pmc)

The Apache Arrow team is pleased to announce the 0.8.0 release of the Apache Arrow ADBC libraries. This covers includes 43 resolved issues from 12 distinct contributors.

This is a release of the libraries, which are at version 0.8.0. The API specification is versioned separately and is at version 1.1.0.

The release notes below are not exhaustive and only expose selected highlights of the release. Many other bugfixes and improvements have been made: we refer you to the complete changelog.

Release Highlights

C#/.NET has added a BigQuery driver. Also, it now can be used through ADO.NET.

The R bindings now use ADBC 1.1.0, and more packages are now available on CRAN.

The Snowflake driver now has an option to control whether to return decimal types or attempt to convert to integers/floats. The PostgreSQL driver now uses COPY for bulk ingestion, which Pandas has found is approximately 35x faster than their previous method. The SQLite driver can now load extensions and supports more data types, including Arrow binary (SQL BLOB), and supports binding some dictionary-encoded types (which will be unpacked).

Contributors

$ git shortlog --perl-regexp --author='^((?!dependabot\[bot\]).*)$' -sn apache-arrow-adbc-0.7.0..apache-arrow-adbc-0.8.0
    27	David Li
    23	William Ayd
    19	Dewey Dunnington
     4	Matt Topol
     4	Solomon Choe
     4	davidhcoe
     2	vleslief-ms
     1	Aaron Ross
     1	Fredrik Hoem Grelland
     1	Joel Lubinitsky
     1	OleMussmann
     1	Ruoxuan Wang

Roadmap

Work continues on improving the existing drivers in terms of supported Arrow/database types, performance, and so on.

For Java, the minimum JDK version will stay on JDK 8 as long as the Arrow Java libraries remain on that version.

There are currently no plans for a second API revision. As work progresses on asynchronous and device-aware APIs in the Arrow ecosystem, ADBC will eventually be updated to support any new APIs.

Getting Involved

We welcome questions and contributions from all interested. Issues can be filed on GitHub, and questions can be directed to GitHub or the Arrow mailing lists.