Apache Arrow 0.13.0 Release

Published 02 Apr 2019
By Wes McKinney (wesm)

The Apache Arrow team is pleased to announce the 0.13.0 release. This covers more than 2 months of development work and includes 550 resolved issues from 81 distinct contributors.

See the Install Page to learn how to get the libraries for your platform. The complete changelog is also available.

While it’s a large release, this post will give some brief highlights in the project since the 0.12.0 release from January.

New committers and PMC member

The Arrow team is growing! Since the 0.12.0 release we have increased the size of our committer and PMC rosters.

Thank you for all your contributions!

Rust DataFusion Query Engine donation

Since the last release, we received a donation of DataFusion, a Rust-native query engine for the Arrow columnar format, whose development had been led prior by Andy Grove. Read more about DataFusion in our February blog post.

This is an exciting development for the Rust community, and we look forward to developing more analytical query processing within the Apache Arrow project.

Arrow Flight gRPC progress

Over the last couple months, we have made significant progress on Arrow Flight, an Arrow-native data messaging framework. We have integration tests to check C++ and Java compatibility, and we have added Python bindings for the C++ library. We will write a future blog post to go into more detail about how Flight works.

C++ notes

There were 231 issues relating to C++ in this release, far too much to summarize in a blog post. Some notable items include:

C# Notes

C# .NET development has picked up since the initial code donation last fall. 11 issues were resolved this release cycle.

The Arrow C# package is now available via NuGet.

Go notes

8 Go-related issues were resolved. A notable feature is the addition of a CSV file writer.

Java notes

26 Java issues were resolved. Outside of Flight-related work, some notable items include:

Javascript Notes

The recent JavaScript 0.4.1 release is the last JavaScript-only release of Apache Arrow. Starting with 0.13 the Javascript implementation is now included in mainline Arrow releases! The version number of the released JavaScript packages will now be in sync with the mainline version number.

Python notes

86 Python-related issues were resolved. Some highlights include:

Note that Apache Arrow will continue to support Python 2.7 until January 2020.

Ruby and C GLib notes

36 C/GLib- and Ruby-related issues were resolved. The work continues to follow the upstream work in the C++ project.

Rust notes

69 Rust-related issues were resolved. Many of these relate to ongoing work in the DataFusion query engine. Some notable items include:

R development progress

The Arrow R developers have expanded the scope of the R language bindings and additionally worked on packaging support to be able to submit the package to CRAN in the near future. 23 issues were resolved for this release.

We wrote in January about ongoing work to accelerate R work on Apache Spark using Arrow.

Community Discussions Ongoing

There are a number of active discussions ongoing on the developer dev@arrow.apache.org mailing list. We look forward to hearing from the community there: