8 Using PyArrow from R

8.1 Introduction

For more information on using setting up and installing PyArrow to use in R, see the “Apache Arrow in Python and R with reticulate” vignette.

8.2 Create an Arrow object using PyArrow in R

You want to use PyArrow to create an Arrow object in an R session.

8.2.1 Solution

library(reticulate)
pa <- import("pyarrow")
pyarrow_scalar <- pa$scalar(42)
pyarrow_scalar

## <pyarrow.DoubleScalar: 42.0>

8.3 Call a PyArrow function from R

You want to call a PyArrow function from your R session.

8.3.1 Solution

table_1 <- arrow_table(mtcars[1:5,])
table_2 <- arrow_table(mtcars[11:15,])

pa$concat_tables(tables = list(table_1, table_2)) %>%
  collect()

##     mpg cyl  disp  hp drat    wt  qsec vs am gear carb
## 1  21.0   6 160.0 110 3.90 2.620 16.46  0  1    4    4
## 2  21.0   6 160.0 110 3.90 2.875 17.02  0  1    4    4
## 3  22.8   4 108.0  93 3.85 2.320 18.61  1  1    4    1
## 4  21.4   6 258.0 110 3.08 3.215 19.44  1  0    3    1
## 5  18.7   8 360.0 175 3.15 3.440 17.02  0  0    3    2
## 6  17.8   6 167.6 123 3.92 3.440 18.90  1  0    4    4
## 7  16.4   8 275.8 180 3.07 4.070 17.40  0  0    3    3
## 8  17.3   8 275.8 180 3.07 3.730 17.60  0  0    3    3
## 9  15.2   8 275.8 180 3.07 3.780 18.00  0  0    3    3
## 10 10.4   8 472.0 205 2.93 5.250 17.98  0  0    3    4