This will do the necessary configuration to create a (virtual) table in DuckDB
that is backed by the Arrow object given. No data is copied or modified until
collect() or compute() are called or a query is run against the table.
to_duckdb(
.data,
con = arrow_duck_connection(),
table_name = unique_arrow_tablename(),
auto_disconnect = TRUE
)the Arrow object (e.g. Dataset, Table) to use for the DuckDB table
a DuckDB connection to use (default will create one and store it
in options("arrow_duck_con"))
a name to use in DuckDB for this object. The default is a
unique string "arrow_" followed by numbers.
should the table be automatically cleaned up when the
resulting object is removed (and garbage collected)? Default: TRUE
A tbl of the new table in DuckDB
The result is a dbplyr-compatible object that can be used in d(b)plyr pipelines.
If auto_disconnect = TRUE, the DuckDB table that is created will be configured
to be unregistered when the tbl object is garbage collected. This is helpful
if you don't want to have extra table objects in DuckDB after you've finished
using them.
library(dplyr)
ds <- InMemoryDataset$create(mtcars)
ds %>%
filter(mpg < 30) %>%
to_duckdb() %>%
group_by(cyl) %>%
summarize(mean_mpg = mean(mpg, na.rm = TRUE))
#> # Source: SQL [3 x 2]
#> # Database: DuckDB 0.3.5-dev1410 [unknown@Linux 5.15.0-1014-azure:R 4.2.1/:memory:]
#> cyl mean_mpg
#> <dbl> <dbl>
#> 1 6 19.7
#> 2 4 23.7
#> 3 8 15.1