You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I routinely work with multiple large csvs with a mess of file paths that aren't amenable to glob syntax. When working with duckdb I can supply these as, say SELECT * FROM read_csv([file_1.csv, file_2.csv]) and that works. I can't figure out how to do the equivalent in duckplyr.
I've tried:
file_paths <- c("file_1.csv", "file_2.csv) OR file_paths <- list("file_1.csv", "file_2.csv")
duckplyr_df_from_csv(file_paths) %>% do_something
It doesn't error, but it only reads in the first file.
Is this possible? if so how? If not, I think there should at least be a warning if a list or vector of multiple file paths are passed.
The text was updated successfully, but these errors were encountered:
Thanks. Code like file_paths %>% map(duckplyr_df_from_csv) %>% bind_rows() has worked for me in practice, but I agree that this should be streamlined. Would you like to contribute a PR?
I routinely work with multiple large csvs with a mess of file paths that aren't amenable to glob syntax. When working with duckdb I can supply these as, say
SELECT * FROM read_csv([file_1.csv, file_2.csv])
and that works. I can't figure out how to do the equivalent in duckplyr.I've tried:
file_paths <- c("file_1.csv", "file_2.csv)
ORfile_paths <- list("file_1.csv", "file_2.csv")
duckplyr_df_from_csv(file_paths) %>% do_something
It doesn't error, but it only reads in the first file.
Is this possible? if so how? If not, I think there should at least be a warning if a list or vector of multiple file paths are passed.
The text was updated successfully, but these errors were encountered: