Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bqr_upload_data issues with special characters #80

Open
rafaxalv opened this issue Nov 18, 2022 · 1 comment
Open

bqr_upload_data issues with special characters #80

rafaxalv opened this issue Nov 18, 2022 · 1 comment

Comments

@rafaxalv
Copy link

Hi,

Im uploading some dataframes from R to big query. When using bigquery package I had no issues.
When I upload with BigQueryR I have problems with special characters. Is there any configuration I should do?

I see in the source code that there is an encoding being applied at the step of the CSV creation.

bqr_upload_data(projectId = billing, datasetId = clientname, tableId = 'Lancamentos_Financeiros', upload_data = lancamentosFinanceiros , create = c("CREATE_IF_NEEDED"), schema = NULL, wait = F, autodetect = TRUE, nullMarker = NULL, maxBadRecords = NULL, allowJaggedRows = FALSE, allowQuotedNewlines = FALSE, fieldDelimiter = ",")

Also. bqr_upload_data is significantly slower than bq_perform_upload. Is there something I can set to reduce upload times?

@MarkEdmondson1234
Copy link
Collaborator

I imagine bigrquery is using the more performant BigQuery storage API and is in general more maintained than this library. Is there a reason you are using bigQueryR vs bigrquery?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants