Reading query table.list_rows based on start_index and max_results not working. #113
Labels
api: bigquery
Issues related to the googleapis/python-bigquery API.
priority: p1
Important issue which blocks shipping the next release. Will be fixed prior to next release.
type: bug
Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
I am using python google.cloud.bigquery.client library.
Scenario:
I have a query which is supposed to return 2M records. Due to another issue I am facing - #112 (comment)
I thought of using of start_index and max_results on table.list_rows method on temp table of query results.
Rererence -
https://cloud.google.com/bigquery/docs/paging-results#paging_through_query_results
I create a list of start_index and started multiple thread to read 1000000 records from the start_index.
What I notice is that it is fetching same records more than once.
The text was updated successfully, but these errors were encountered: