Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: add AppendRowsStream helper to append rows with a BigQueryWriteClient #284

Merged
merged 48 commits into from Sep 10, 2021
Merged

feat: add AppendRowsStream helper to append rows with a BigQueryWriteClient #284

merged 48 commits into from Sep 10, 2021

Commits on Aug 9, 2021

  1. WIP: write client sample

    @tswast
    tswast committed Aug 9, 2021
    Copy the full SHA
    c34e0bf View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2021

  1. add sample with nullable types

    @tswast
    tswast committed Aug 11, 2021
    Copy the full SHA
    c9d6338 View commit details
    Browse the repository at this point in the history

  2. add schema for all supported types

    @tswast
    tswast committed Aug 11, 2021
    Copy the full SHA
    dbe2a21 View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2021

  1. add complex types to code sample

    @tswast
    tswast committed Aug 12, 2021
    Copy the full SHA
    e5b7b3f View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2021

  1. refactor sample so that it can be tested

    @tswast
    tswast committed Aug 16, 2021
    Copy the full SHA
    2d927b1 View commit details
    Browse the repository at this point in the history

  2. make test assertions more thorough

    @tswast
    tswast committed Aug 16, 2021
    Copy the full SHA
    19b746e View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into b195450856-write-client

    @tswast
    tswast committed Aug 16, 2021
    Copy the full SHA
    f6af466 View commit details
    Browse the repository at this point in the history

  4. fix lint error

    @tswast
    tswast committed Aug 16, 2021
    Copy the full SHA
    483b0e3 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/b195450856-write-client' into b1… 

    …95450856-write-client
    @tswast
    tswast committed Aug 16, 2021
    Copy the full SHA
    a74e7ea View commit details
    Browse the repository at this point in the history

  6. remove done TODO

    @tswast
    tswast committed Aug 16, 2021
    Copy the full SHA
    eba8539 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2021

  1. address reviewer comments

    @tswast
    tswast committed Aug 17, 2021
    Copy the full SHA
    40e2800 View commit details
    Browse the repository at this point in the history

  2. fix tag mismatch

    @tswast
    tswast committed Aug 17, 2021
    Copy the full SHA
    49c3c58 View commit details
    Browse the repository at this point in the history

  3. test on multiple regions

    @tswast
    tswast committed Aug 17, 2021
    Copy the full SHA
    6d30337 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2021

  1. Merge remote-tracking branch 'upstream/master' into b195450856-write-… 

    …client
    @tswast
    tswast committed Aug 19, 2021
    Copy the full SHA
    cc969eb View commit details
    Browse the repository at this point in the history

  2. correct comments about why offset exists

    @tswast
    tswast committed Aug 19, 2021
    Copy the full SHA
    bba6df4 View commit details
    Browse the repository at this point in the history

  3. upgrade g-c-b

    @tswast
    tswast committed Aug 19, 2021
    Copy the full SHA
    dcc648d View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2021

  1. WIP: invert stream using BiDi class

    @tswast
    tswast committed Aug 20, 2021
    Copy the full SHA
    12a82a1 View commit details
    Browse the repository at this point in the history

  2. WIP: attempt to use Future for send instead

    @tswast
    tswast committed Aug 20, 2021
    Copy the full SHA
    1beb0b9 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2021

  1. WIP: use futures, populated by background consumer

    @tswast
    tswast committed Aug 23, 2021
    Copy the full SHA
    34e5cbd View commit details
    Browse the repository at this point in the history

  2. make sure stream is actually open before returning from open

    @tswast
    tswast committed Aug 23, 2021
    Copy the full SHA
    d2491b1 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2021

  1. copy close implementation from pub/sub

    @tswast
    tswast committed Aug 24, 2021
    Copy the full SHA
    daf42a8 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2021

  1. support extra metadata

    @tswast
    tswast committed Aug 25, 2021
    Copy the full SHA
    c40b51f View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2021

  1. Merge remote-tracking branch 'upstream/master' into b195450856-write-… 

    …client-BiDi
    @tswast
    tswast committed Aug 26, 2021
    Copy the full SHA
    8bcc36c View commit details
    Browse the repository at this point in the history

  2. process exceptions, add open timeout

    @tswast
    tswast committed Aug 26, 2021
    Copy the full SHA
    350628d View commit details
    Browse the repository at this point in the history

  3. sort imports

    @tswast
    tswast committed Aug 26, 2021
    Copy the full SHA
    4086445 View commit details
    Browse the repository at this point in the history

  4. WIP: unit tests

    @tswast
    tswast committed Aug 26, 2021
    Copy the full SHA
    4c7f60e View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2021

  1. drain futures when stream closes

    @tswast
    tswast committed Aug 27, 2021
    Copy the full SHA
    f42d871 View commit details
    Browse the repository at this point in the history

  2. update docs

    @tswast
    tswast committed Aug 27, 2021
    Copy the full SHA
    39cd7af View commit details
    Browse the repository at this point in the history

  3. add callbacks to detect when a stream fails

    @tswast
    tswast committed Aug 27, 2021
    Copy the full SHA
    cc9a0fb View commit details
    Browse the repository at this point in the history

  4. add unit tests

    @tswast
    tswast committed Aug 27, 2021
    Copy the full SHA
    1d7f76a View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into b195450856-write-client-BiDi

    @tswast
    tswast committed Aug 27, 2021
    Copy the full SHA
    b054fce View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2021

  1. Merge branch 'main' into b195450856-write-client-BiDi

    @tswast
    tswast committed Aug 31, 2021
    Copy the full SHA
    29e25ce View commit details
    Browse the repository at this point in the history

  2. add sleep to loop waiting for RPC to be active

    @tswast
    tswast committed Aug 31, 2021
    Copy the full SHA
    faaee9e View commit details
    Browse the repository at this point in the history

  3. don't freeze if initial RPC fails

    @tswast
    tswast committed Aug 31, 2021
    Copy the full SHA
    46dd60e View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2021

  1. Merge remote-tracking branch 'upstream/main' into b195450856-write-cl… 

    …ient-BiDi
    @tswast
    tswast committed Sep 3, 2021
    Copy the full SHA
    4563e4b View commit details
    Browse the repository at this point in the history

  2. add needed initializations so done() functions

    @tswast
    tswast committed Sep 3, 2021
    Copy the full SHA
    22b7b0c View commit details
    Browse the repository at this point in the history

  3. fail fast when there is a problem with the initial request

    @tswast
    tswast committed Sep 3, 2021
    Copy the full SHA
    e307c8f View commit details
    Browse the repository at this point in the history

  4. don't inherit concurrent.futures 

    It's unnecessary and kept resulting in stuff getting stuck.
    @tswast
    tswast committed Sep 3, 2021
    Copy the full SHA
    2b26b3d View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2021

  1. Merge remote-tracking branch 'upstream/main' into b195450856-write-cl… 

    …ient-BiDi
    @tswast
    tswast committed Sep 8, 2021
    Copy the full SHA
    0e91a6a View commit details
    Browse the repository at this point in the history

  2. add unit test for open timeout

    @tswast
    tswast committed Sep 8, 2021
    Copy the full SHA
    a3185e9 View commit details
    Browse the repository at this point in the history

  3. 🦉 Updates from OwlBot 

    See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md
    @gcf-owl-bot
    gcf-owl-bot[bot] committed Sep 8, 2021
    Copy the full SHA
    61fa79f View commit details
    Browse the repository at this point in the history

  4. add manual client to docs

    @tswast
    tswast committed Sep 8, 2021
    Copy the full SHA
    6fc1c75 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/b195450856-write-client-BiDi' in… 

    …to b195450856-write-client-BiDi
    @tswast
    tswast committed Sep 8, 2021
    Copy the full SHA
    7bddd4f View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2021

  1. typo in sample comments

    @tswast
    tswast committed Sep 9, 2021
    Copy the full SHA
    0c5d08c View commit details
    Browse the repository at this point in the history

  2. force timeout and metadata to be kwargs

    @tswast
    tswast committed Sep 9, 2021
    Copy the full SHA
    dc33c88 View commit details
    Browse the repository at this point in the history

  3. unify interface for sending row data

    @tswast
    tswast committed Sep 9, 2021
    Copy the full SHA
    9b229a3 View commit details
    Browse the repository at this point in the history

  4. pull stream name from merged request

    @tswast
    tswast committed Sep 9, 2021
    Copy the full SHA
    001a922 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2021

  1. require newer proto-plus for copy_from method

    @tswast
    tswast committed Sep 10, 2021
    Copy the full SHA
    68507d8 View commit details
    Browse the repository at this point in the history