New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Modified dataflow templates parameter description #1510
Modified dataflow templates parameter description #1510
Conversation
…late" This reverts commit ad65fdd.
…bSub_to_MongoDB templates
...ud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextIOToBigQuery.java
Outdated
Show resolved
Hide resolved
...ud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextIOToBigQuery.java
Outdated
Show resolved
Hide resolved
v2/pubsub-to-mongodb/src/main/java/com/google/cloud/teleport/v2/templates/PubSubToMongoDB.java
Outdated
Show resolved
Hide resolved
v2/pubsub-to-mongodb/src/main/java/com/google/cloud/teleport/v2/templates/PubSubToMongoDB.java
Show resolved
Hide resolved
I think this is actually for the batch template? i.e. https://cloud.google.com/dataflow/docs/guides/templates/provided/cloud-storage-to-bigquery In the docs, the parameter descriptions are inconsistent between the streaming and batch versions of the template. But I don't think it matters which version we pick. |
...ud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextIOToBigQuery.java
Outdated
Show resolved
Hide resolved
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #1510 +/- ##
============================================
- Coverage 40.93% 40.18% -0.75%
+ Complexity 2815 2793 -22
============================================
Files 740 737 -3
Lines 42875 42768 -107
Branches 4585 4578 -7
============================================
- Hits 17549 17187 -362
- Misses 23824 24102 +278
+ Partials 1502 1479 -23
|
...ud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextIOToBigQuery.java
Outdated
Show resolved
Hide resolved
...ud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextIOToBigQuery.java
Outdated
Show resolved
Hide resolved
...ud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextIOToBigQuery.java
Outdated
Show resolved
Hide resolved
...ooglecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextToBigQueryStreaming.java
Outdated
Show resolved
Hide resolved
v2/pubsub-to-mongodb/src/main/java/com/google/cloud/teleport/v2/templates/PubSubToMongoDB.java
Outdated
Show resolved
Hide resolved
v2/pubsub-to-mongodb/src/main/java/com/google/cloud/teleport/v2/templates/PubSubToMongoDB.java
Outdated
Show resolved
Hide resolved
v2/pubsub-to-mongodb/src/main/java/com/google/cloud/teleport/v2/templates/PubSubToMongoDB.java
Outdated
Show resolved
Hide resolved
v2/pubsub-to-mongodb/src/main/java/com/google/cloud/teleport/v2/templates/PubSubToMongoDB.java
Outdated
Show resolved
Hide resolved
changes suggested in descriptions Co-authored-by: Rebecca Szper <98840847+rszper@users.noreply.github.com>
...ud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextIOToBigQuery.java
Outdated
Show resolved
Hide resolved
...ooglecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextToBigQueryStreaming.java
Outdated
Show resolved
Hide resolved
...ud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextIOToBigQuery.java
Outdated
Show resolved
Hide resolved
...ud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextIOToBigQuery.java
Outdated
Show resolved
Hide resolved
...ud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextIOToBigQuery.java
Outdated
Show resolved
Hide resolved
Co-authored-by: Rebecca Szper <98840847+rszper@users.noreply.github.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
One minor edit, otherwise LGTM
v2/pubsub-to-mongodb/src/main/java/com/google/cloud/teleport/v2/templates/PubSubToMongoDB.java
Outdated
Show resolved
Hide resolved
…2/templates/PubSubToMongoDB.java Co-authored-by: Rebecca Szper <98840847+rszper@users.noreply.github.com>
8dfb6de
into
GoogleCloudPlatform:main
Modified parameters for Stream_GCS_Text_to_BigQuery_Flex and Cloud_PubSub_to_MongoDB templates