Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: <Kafka to BigQuery template is confusing and there are no mandatory parameters. Clean up is required. See 4 items mentioned in the What happened section> #1430

Open
allamsudha opened this issue Apr 12, 2024 · 0 comments
Labels
bug Something isn't working needs triage p2

Comments

@allamsudha
Copy link

Related Template(s)

Kafka to BigQuery

Template Version

V2

What happened?

Handle @deprecated annotation properly in order to remove duplicates up on the screen. – Bug
Make Kafka broadcast servers list as mandatory – Bug
GCP Dataflow Kafka to BigQuery template should be able to read the topics list from Cloud Storage OR BigQuery table prepopulated OR from text box input. One of them is mandatory – Bug
CREATE_IF_NEEDED should be the default disposition for not only topics tables but also for dead letter tables. – Bug
Unify the solution so that it is using reusable components. For example, datastream merging function may most probably applicable to JDBC, pub/sub, kafka, etc., sources.
One reusable component may be sufficient – Bug

Relevant log output

No response

@allamsudha allamsudha added bug Something isn't working needs triage p2 labels Apr 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working needs triage p2
Projects
None yet
Development

No branches or pull requests

1 participant