Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Flink] Add support for generating OpenLineage event in Flink sink job #167

Open
dmetasoul01 opened this issue Mar 14, 2023 · 0 comments
Open

[Flink] Add support for generating OpenLineage event in Flink sink job #167

dmetasoul01 opened this issue Mar 14, 2023 · 0 comments
Assignees
@dmetasoul01
Labels
enhancement New feature or request flink flink support into lakesoul
Projects
Realtime Lineage

Comments

@dmetasoul01
Copy link
Contributor

Add open lineage event report for flink cdc sink.
Input datasets should contain the source database/table of mysql. And output datasets are lakesoul's tables.
Job name should be the job name of the flink job, and run event is generated for each commit during checkpoint with unique run id.
@dmetasoul01 dmetasoul01 added enhancement New feature or request flink flink support into lakesoul labels Mar 14, 2023
@dmetasoul01 dmetasoul01 self-assigned this Mar 14, 2023
@dmetasoul01 dmetasoul01 added this to To do in Realtime Lineage via automation Mar 14, 2023
@dmetasoul01 dmetasoul01 changed the title [Flink] Support OpenLineage [Flink] Add support for generating OpenLineage event in Flink sink job Mar 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dmetasoul01 dmetasoul01

Labels
enhancement New feature or request flink flink support into lakesoul
Projects
Realtime Lineage
To do
Milestone
No milestone
Development

No branches or pull requests
1 participant
@dmetasoul01