Public API for extracting lineage info

[antoniivanov]

Hi,

I think the project looks great and it's very promising as a generic way to be able to gather lineage for SQL users.

But is it only Command-Line? Are there public classes that can be used as a library in another project?

[antoniivanov]

Is LineageRunner considered a public API - https://sqllineage.readthedocs.io/en/latest/basic_concepts/lineage_runner.html

If so then I guess my next question is if I import it then this (https://github.com/reata/sqllineage/blob/master/sqllineage/__init__.py#L59) overrides my logging configuration? Should we fix it? I can open an issue or even a PR for that.

Thanks.

[reata]

Thanks for reaching out.

Moving towards a Python library is definitely the way to go for sqllineage. It's one of the biggest features I'd like to bring in v1.4. But at present, I think I still need more time working on various edge case bugfix release in v1.3.x. So if you'd like to start with the logging configuration, you're more than welcome to.

As for the LineageRunner, I'm not very sure yet. This is definitely the most stable class among others, of course. But previously I was prioritizing adding some functional interface first (#226) . If we're doing it, should sqllineage.run just return LineageRunner? Let me know your thoughts.

[antoniivanov]

Got it. Thanks for the answer.

I opened #245 I hope it's ok.

[reata]

I just merged this PR, thanks for your contribution.

[antoniivanov]

Thanks . If you are curious, I am using sqllineage here