Is there a way to see a query plan?

[geekodour]

Description

See this blogpost: https://salim-sayed.medium.com/spark-delta-lake-merge-slowness-due-to-skewed-partitions-f212285bd04f
It shows an example of the Physical plan

Use Case
I am trying to debug a slow merge while using delta-rs via polars and I am not sure how should I access the query plan. Is it something that's accessible?

[geekodour]

Another example: https://kb.databricks.com/delta/delta-merge-into

Think this is more of a pyarrow question?

[ion-elgreco]

Not really at the moment. You could modify the delta-rs code to return/dbg the plan.

Are you merging on the full table or a set of partitions?

[echai58]

If you set RUST_LOG=debug datafusion will print out the full optimized/unoptimized query plans, if that's what you're looking for.