You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Delta table access via Symlink table using Hive Connector in Prestissimo
Expected Behavior or Use Case
Delta table can be accessed using hive connector by registering them as a symlink tables in HMS. https://docs.delta.io/latest/presto-integration.html
This is to extend this same support for Prestissimo using Hive Connector.
Presto Component, Service, or Connector
presto-native-execution
Possible Implementation
Currenlty mapping for inputformat and serde are missing in Prestissimo to access symlink tables. We need to add that mapping in PrestoToVeloxConnector.cpp to successfully access Delta tables.
Context
Delta table can be accessed using hive connector by registering them as a symlink tables in HMS. https://docs.delta.io/latest/presto-integration.html
This is to extend this same support for Prestissimo using Hive Connector.
The text was updated successfully, but these errors were encountered:
Discussed about this with Deepak, he mentioned we should add test for this.
So I am open to get pointers around how do we write test for this? Since Presto hive connector Java doesn't support Creating symlink file.
@aditi-pandit This is similar to the Hudi change #19620.
Reetika and I are looking into how we can test Delta similar to Hudi and add a generic testing framework for both Hudi and Delta in Prestissimo.
Delta table access via Symlink table using Hive Connector in Prestissimo
Expected Behavior or Use Case
Delta table can be accessed using hive connector by registering them as a symlink tables in HMS. https://docs.delta.io/latest/presto-integration.html
This is to extend this same support for Prestissimo using Hive Connector.
Presto Component, Service, or Connector
presto-native-execution
Possible Implementation
Currenlty mapping for inputformat and serde are missing in Prestissimo to access symlink tables. We need to add that mapping in PrestoToVeloxConnector.cpp to successfully access Delta tables.
Context
Delta table can be accessed using hive connector by registering them as a symlink tables in HMS. https://docs.delta.io/latest/presto-integration.html
This is to extend this same support for Prestissimo using Hive Connector.
The text was updated successfully, but these errors were encountered: