2.3.1

Release notes

• These release notes provide information about new features, fixes, and updates that are included in the latest update release.
• We often roll out features (and sometimes even fixes) to Current over a period of time. If you don’t see something described below right away, you can expect it soon

ADB to Purview Connector Solution Accelerator - Version 2.3.1

Version 2.3.1

Features

• Rolled back support of Delta Merge statement. There was a false positive in our test suite but additional tests were added and verified that Delta Merge is still not supported due to proprietary implementation from Databricks.

Major Bug Fixes

• Fixed issue with Library definition in Job Tasks causing deserialization error (#177)
• Fixed issue where mount points refer to nested folder (#175)

Other

• Added a utility for removing spaces from OlToPurviewMapping.json ./deployment/util/mappings-remove-spaces.py

Upgrade from 2.3.0 to 2.3.1

OpenLineage / Databricks Installation

• No changes to the OpenLineage / Databricks Installation

Changes to Function App Settings

• Update OlToPurviewMappings with the latest mappings found in the deployment/infra/OlToPurviewMappings.json file.

Changes to Function App

You will need to deploy the updated function code to Azure. You can do so with either of the following:

• Cloning the repo and deploying via VS code's Azure Functions Extension.
• Using the Azure CLI to do a zip push deployment with the 2.3.0 zip release artifact.

az functionapp deployment source config-zip \
-g <RESOURCE_GROUP_NAME> \
-n <FUNCTION_SERVICE_NAME> \
--src <PATH_TO_RELEASE_ZIP_FILE>