Releases: Datavault-UK/automate-dv
Version 0.10.2
[v0.10.2] - 2024-02-27
New
dbt Versions
👍 Officially tested on dbt 1.7.x
All Platforms
- A new SHA-1 Hashing option is now available for all platforms!* docs
*Not available on Postgres due to requiring pgcrypto extension
Fixed
All Platforms
- Fixed an issue where the payload-exclusion feature was not enabled for payload definitions in Multi-Active Satellites (#217)
- Fixed an issue where in some cases duplicates would be loaded into Satellites (#221)
SQLServer/Postgres
Notes
- dbt SQLServer 1.7.x has caused the
vault_insert_by_x
materialisations provided by AutomateDV to behave inconsistently - both materialisations have been temporarily disabled in SQLServer only and will raise an error, and output an error message when used on SQLServer only.
Thanks
@ZacharyMcGuire - Contributing fixes for SQLServer casing issues
Version 0.10.1
[v0.10.1] - 2023-08-28
Fixes
All Platforms
- Fixed the case where repeating a load would cause duplicates when using the Satellites as released in 0.10.0 (#207)
- Implemented as a new Behaviour Flag for Satellites
apply_source_filter
- Implemented as a new Behaviour Flag for Satellites
Thanks
- With thanks to @cristianivanoff for reporting this (#207) on Slack!
Version 0.10.0
[v0.10.0] - 2023-08-14
New
All Platforms
-
Reference Tables (ref_table macro)
Improved
All Platforms
-
Satellite loading limitations resolved 🎉🎉🎉
(for standardsat()
macro)- Migration Guide
- Updated Loading Guide
Version 0.9.7
[v0.9.7] - 2023-07-19
New
Databricks and Postgres
Databricks and Postgres are now fully supported in v0.9.7!
We have added support for:
- Transactional Links (t_link macro)
- Effectivity Satellites (eff_sat macro)
- Multi-active Satellites (ma_sat macro)
- Extended Tracking Satellites (xts macro)
- Point in Time tables (PITs) (pit macro)
- Bridges (bridge macro)
Fixes
All platforms
Error handling and error messages
- Cases where escape characters are empty now correctly use the platform default instead.
- Cases where too many iterations (>100,000) would occur for custom
vault_insert_by_x
materialisations on SQLServer now raise an error.
Postgres
- Fixed a hashing length bug (#176)
Version 0.9.6 - The Rebrand
Version 0.9.5
[v0.9.5] - 2023-03-22
Fixes
All platforms
- Added error handling for when the number of iterations in
vault_insert_by_x
exceeds 100,000 (#175) - Fixed a regression in PITs where an incorrect join was causing a performance hit and in some cases, incorrect data
- Fixed an issue causing 'LOADING...' log messages to appear when running
dbt docs generate
ordbt docs serve
- Fixed a bug in the
vault_insert_by_period
materialisation affecting executions with 'hour' as the period (#178)
SQLServer
- Fixed a minor casing issue in the SQLServer
eff_sat
macro (#182)
Databricks
- Fixed an issue related to #183 but for MD5 hashing in Databricks
Version 0.9.4
[v0.9.4] - 2023-02-16
This is a minor hotfix update. More bug fixes to come soon! 😄
Fixes
- Binary type not defaulting correctly (Snowflake) (#183)
Version 0.9.3
[v0.9.3] - 2023-01-27
Fixes
- Updated
packages.yml
for compatibility with dbt-utils 1.0.0
Notes
- Fully tested (and passing) with dbt-utils 1.0.0 and dbt 1.3.2
Thank you to our community
Thank you to all those who were being patient for this release. The delay was due to us wanting to release this with a few other bug fixes and new features. This additional content is being released at a later date so that we could get this dbt-utils fix out to our community sooner.
Version 0.9.2
Version 0.9.1
[v0.9.1] - 2022-12-16
New
New Features:
🌟 Ghost Records -> Docs
🌟 Hashing Casing config (#123) -> Docs
dbt Versions
👍 dbt support updated to 1.3.x
👍 dbt-utils support updated to 0.9.x (1.0.x will be officially supported shortly)
Fixes
Escaping
We have made significant changes to how escaping now works as per #168. We believe this will fix the bugs collected in this master issue.
Whilst we have tested this extensively, we cannot yet be 100% this has fixed every edge case. Please bear with us as we collect community feedback. We welcome your feedback on this!
Related issues:
Casing
In addition to the above, we have also done an overhaul of casing in our templates. Users should now not experience any unwanted casing changes. As above, please provide feedback if any issues are found!
Related issues:
Other
- Fixed a few edge cases where excludes for payload and hashdiffs would not work as expected
Behind the scenes
- Major re-factor of Hashing to improve maintainability, readability and extensibility. The functionality remains the same and should not affect users
Docs
- Split best practises into separate pages for ease of navigation and to reduce clutter
- Moved old release notes to a new "archived" releases page