From dbt-core 1.8 - Add support to load source freshness data as well

[b-per]

Is your feature request related to a problem? Please describe.
Until dbt-core 1.7, it is not possible to use on-run-end hooks to upload freshness data to the warehouse.

This merged PR provides this ability going forward (e.g. 1.8+)

There is also a flag that needs to be set in dbt_project.yml for the hook to be triggered

# dbt_project.yml
flags:
  source_freshness_run_project_hooks: true

Describe the solution you'd like
Update the package so that source freshness data can be loaded to the warehouse as well

[Maayan-s]

@b-per this PR was actually contributed by @ofek1weiss from our team :)
We are waiting for dbt to make the release official.

[kokorin]

@Maayan-s since 1.8 has been released, can we expect Elementary to use on-run-end hook to upload source freshness?

[haritamar]

Hi @kokorin !
Yes definitely, we'll likely prioritize this in the near future!