dbt-core v1.6.13

dbt-core 1.6.13 - April 18, 2024

Security

• Bump sqlparse to >=0.5.0, <0.6.0 to address GHSA-2m57-hf25-phgg (#9951)

Contributors

• @emmoop (#9951)

dbt-core v1.7.12

dbt-core 1.7.12 - April 16, 2024

Fixes

• Fix assorted source freshness edgecases so check is run or actionable information is given (#9078)
• Exclude password-like fields for considering reparse (#9795)

dbt-core v1.6.12

dbt-core 1.6.12 - April 16, 2024

Fixes

• Exclude password-like fields for considering reparse (#9795)

dbt-core v1.8.0b2

dbt-core 1.8.0-b2 - April 03, 2024

Features

• Global config for --target and --profile CLI flags and DBT_TARGET and DBT_PROFILE environment variables. (#7798)
• Allow excluding resource types for build, list, and clone commands, and provide env vars (#9237)
• SourceDefinition.meta represents source-level and table-level meta properties, instead of only table-level (#9766)
• Allow metrics in semantic layer filters. (#9804)

Fixes

• fix lock-file bad indentation (#9319)
• Tighten exception handling to avoid worker thread hangs. (#9583)
• Do not add duplicate input_measures (#9360)
• Throw a ParsingError if a primary key constraint is defined on multiple columns or at both the column and model level. (#9581)
• Bug fix: don't parse Jinja in filters for input metrics or measures. (#9582)
• Fix traceback parsing for exceptions raised due to csv fixtures moved into or out of fixture/subfolders. (#9570)
• Fix partial parsing KeyError on deleted schema files (#8860)
• Support saved queries in dbt list (#9532)
• include sources in catalog.json when over 100 relations selected for catalog generation (#9755)
• Support overriding macros in packages in unit testing (#9624)
• Handle exceptions for failing on-run-* hooks in source freshness (#9511)
• Validation of unit test parsing for incremental models (#9593)
• Fix use of retry command on command using defer (#9770)
• Make args variable to be un-modified by dbt.invoke(args) (#8938, #9787)
• Unit test path outputs (#9608)
• Fix assorted source freshness edgecases so check is run or actionable information is given (#9078)
• "Fix Docker release process to account for both historical and current versions of dbt-postgres (#9827)

Docs

• Add analytics for dbt.com (dbt-docs/#430)

Under the Hood

• Remove unused key wildcard from MethodName enum (#9641)
• Improve dbt CLI speed (#4627)
• Include node_info in various Result events (#9619)

Dependencies

• Bump actions/upload-artifact from 3 to 4 (#9470)
• Restrict protobuf to 4.* versions (#9566)
• Bump codecov/codecov-action from 3 to 4 (#9659)

Contributors

• @asweet (#9641)
• @b-per (#430)
• @barton996 (#7798)
• @courtneyholcomb (#9804, #9582)
• @dwreeves (#4627)
• @jx2lee (#9319)
• @slothkong (#9570)

dbt-core v1.7.11

dbt-core 1.7.11 - March 28, 2024

Fixes

• Tighten exception handling to avoid worker thread hangs. (#9583)
• Add field wrapper to BaseRelation members that were missing it. (#9681)

dbt-core v1.6.11

dbt-core 1.6.11 - March 28, 2024

Dependencies

• Restrict protobuf to 4.* versions (#9566)

dbt-core v1.5.11

dbt-core 1.5.11 - March 28, 2024

Dependencies

• Restrict protobuf to 4.* versions (#9566)

dbt-core v1.7.10

dbt-core 1.7.10 - March 14, 2024

Fixes

• Do not add duplicate input_measures (#9360)
• Fix partial parsing KeyError on deleted schema files (#8860)
• Support saved queries in dbt list (#9532)

Dependencies

• Restrict protobuf to 4.* versions (#9566)

dbt-core v1.8.0b1

dbt-core 1.8.0-b1 - February 28, 2024

Breaking Changes

• Remove adapter.get_compiler interface (#9148)
• Move AdapterLogger to adapters folder (#9151)
• Rm --dry-run flag from 'dbt deps --add-package', in favor of just 'dbt deps --lock' (#9100)
• move event manager setup back to core, remove ref to global EVENT_MANAGER and clean up event manager functions (#9150)
• Remove dbt-tests-adapter and dbt-postgres packages from dbt-core (#9455)

Features

• Initial implementation of unit testing (#8287)
• Unit test manifest artifacts and selection (#8295)
• Support config with tags & meta for unit tests (#8294)
• Allow adapters to include package logs in dbt standard logging (#7859)
• Enable inline csv fixtures in unit tests (#8626)
• Add drop_schema_named macro (#8025)
• migrate utils to common and adapters folders (#8924)
• Move Agate helper client into common (#8926)
• remove usage of dbt.config.PartialProject from dbt/adapters (#8928)
• Add exports to SavedQuery spec (#8892)
• Support unit testing incremental models (#8422)
• Add support of csv file fixtures to unit testing (#8290)
• Remove legacy logger (#8027)
• Unit tests support --defer and state:modified (#8517)
• Support setting export configs hierarchically via saved query and project configs (#8956)
• Support source inputs in unit tests (#8507)
• Use daff to render diff displayed in stdout when unit test fails (#8558)
• Move unit testing to test command (#8979)
• Support --empty flag for schema-only dry runs (#8971)
• Support unit tests in non-root packages (#8285)
• Convert the tests config to data_tests in both dbt_project.yml and schema files. in schema files. (#8699)
• Make fixture files full-fledged parts of the manifest and enable partial parsing (#9067)
• Adds support for parsing conversion metric related properties for the semantic layer. (#9203)
• In build command run unit tests before models (#9128)
• Move flags from UserConfig in profiles.yml to flags in dbt_project.yml (#9183)
• Added hook support for dbt source freshness (#5609)
• Align with order of unit test output when actual differs from expected (#9370)
• Added support for external nodes in unit test nodes (#8944)
• Enable unit testing versioned models (#9344)
• Enable list command for unit tests (#8508)
• Integration Test Optimizations (#9498)
• Accelerate integration tests with caching. (#9498)
• Cache environment variables (#9489)
• Support meta at the config level for Metric nodes (#9441)
• Add cache to SavedQuery config (#9540)

Fixes

• For packages installed with tarball method, fetch metadata to resolve nested dependencies (#8621)
• Fix partial parsing not working for semantic model change (#8859)
• Handle unknown type_code for model contracts (#8877, #8353)
• Rework get_catalog implementation to retain previous adapter interface semantics (#8846)
• Add back contract enforcement for temporary tables on postgres (#8857)
• Add version to fqn when version==0 (#8836)
• Fix cased comparison in catalog-retrieval function. (#8939)
• Catalog queries now assign the correct type to materialized views (#8864)
• Fix compilation exception running empty seed file and support new Integer agate data_type (#8895)
• Make relation filtering None-tolerant for maximal flexibility across adapters. (#8974)
• Update run_results.json from previous versions of dbt to support deferral and rerun from failure (#9010)
• Use MANIFEST.in to recursively include all jinja templates; fixes issue where some templates were not included in the distribution (#9016)
• Fix git repository with subdirectory for Deps (#9000)
• Use seed file from disk for unit testing if rows not specified in YAML config (#8652)
• Fix formatting of tarball information in packages-lock.yml (#9062)
• deps: Lock git packages to commit SHA during resolution (#9050)
• deps: Use PackageRenderer to read package-lock.json (#9127)
• Ensure we produce valid jsonschema schemas for manifest, catalog, run-results, and sources (#8991)
• Get sources working again in dbt docs generate (#9119)
• Fix parsing f-strings in python models (#6976)
• Preserve the value of vars and the --full-refresh flags when using retry. (#9112)
• Support reasonably long unit test names (#9015)
• Fix back-compat parsing for model-level 'tests', source table-level 'tests', and 'tests' defined on model versions (#9411)
• Fix retry command run from CLI (#9444)
• Fix seed and source selection in dbt docs generate (#9161)
• Add TestGenerateCatalogWithExternalNodes, include empty nodes in node selection during docs generate (#9456)
• Fix node type plurals in FoundStats log message (#9464)
• Run manifest upgrade preprocessing on any older manifest version, including v11 (#9487)
• Update 'compiled_code' context member logic to route based on command ('clone' or not). Reimplement 'sql' context member as wrapper of 'compiled_code'. (#9502)
• Fix bug where Semantic Layer filter strings are parsed into lists. (#9507)
• Initialize invocation context before test fixtures are built. (##9489)
• When patching versioned models, set constraints after config (#9364)
• only include unmodified semantic mdodels in state:modified selection (#9548)
• Set query headers when manifest is passed in to dbtRunner (#9546)
• Store node_info in node associated logging events (#9557)
• Fix Semantic Model Compare node relations (#9548)
• Clearer no-op logging in stubbed SavedQueryRunner (#9533)
• Fix node_info contextvar handling so incorrect node_info doesn't persist (#8866)
• Add target-path to retry (#8948)

Docs

• fix get_custom_database docstring (dbt-docs/#9003)

Under the Hood

• Added more type annotations. (#8537)
• Add unit testing functional tests ([#8512](https://github.com/dbt...

dbt-core v1.7.9

dbt-core 1.7.9 - February 28, 2024

Fixes

• Fix node_info contextvar handling so incorrect node_info doesn't persist (#8866)
• Add target-path to retry (#8948)

Under the Hood

• Make dbt-core compatible with Python 3.12 (#9007)
• Restrict protobuf to major version 4. (#9566)

Security

• Update Jinja2 to >= 3.1.3 to address CVE-2024-22195 (#CVE-2024-22195)

Contributors

• @l1xnan (#9007)