As part of our September Orchestrators 5-stable release, we are upgrading dbt to version 1.7 as the default across all our orchestrators. Additionally, MATE will now support dbt 1.8.

With dbt 1.7, the package Datavault-uk/dbtvault has been renamed to Datavault-UK/automate_dv. This name change is critical—if your project utilizes this package and it is not renamed appropriately, your pipelines will fail after the September Orchestrators 5-stable release scheduled for September 26th.

To prevent disruptions, if you're using Datavault-uk/dbtvault , please make sure the following changes are implemented before September 26th:

• Update any references from dbtvault to automate_dv.
• In variables.yml, set the DATAOPS_FEATURE_MATE_DBT_VERSION variable to 1.7. For more details, refer to the documentation here.

Test Your Projects:

You can test your projects with the switch to dbt 1.7 default by following the instructions provided below:

• For Projects Using dbt 1.7 or dbt 1.8:

  • No action required. Your projects will continue running on the selected dbt version without issues.

• For Projects Running Below dbt 1.7:

  • Create a Feature Branch - for each project, create a feature branch to isolate and safely test the update.

  • Add a New Variable - insert the following into pipelines/includes/config/variables.yml:DATAOPS_RUNNER_IMAGE_TAG: dbt1.7-default-in-orchestrators

  • Run a New Pipeline - execute a new pipeline run and check the MATE job logs to confirm that dbt is now running version 1.7.

  • Test and Validate - thoroughly test your project to ensure everything works as expected with dbt 1.7 and the updated package. Carefully review your models, tests, and pipeline behavior to identify any issues.

Please do not promote the changes from this feature branch to production, as that will change the Orchestrator image from 5-stable to dbt1.7-default-in-orchestrators.

If you have any questions or need assistance, please contact us at support@dataops.live . We're here to help!

Important Note:

We plan to remove support for dbt 1.4 across all our orchestrators in early 2025. To ensure uninterrupted support and prevent potential disruptions, we strongly encourage you to begin migrating your projects to dbt 1.7 or later, as this will soon become the default version. Early migration will help ensure your projects remain stable and compatible with future updates.