Create an integrated DBT and Cloud Composer operations environment

Cloud Composer 3 | Cloud Composer 2 | Cloud Composer 1

This page describes how to use Terraform to create an integrated DBT and Cloud Composer operations environment.

About the terraform-google-dbt-composer-blueprint` module

The terraform-google-dbt-composer-blueprint module uses Terraform to do the following:

  • Applies required APIs and permissions in the project.
  • Creates documentation (for DBT) bucket.
  • Creates a Cloud Composer environment, including networking configuration, and a service account.
  • Copies across DAG utilities for Cloud Composer
  • Exports audit logs for the project into a BigQuery project, including two materialized views and a view on top to support dashboards.

In addition, the module provides an end-to-end example of using the DAG utilities and creating an example DBT job in Cloud Composer.

Module's code on GitHub

For more information and code samples, see terraform-google-dbt-composer-blueprint module page on GitHub.

What's next