Skip to content

Conversation

fsalemi
Copy link
Contributor

@fsalemi fsalemi commented Sep 9, 2025

Description

Adding analysis_name to the stg, int, mart dim_gtfs_datasets.

This is a part of #4161

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation

How has this been tested?

jovyan@jupyter-fsalemi:~/data-infra/warehouse$ poetry run dbt run -s +dim_gtfs_datasets
18:43:41  Running with dbt=1.5.1
18:43:48  Found 621 models, 1238 tests, 0 snapshots, 0 analyses, 855 macros, 0 operations, 14 seed files, 224 sources, 4 exposures, 0 metrics, 0 groups
18:43:48  
18:44:04  Concurrency: 8 threads (target='dev')
18:44:04  
18:44:04  1 of 3 START sql view model farhad_staging.stg_transit_database__gtfs_datasets . [RUN]
18:44:05  1 of 3 OK created sql view model farhad_staging.stg_transit_database__gtfs_datasets  [CREATE VIEW (0 processed) in 1.45s]
18:44:05  2 of 3 START sql table model farhad_staging.int_transit_database__gtfs_datasets_dim  [RUN]
18:44:10  2 of 3 OK created sql table model farhad_staging.int_transit_database__gtfs_datasets_dim  [CREATE TABLE (5.4k rows, 7.6 GiB processed) in 4.89s]
18:44:10  3 of 3 START sql table model farhad_mart_transit_database.dim_gtfs_datasets .... [RUN]
18:44:13  3 of 3 OK created sql table model farhad_mart_transit_database.dim_gtfs_datasets  [CREATE TABLE (5.4k rows, 1.7 MiB processed) in 2.46s]
18:44:13  
18:44:13  Finished running 1 view model, 2 table models in 0 hours 0 minutes and 24.89 seconds (24.89s).
18:44:13  
18:44:13  Completed successfully
18:44:13  
18:44:13  Done. PASS=3 WARN=0 ERROR=0 SKIP=0 TOTAL=3

Post-merge follow-ups

  • No action required
  • Actions required (specified below)

Copy link

github-actions bot commented Sep 9, 2025

Terraform plan in iac/cal-itp-data-infra/airflow/us

Plan: 0 to add, 4 to change, 0 to destroy.
Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
!~  update in-place

Terraform will perform the following actions:

  # google_storage_bucket_object.calitp-composer-dags["models/intermediate/transit_database/dimensions/int_transit_database__gtfs_datasets_dim.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "4f1s3w==" -> (known after apply)
!~      detect_md5hash      = "IGkuSAy/G11WON5BKC761Q==" -> "different hash"
!~      generation          = 1751416667226953 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/intermediate/transit_database/dimensions/int_transit_database__gtfs_datasets_dim.sql"
!~      md5hash             = "IGkuSAy/G11WON5BKC761Q==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/transit_database/dimensions/int_transit_database__gtfs_datasets_dim.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/mart/transit_database/_mart_transit_database.yml"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "b8nOEw==" -> (known after apply)
!~      detect_md5hash      = "6xSVbYLmRIFEpaQwPKZw7w==" -> "different hash"
!~      generation          = 1752703532539764 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/mart/transit_database/_mart_transit_database.yml"
!~      md5hash             = "6xSVbYLmRIFEpaQwPKZw7w==" -> (known after apply)
        name                = "data/warehouse/models/mart/transit_database/_mart_transit_database.yml"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/mart/transit_database/dim_gtfs_datasets.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "iZj0CQ==" -> (known after apply)
!~      detect_md5hash      = "UCjs69xwq3UGgsaOM8eKTg==" -> "different hash"
!~      generation          = 1751416668944705 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/mart/transit_database/dim_gtfs_datasets.sql"
!~      md5hash             = "UCjs69xwq3UGgsaOM8eKTg==" -> (known after apply)
        name                = "data/warehouse/models/mart/transit_database/dim_gtfs_datasets.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/staging/transit_database/stg_transit_database__gtfs_datasets.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "kuuaEQ==" -> (known after apply)
!~      detect_md5hash      = "tPp55852vH6MEWCf4KHKHA==" -> "different hash"
!~      generation          = 1751416669798677 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/staging/transit_database/stg_transit_database__gtfs_datasets.sql"
!~      md5hash             = "tPp55852vH6MEWCf4KHKHA==" -> (known after apply)
        name                = "data/warehouse/models/staging/transit_database/stg_transit_database__gtfs_datasets.sql"
#        (17 unchanged attributes hidden)
    }

Plan: 0 to add, 4 to change, 0 to destroy.

📝 Plan generated in Plan Terraform for Warehouse and DAG changes #588

Copy link

github-actions bot commented Sep 9, 2025

Terraform plan in iac/cal-itp-data-infra-staging/airflow/us

Plan: 0 to add, 4 to change, 0 to destroy.
Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
!~  update in-place

Terraform will perform the following actions:

  # google_storage_bucket_object.calitp-staging-composer-dags["models/intermediate/transit_database/dimensions/int_transit_database__gtfs_datasets_dim.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "4f1s3w==" -> (known after apply)
!~      detect_md5hash      = "IGkuSAy/G11WON5BKC761Q==" -> "different hash"
!~      generation          = 1749663114080976 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/intermediate/transit_database/dimensions/int_transit_database__gtfs_datasets_dim.sql"
!~      md5hash             = "IGkuSAy/G11WON5BKC761Q==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/transit_database/dimensions/int_transit_database__gtfs_datasets_dim.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/mart/transit_database/_mart_transit_database.yml"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "b8nOEw==" -> (known after apply)
!~      detect_md5hash      = "6xSVbYLmRIFEpaQwPKZw7w==" -> "different hash"
!~      generation          = 1752627599326367 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/mart/transit_database/_mart_transit_database.yml"
!~      md5hash             = "6xSVbYLmRIFEpaQwPKZw7w==" -> (known after apply)
        name                = "data/warehouse/models/mart/transit_database/_mart_transit_database.yml"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/mart/transit_database/dim_gtfs_datasets.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "iZj0CQ==" -> (known after apply)
!~      detect_md5hash      = "UCjs69xwq3UGgsaOM8eKTg==" -> "different hash"
!~      generation          = 1749663112718886 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/mart/transit_database/dim_gtfs_datasets.sql"
!~      md5hash             = "UCjs69xwq3UGgsaOM8eKTg==" -> (known after apply)
        name                = "data/warehouse/models/mart/transit_database/dim_gtfs_datasets.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/staging/transit_database/stg_transit_database__gtfs_datasets.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "kuuaEQ==" -> (known after apply)
!~      detect_md5hash      = "tPp55852vH6MEWCf4KHKHA==" -> "different hash"
!~      generation          = 1749663116130730 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/staging/transit_database/stg_transit_database__gtfs_datasets.sql"
!~      md5hash             = "tPp55852vH6MEWCf4KHKHA==" -> (known after apply)
        name                = "data/warehouse/models/staging/transit_database/stg_transit_database__gtfs_datasets.sql"
#        (17 unchanged attributes hidden)
    }

Plan: 0 to add, 4 to change, 0 to destroy.

📝 Plan generated in Plan Terraform for Warehouse and DAG changes #588

@fsalemi fsalemi merged commit ed3d862 into main Sep 10, 2025
16 checks passed
@fsalemi fsalemi deleted the analysis_name branch September 10, 2025 19:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants