Go to file
Ryan-Loofy 3bfdba7ebf
Initial commit for Cosmos DBT Project (#1)
* Initial commit for Cosmos DBT Project

* Add gitignore

* Removed dbt packages

* Removed dbt logs

* Delete target

* Remove DS_Stores

* Delete ds_store
2022-11-09 09:19:00 -05:00
analysis Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00
data Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00
macros Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00
models Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00
snapshots Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00
tests Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00
.gitignore Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00
dbt_project.yml Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00
docker-compose.yml Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00
Dockerfile Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00
LICENSE Initial commit 2022-11-01 14:16:22 -04:00
Makefile Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00
packages.yml Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00
profiles.yml Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00
README.md Initial commit for Cosmos DBT Project (#1) 2022-11-09 09:19:00 -05:00

Profile Set Up

Use the following within profiles.yml


cosmos:
  target: dev
  outputs:
    dev:
      type: snowflake
      account: vna27887.us-east-1
      role: INTERNAL_DEV
      user: <USERNAME>
      password: <PASSWORD>
      region: us-east-1
      database: COSMOS_DEV
      warehouse: DBT_EMERGENCY
      schema: silver
      threads: 12
      client_session_keep_alive: False
      query_tag: <QUERY_TAG>
    prod:
      type: snowflake
      account: vna27887.us-east-1
      role: DBT_CLOUD_COSMOS
      user: <USERNAME>
      password: <PASSWORD>
      region: us-east-1
      database: COSMOS
      warehouse: DBT_EMERGENCY
      schema: silver
      threads: 12
      client_session_keep_alive: False
      query_tag: <QUERY_TAG>

Variables

To control which external table environment a model references, as well as, whether a Stream is invoked at runtime using control variables:

  • STREAMLINE_INVOKE_STREAMS When True, invokes streamline on model run as normal When False, NO-OP
  • STREAMLINE_USE_DEV_FOR_EXTERNAL_TABLES When True, uses DEV schema Streamline.Cosmos_DEV When False, uses PROD schema Streamline.Cosmos

Default values are False

  • Usage: dbt run --var '{"STREAMLINE_USE_DEV_FOR_EXTERNAL_TABLES":True, "STREAMLINE_INVOKE_STREAMS":True}' -m ...

Resources:

  • Learn more about dbt in the docs
  • Check out Discourse for commonly asked questions and answers
  • Join the chat on Slack for live discussions and support
  • Find dbt events near you
  • Check out the blog for the latest news on dbt's development and best practices