Go to file
2024-08-13 10:46:19 -06:00
.github restored old workflow because why not 2024-07-31 09:48:54 -06:00
analyses initial project 2022-09-07 09:40:56 -04:00
data every 95 2023-11-10 17:50:09 -05:00
docs unstake_events replacement with withdraw_events 2022-12-01 10:46:30 -05:00
macros updated incremental logic for reducing merge cost in temp view + added macro 2024-07-25 12:09:51 -06:00
models changed materialization strategy 2024-08-13 10:46:19 -06:00
snapshots initial project 2022-09-07 09:40:56 -04:00
tests tests update 2023-11-07 10:00:38 -05:00
.gitignore ignore dbt-env 2023-01-19 11:05:00 -08:00
dbt_project.yml dbtt proj 2023-12-05 12:28:42 -05:00
LICENSE Initial commit 2022-09-02 23:30:45 -04:00
package-lock.yml fix gha, bump fsc utils 2024-07-24 09:09:34 -04:00
packages.yml fix gha, bump fsc utils 2024-07-24 09:09:34 -04:00
profiles.yml github actions 2023-01-06 12:12:56 -05:00
README.md update readme for default tag update 2023-01-19 12:21:27 -08:00
requirements.txt gha tasks 2023-11-08 15:54:05 -05:00

Profile Set Up

Use the following within profiles.yml


thorchain:
  target: dev
  outputs:
    dev:
      type: snowflake
      account: <ACCOUNT>
      role: <ROLE>
      user: <USERNAME>
      password: <PASSWORD>
      region: <REGION>
      database: THORCHAIN_DEV
      warehouse: <WAREHOUSE>
      schema: silver
      threads: 4
      client_session_keep_alive: False
      query_tag: <TAG>

Resources:

  • Learn more about dbt in the docs
  • Check out Discourse for commonly asked questions and answers
  • Join the chat on Slack for live discussions and support
  • Find dbt events near you
  • Check out the blog for the latest news on dbt's development and best practices

Applying Model Tags

Database / Schema level tags

Database and schema tags are applied via the add_database_or_schema_tags macro. These tags are inherited by their downstream objects. To add/modify tags call the appropriate tag set function within the macro.

{{ set_database_tag_value('SOME_DATABASE_TAG_KEY','SOME_DATABASE_TAG_VALUE') }}
{{ set_schema_tag_value('SOME_SCHEMA_TAG_KEY','SOME_SCHEMA_TAG_VALUE') }}

Model tags

To add/update a model's snowflake tags, add/modify the meta model property under config. Only table level tags are supported at this time via DBT.

{{ config(
    ...,
    meta={
        'database_tags':{
            'table': {
                'PURPOSE': 'SOME_PURPOSE'
            }
        }
    },
    ...
) }}

By default, model tags are pushed to Snowflake on each DBT run. You can disable this by setting the UPDATE_SNOWFLAKE_TAGS project variable to False during a run.

dbt run --var '{"UPDATE_SNOWFLAKE_TAGS":False}' -s models/core/core__fact_swaps.sql

Querying for existing tags on a model in snowflake

select *
from table(thorchain.information_schema.tag_references('thorchain.core.fact_swaps', 'table'));