Go to file
Jack Forgash 30ce62f6a0
AN-4936/Backfill Migration Final (#335)
* del cw models

* core views

* defi views

* gov view

* nft_views

* rm ref to old cw models

* del internal cols

* nv 13-15

* nv 13-15

* nv 17-18

* nv 20

* del temp logic

* upd tests on allday metadata

* upd to warn
2024-07-01 13:27:42 -06:00
.github/workflows AN-4936/Backfill Migration Final (#335) 2024-07-01 13:27:42 -06:00
analysis initial setup files 2022-04-14 11:34:12 -07:00
data NFLAD Challenge - del dup wallets (#260) 2024-01-22 12:02:30 -07:00
macros use us-east-2 integration (#339) 2024-06-25 14:11:59 -06:00
models AN-4936/Backfill Migration Final (#335) 2024-07-01 13:27:42 -06:00
python new workflow/adhoc with alert (#334) 2024-06-20 10:40:48 -06:00
snapshots initial setup files 2022-04-14 11:34:12 -07:00
tests AN-4936/Backfill Migration Final (#335) 2024-07-01 13:27:42 -06:00
.env.sample quickfix to profile and .env.sample (#313) 2024-04-09 11:29:09 -06:00
.gitignore test (#114) 2023-04-07 13:24:50 -06:00
.user.yml An 2434/swap labels (#86) 2022-11-17 15:41:06 -05:00
dbt_project.yml AN-4936/Backfill Migration Final (#335) 2024-07-01 13:27:42 -06:00
docker-compose.yml add resources for community curation (#75) 2022-10-17 16:32:28 -07:00
Dockerfile add resources for community curation (#75) 2022-10-17 16:32:28 -07:00
LICENSE Initial commit 2022-04-14 11:08:03 -07:00
Makefile adding batch methods for chain and cronjob (#284) 2024-03-14 15:38:49 -06:00
package-lock.yml Stream 798/tx batch tuning (#280) 2024-03-04 13:33:25 -08:00
packages.yml Stream 798/tx batch tuning (#280) 2024-03-04 13:33:25 -08:00
profiles.yml quickfix to profile and .env.sample (#313) 2024-04-09 11:29:09 -06:00
README.md tags (#104) 2023-01-23 10:59:46 -07:00
requirements.txt add protobuf ver (#288) 2024-03-13 13:22:18 -06:00

Profile Set Up

Use the following within profiles.yml


flow:
  target: dev
  outputs:
    dev:
      type: snowflake
      account: <ACCOUNT>
      role: <ROLE>
      user: <USERNAME>
      password: <PASSWORD>
      region: <REGION>
      database: FLOW_DEV
      warehouse: <WAREHOUSE>
      schema: silver
      threads: 4
      client_session_keep_alive: False
      query_tag: <TAG>

Resources:

  • Learn more about dbt in the docs
  • Check out Discourse for commonly asked questions and answers
  • Join the chat on Slack for live discussions and support
  • Find dbt events near you
  • Check out the blog for the latest news on dbt's development and best practices

Applying Model Tags

Database / Schema level tags

Database and schema tags are applied via the add_database_or_schema_tags macro. These tags are inherited by their downstream objects. To add/modify tags call the appropriate tag set function within the macro.

{{ set_database_tag_value('SOME_DATABASE_TAG_KEY','SOME_DATABASE_TAG_VALUE') }}
{{ set_schema_tag_value('SOME_SCHEMA_TAG_KEY','SOME_SCHEMA_TAG_VALUE') }}

Model tags

To add/update a model's snowflake tags, add/modify the meta model property under config. Only table level tags are supported at this time via DBT.

{{ config(
    ...,
    meta={
        'database_tags':{
            'table': {
                'PURPOSE': 'SOME_PURPOSE'
            }
        }
    },
    ...
) }}

By default, model tags are pushed to Snowflake on each DBT run. You can disable this by setting the UPDATE_SNOWFLAKE_TAGS project variable to False during a run.

dbt run --var '{"UPDATE_SNOWFLAKE_TAGS":False}' -s models/core/core__ez_nft_sales.sql

Querying for existing tags on a model in snowflake

select *
from table(flow.information_schema.tag_references('flow.core.ez_nft_sales', 'table'));