Go to file
Jack Forgash 7475d0fb09
Merge pull request #72 from FlipsideCrypto/upd-fsc-utils
aurora/upd fsc utils to 1.23.0
2024-08-21 16:41:13 -06:00
.github/workflows upd target in gha profiles.yml 2024-08-21 16:40:12 -06:00
analyses Revert "Evm" 2023-05-23 15:48:06 -05:00
data schedule updates and split streamline job 2023-11-17 13:50:17 -05:00
docs initial 2023-04-25 09:37:49 -04:00
macros traces models 2023-12-19 16:43:25 -05:00
models fix docs ref 2024-05-01 13:48:15 -06:00
python_scripts/test_alert Update dbt_test_alert.py 2023-08-01 09:48:36 -06:00
snapshots initial 2023-04-25 09:37:49 -04:00
.gitignore init dbt profile for gha 2023-06-07 12:45:34 -06:00
dbt_project.yml profile 2024-01-26 13:27:56 +07:00
LICENSE Initial commit 2023-04-25 09:31:00 -04:00
package-lock.yml upd fsc utils to 1.23.0 2024-04-22 10:57:01 -06:00
packages.yml upd fsc utils to 1.23.0 2024-04-22 10:57:01 -06:00
profiles.yml other xyz references 2023-06-07 12:38:00 -06:00
README.md init setup 2023-06-07 12:17:41 -06:00
requirements.txt fix workflow and requ 2024-03-13 13:58:32 -06:00

Aurora Models

Profile Set Up

Use the following within profiles.yml


aurora:
  target: dev
  outputs:
    dev:
      type: snowflake
      account: <ACCOUNT>
      role: <ROLE>
      user: <USERNAME>
      password: <PASSWORD>
      region: <REGION>
      database: AURORA_DEV
      warehouse: <WAREHOUSE>
      schema: silver
      threads: 4
      client_session_keep_alive: False
      query_tag: <TAG>

Resources:

  • Learn more about dbt in the docs

  • Check out Discourse for commonly asked questions and answers

  • Join the chat on Slack for live discussions and support

  • Find dbt events near you

  • Check out the blog for the latest news on dbt's development and best practices

  • Check out the blog for the latest news on dbt's development and best practices

Applying Model Tags

Database / Schema level tags

Database and schema tags are applied via the add_database_or_schema_tags macro. These tags are inherited by their downstream objects. To add/modify tags call the appropriate tag set function within the macro.

{{ set_database_tag_value('SOME_DATABASE_TAG_KEY','SOME_DATABASE_TAG_VALUE') }}
{{ set_schema_tag_value('SOME_SCHEMA_TAG_KEY','SOME_SCHEMA_TAG_VALUE') }}

Model tags

To add/update a model's snowflake tags, add/modify the meta model property under config. Only table level tags are supported at this time via DBT.

{{ config(
    ...,
    meta={
        'database_tags':{
            'table': {
                'PURPOSE': 'SOME_PURPOSE'
            }
        }
    },
    ...
) }}

By default, model tags are not pushed to snowflake on each load. You can push a tag update for a model by specifying the UPDATE_SNOWFLAKE_TAGS project variable during a run.

dbt run --var '{"UPDATE_SNOWFLAKE_TAGS":True}' -s models/core/core__fact_swaps.sql

Querying for existing tags on a model in snowflake

select *
from table(auruora.information_schema.tag_references('aurora.core.fact_blocks', 'table'));