Commit Graph

352 Commits

Author SHA1 Message Date
shah
1960f5b276 add _utils to integration_test selector 2025-01-27 15:21:26 -08:00
Jack Forgash
24a7caf384
fix receipts model (#363) 2024-09-16 11:08:37 -06:00
Jack Forgash
2988813d42
upd tag to non-core (#362) 2024-09-13 13:21:24 -06:00
Jack Forgash
9a7151bfc1
AN-5209/Upd staking model (#358)
* Upd staking model

* drop _s suffix

* rm event_data col

* upd desc
2024-09-13 11:07:37 -06:00
Jack Forgash
ccf595e199
AN-5100/tx actors model (#361)
* tx actors model

* upd silver

* gold ez tbl

* segment out actors from tx-level participants

* Add alias

* add rn to de-duplicate join in ez

* add incremental_predicates

* final add mod ts cluster, tx_succeeded
2024-09-13 09:40:45 -06:00
Jack Forgash
14d52208aa
rm deprecated views (#359) 2024-09-11 09:09:52 -06:00
Jack Forgash
894a940c4e
rename dbt_run_evm run-name (#360) 2024-09-10 21:41:58 -06:00
Jack Forgash
08f0bce6b4
rn block_hash to hash (#357)
* rn block_hash to hash

* upd block gap test

* unrename gap test col
2024-09-10 10:26:32 -06:00
Jack Forgash
70d0393cfa
AN-5196 coreevm final (#356)
* an-5198-upd-block-gap-test

* evm block gap test

* evm gaps tests

* blocks and txs tests

* logs tests

* add evm gap test to daily test gha

* run evm job in separate gha workflow
2024-09-09 12:02:03 -06:00
Jack Forgash
610f0174fd
swaps final merge strat d+i (#355) 2024-09-07 10:57:24 -04:00
Jack Forgash
d113f4164a
fix typo instert (#354) 2024-09-06 11:56:00 -04:00
Jack Forgash
2dccd4f5ef
Upd Package Lock, fix core_evm incr (#353)
* fix core_evm

* package lock
2024-09-06 11:50:30 -04:00
Jack Forgash
8f45448a66 upd fsc utils 2024-09-06 11:43:42 -04:00
Jack Forgash
88df737fa2
AN-5203/Deploy flowEVM (#343)
* flow evm init

* flow evm testnet - blocks

* deploy dev udfs, update typo

* send block height as hex

* dev limit

* use stg external table

* some links

* add query to side doc

* upd external tbl to stg & testnet

* silver and evm txs

* testnet silver models pt1

* testnet events final, decode hash udf

* udf get evm chainhead

* upd resource list

* new udf. receipts pipeline. upd testnet model cols. expand readme

* receipts silver

* traces

* vault

* reorg to evm dir

* rm testnet, blocks lookback

* lookbacks, move qualify

* macro and align naming

* del testnet, reset namespace to gen

* silver_evm - receipts and txs

* core_evm fact_blocks & fact_transactions

* fix vault path in get blocks. Logs v1 (need sample)

* core_evm fact_logs

* CR updates

* del readme and add workflow

* upd vault path, batch size

* incr logic on modified to core_evm

* use local utils.udf, add blockNumber col to complete blocks check

* rm col

* correct _invocation_id

* upd nv csv

* incr batch limit due to late start

* add evm tag to model run
2024-09-05 20:43:33 -06:00
Jack Forgash
e37db5668f
d+i (#352) 2024-09-04 18:45:33 -06:00
Shah Newaz Khan
1a3ea2c2fc
fix gha workflow env (#350)
* fix gha workflow env

* add dbt_profiles_dir

* bump fsc-utils to 1.30.0 & add tag_integration_test

* add resource path selector to gha dbt command

* revert to fsc-utils package 1.17.2

* add selectors.yml

* add reusable dbt run workflow

* test python 3.8

* pass in python version

* add reusable workflow template and uses python_version

* remove inline dbt.yml in favor of reusable template

* change to dbt.yml reusable workflow

* fix input command and remove python version

* remove external browser authenticator

* fix profiles in ./

* add password envar

* clean up dbt_run_integration_test gha
2024-08-27 18:55:29 -07:00
Jack Forgash
02a587c10d
uncomment query-comment (#351) 2024-08-21 16:22:29 -06:00
Shah Newaz Khan
bb864a8e87
Livequery integration test gha (#349)
* add dbt.yml and integration test gha's

* update dbt selector to run all integration tests in lq package

* remove fail fast strategy
2024-08-14 09:35:41 -07:00
Jack Forgash
eb3247ca26
last _adj (#348) 2024-08-01 10:25:11 -06:00
Jack Forgash
433e62a63c
AN-4553/deploy new defi gold views (#345)
* bridge complete model

* depr notice on ez. Tests on fact bridge. TODOs - naming convention for amount and use chain IDs??

* ez and fact bridging

* dex swaps

* fix id col name. add platform to dex

* rm adj
2024-08-01 10:22:24 -06:00
Jack Forgash
a600e38457
upd dim metadata tests (#347) 2024-07-31 11:41:57 -06:00
Jack Forgash
3e471404e5
AN-5069/expand onchain metadata mapping (#346) 2024-07-31 08:24:25 -06:00
Jack Forgash
51607b2222
add tag back (#344) 2024-07-26 13:49:04 -06:00
eric-laurello
61c60b99c1
recorded_hour (#342) 2024-07-15 14:33:45 -04:00
eric-laurello
f6b98de014
so & clsutering (#341) 2024-07-15 09:28:47 -06:00
Jack Forgash
30ce62f6a0
AN-4936/Backfill Migration Final (#335)
* del cw models

* core views

* defi views

* gov view

* nft_views

* rm ref to old cw models

* del internal cols

* nv 13-15

* nv 13-15

* nv 17-18

* nv 20

* del temp logic

* upd tests on allday metadata

* upd to warn
2024-07-01 13:27:42 -06:00
Jack Forgash
3bf75dfd18
fix typo (#340) 2024-06-25 15:01:38 -06:00
Jack Forgash
e27aa3b83b
use us-east-2 integration (#339) 2024-06-25 14:11:59 -06:00
Jack Forgash
965d037877
upd aws_flow_api_dev_2 (#338)
* upd aws_flow_api_dev_2

* update everywhere
2024-06-25 12:45:19 -06:00
Jack Forgash
9127e6de86
AN-4852/Testnet Integration (#326)
* source, bronze, complete, rt views

* complete testnet_ dependency

* upd sources.yml

* upd models and bronze

* upd models.sql

* upd model in bronze views

* adding chainhead_testnet

* add jobs

* fix: hour

* upd api integration

* various fixes. useast2, gha workflows, bad refs, etc

* update udtf_get_base_table

---------

Co-authored-by: WHYTEWYLL <juanmiblanco1@gmail.com>
2024-06-25 12:12:51 -06:00
Shah Newaz Khan
fd840c2c3e
add flow evm v2 udfs (#337) 2024-06-25 07:49:43 -07:00
Jack Forgash
e41b0411f0
adj schedule and rename non core workflow group (#336) 2024-06-20 14:02:35 -06:00
Jack Forgash
64a996b2c7
new workflow/adhoc with alert (#334)
* new workflow

* print run status

* add workflow dispatch for testing

* add temp default for inputs

* add temp default for inputs in steps

* modify echo status after run

* add outcome

* print data

* pull echo into separate step

* define dbt_run_status

* run again

* try intentional failed dbt command

* add emoji to status

* fix single quote

* pass data directly

* del testing defaults

* del unused imports
2024-06-20 10:40:48 -06:00
Jack Forgash
12bf4e2e86
AN-4799/Backfill Migration (#329)
* move models to bronze

* blocks backfill logic ez ez ez

* streamline_load models for all 4 methods

* add back a set of views for the complete models to use

* del dbt run history gha workflow

* migrate txs final to modified ts

* upd events to modified

* set default val for LOAD_BACKFILL_VERSION in project yml

* update curated model incr logic
2024-06-12 12:10:27 -06:00
Jack Forgash
f3e6d0bfab
del deprecating price models (#332) 2024-06-12 12:02:08 -06:00
Jack Forgash
ffcb6d1492
add args to core fact_transactions (#331) 2024-06-06 22:34:28 -06:00
Jack Forgash
5ecb01870e
add script field to fact transactions (#330)
* add script field

* add to yml
2024-06-06 21:20:42 -06:00
WHYTEWYLL
f9e451debd
stats authorizer replacement (#328) 2024-06-04 17:43:30 -06:00
Jack Forgash
cd3e24bb92
rm 14 and 15 (#327) 2024-05-24 09:35:44 -06:00
Jack Forgash
0b10065d52
incr batches (#325) 2024-05-23 14:55:23 -06:00
Jack Forgash
48c08901b1
fix 18 (#324) 2024-05-23 12:43:06 -06:00
Jack Forgash
cc51f4bcca
add 14-16 back for last few (#323) 2024-05-23 11:30:34 -06:00
Jack Forgash
40ef79f4fc
flip to non-batch method (#322) 2024-05-23 11:17:51 -06:00
Jack Forgash
6e288d5661
del 14-16 (#320) 2024-05-06 13:15:08 -06:00
WHYTEWYLL
f9be7412e6
qualify (#319)
* qualify

* data value

* moving it to flatten event

---------

Co-authored-by: forgash_ <jmfxyz@pm.me>
2024-05-06 09:22:53 -07:00
WHYTEWYLL
a0e441d668
deprecation and new view (#318)
* deprecation and new view

* reorg

* is_deprecated

* deprecated

* upd dbt model tag

---------

Co-authored-by: forgash_ <jmfxyz@pm.me>
2024-05-01 13:49:33 -06:00
WHYTEWYLL
2d85fe3e92
reducing batch size (#282) 2024-05-01 10:58:23 -07:00
Jack Forgash
c2353ab0f3
rm transactions history - complete (#316) 2024-04-24 09:55:20 -06:00
Jack Forgash
894788f9b8
AA-4660 / dex swaps upd (#314)
* new swap model

* comment todos

* swaps aggregator model

* swap aggregator parsing

* upd requested fixes

* add date coalesce to ez view

* swaps agg yml

* platform doc
2024-04-22 09:59:21 -06:00
Jack Forgash
8212f29562
quickfix to profile and .env.sample (#313)
* quickfix to profile and .env.sample

* revert dbt_project.yml
2024-04-09 11:29:09 -06:00