Commit Graph

364 Commits

Author SHA1 Message Date
Jack Forgash
4df472bace
AN-5459/point transfers api integration (#378)
* point transfers api integration

* upd 2 silver models

* gha workflow with auth

* upd gha workflow

* add gha on push config for testing

* add print step

* chg echo

* upd auth.py

* rm run on commit from gha

* upd model tags

* merge 2 silver into 1, add yml, upd gha

* upd auth return vals

* add exit 1 on failure

* upd return on success True

* add gha on-run config for final test

* add backup default to env_var(JWT)

* add backup default to env_var(JWT) - 2

* rm run on commit from gha and upd sql limit for balance call

* add yml for evm address model

* add evm address threshold test

* upd gha workflow

* upd per CRs
2024-11-15 09:43:52 -07:00
Jack Forgash
7edd60669c
AN-5418/Flow x EVM address mapping (#377)
* address mapping

* gold

* upd comment, recency threshold, kill distinct
2024-11-11 12:50:01 -07:00
Jack Forgash
bf0f515937
rm line (#375) 2024-11-04 13:32:19 -07:00
Jack Forgash
6ed4afda47
incr strategy to delete+insert (#374) 2024-11-04 12:27:29 -07:00
Jack Forgash
f6c0455ec2
upd schedule (#373) 2024-10-30 11:35:34 -06:00
Jack Forgash
f1c0a24186
upd native token address (#372) 2024-10-29 10:22:35 -06:00
eric-laurello
9b15a87c5b
latency at 2 hours (#371) 2024-10-18 12:38:41 -04:00
eric-laurello
b0b91770c1
add 3 hour delay (#370) 2024-10-17 15:50:54 -04:00
Jack Forgash
ea33fe6134
add slack webhook url (#369) 2024-10-11 14:31:39 -06:00
Jack Forgash
64a009f0ab
AN-5252/points api integration (#368)
* basic query

* external points api request

* rn REWARD_POINTS and add supplementary models

* upd vault

* add gha workflows

* add headers incl user-agent

* upd header

* rm content type header

* addback secret

* use target

* rn _realtime

* upd silver and add FR view
2024-10-11 14:16:25 -06:00
Jack Forgash
da6606c12f
Update core__ez_token_transfers.yml (#367) 2024-10-10 12:12:14 -06:00
eric-laurello
e77d61f3cc
better gap logic (#366)
fix dupes in tx
rm duplicate unique test
2024-10-09 08:21:16 -04:00
Jack Forgash
96755a007d
AN-5236/new transfers model (#364)
* new transfers models - still a few edge cases

* fix 1 withdrawal 2 deposited edge case

* upd filter in legacy model

* core union all and view -> incremental

* rm silver so
2024-09-19 13:31:36 -06:00
Jack Forgash
24a7caf384
fix receipts model (#363) 2024-09-16 11:08:37 -06:00
Jack Forgash
2988813d42
upd tag to non-core (#362) 2024-09-13 13:21:24 -06:00
Jack Forgash
9a7151bfc1
AN-5209/Upd staking model (#358)
* Upd staking model

* drop _s suffix

* rm event_data col

* upd desc
2024-09-13 11:07:37 -06:00
Jack Forgash
ccf595e199
AN-5100/tx actors model (#361)
* tx actors model

* upd silver

* gold ez tbl

* segment out actors from tx-level participants

* Add alias

* add rn to de-duplicate join in ez

* add incremental_predicates

* final add mod ts cluster, tx_succeeded
2024-09-13 09:40:45 -06:00
Jack Forgash
14d52208aa
rm deprecated views (#359) 2024-09-11 09:09:52 -06:00
Jack Forgash
894a940c4e
rename dbt_run_evm run-name (#360) 2024-09-10 21:41:58 -06:00
Jack Forgash
08f0bce6b4
rn block_hash to hash (#357)
* rn block_hash to hash

* upd block gap test

* unrename gap test col
2024-09-10 10:26:32 -06:00
Jack Forgash
70d0393cfa
AN-5196 coreevm final (#356)
* an-5198-upd-block-gap-test

* evm block gap test

* evm gaps tests

* blocks and txs tests

* logs tests

* add evm gap test to daily test gha

* run evm job in separate gha workflow
2024-09-09 12:02:03 -06:00
Jack Forgash
610f0174fd
swaps final merge strat d+i (#355) 2024-09-07 10:57:24 -04:00
Jack Forgash
d113f4164a
fix typo instert (#354) 2024-09-06 11:56:00 -04:00
Jack Forgash
2dccd4f5ef
Upd Package Lock, fix core_evm incr (#353)
* fix core_evm

* package lock
2024-09-06 11:50:30 -04:00
Jack Forgash
8f45448a66 upd fsc utils 2024-09-06 11:43:42 -04:00
Jack Forgash
88df737fa2
AN-5203/Deploy flowEVM (#343)
* flow evm init

* flow evm testnet - blocks

* deploy dev udfs, update typo

* send block height as hex

* dev limit

* use stg external table

* some links

* add query to side doc

* upd external tbl to stg & testnet

* silver and evm txs

* testnet silver models pt1

* testnet events final, decode hash udf

* udf get evm chainhead

* upd resource list

* new udf. receipts pipeline. upd testnet model cols. expand readme

* receipts silver

* traces

* vault

* reorg to evm dir

* rm testnet, blocks lookback

* lookbacks, move qualify

* macro and align naming

* del testnet, reset namespace to gen

* silver_evm - receipts and txs

* core_evm fact_blocks & fact_transactions

* fix vault path in get blocks. Logs v1 (need sample)

* core_evm fact_logs

* CR updates

* del readme and add workflow

* upd vault path, batch size

* incr logic on modified to core_evm

* use local utils.udf, add blockNumber col to complete blocks check

* rm col

* correct _invocation_id

* upd nv csv

* incr batch limit due to late start

* add evm tag to model run
2024-09-05 20:43:33 -06:00
Jack Forgash
e37db5668f
d+i (#352) 2024-09-04 18:45:33 -06:00
Shah Newaz Khan
1a3ea2c2fc
fix gha workflow env (#350)
* fix gha workflow env

* add dbt_profiles_dir

* bump fsc-utils to 1.30.0 & add tag_integration_test

* add resource path selector to gha dbt command

* revert to fsc-utils package 1.17.2

* add selectors.yml

* add reusable dbt run workflow

* test python 3.8

* pass in python version

* add reusable workflow template and uses python_version

* remove inline dbt.yml in favor of reusable template

* change to dbt.yml reusable workflow

* fix input command and remove python version

* remove external browser authenticator

* fix profiles in ./

* add password envar

* clean up dbt_run_integration_test gha
2024-08-27 18:55:29 -07:00
Jack Forgash
02a587c10d
uncomment query-comment (#351) 2024-08-21 16:22:29 -06:00
Shah Newaz Khan
bb864a8e87
Livequery integration test gha (#349)
* add dbt.yml and integration test gha's

* update dbt selector to run all integration tests in lq package

* remove fail fast strategy
2024-08-14 09:35:41 -07:00
Jack Forgash
eb3247ca26
last _adj (#348) 2024-08-01 10:25:11 -06:00
Jack Forgash
433e62a63c
AN-4553/deploy new defi gold views (#345)
* bridge complete model

* depr notice on ez. Tests on fact bridge. TODOs - naming convention for amount and use chain IDs??

* ez and fact bridging

* dex swaps

* fix id col name. add platform to dex

* rm adj
2024-08-01 10:22:24 -06:00
Jack Forgash
a600e38457
upd dim metadata tests (#347) 2024-07-31 11:41:57 -06:00
Jack Forgash
3e471404e5
AN-5069/expand onchain metadata mapping (#346) 2024-07-31 08:24:25 -06:00
Jack Forgash
51607b2222
add tag back (#344) 2024-07-26 13:49:04 -06:00
eric-laurello
61c60b99c1
recorded_hour (#342) 2024-07-15 14:33:45 -04:00
eric-laurello
f6b98de014
so & clsutering (#341) 2024-07-15 09:28:47 -06:00
Jack Forgash
30ce62f6a0
AN-4936/Backfill Migration Final (#335)
* del cw models

* core views

* defi views

* gov view

* nft_views

* rm ref to old cw models

* del internal cols

* nv 13-15

* nv 13-15

* nv 17-18

* nv 20

* del temp logic

* upd tests on allday metadata

* upd to warn
2024-07-01 13:27:42 -06:00
Jack Forgash
3bf75dfd18
fix typo (#340) 2024-06-25 15:01:38 -06:00
Jack Forgash
e27aa3b83b
use us-east-2 integration (#339) 2024-06-25 14:11:59 -06:00
Jack Forgash
965d037877
upd aws_flow_api_dev_2 (#338)
* upd aws_flow_api_dev_2

* update everywhere
2024-06-25 12:45:19 -06:00
Jack Forgash
9127e6de86
AN-4852/Testnet Integration (#326)
* source, bronze, complete, rt views

* complete testnet_ dependency

* upd sources.yml

* upd models and bronze

* upd models.sql

* upd model in bronze views

* adding chainhead_testnet

* add jobs

* fix: hour

* upd api integration

* various fixes. useast2, gha workflows, bad refs, etc

* update udtf_get_base_table

---------

Co-authored-by: WHYTEWYLL <juanmiblanco1@gmail.com>
2024-06-25 12:12:51 -06:00
Shah Newaz Khan
fd840c2c3e
add flow evm v2 udfs (#337) 2024-06-25 07:49:43 -07:00
Jack Forgash
e41b0411f0
adj schedule and rename non core workflow group (#336) 2024-06-20 14:02:35 -06:00
Jack Forgash
64a996b2c7
new workflow/adhoc with alert (#334)
* new workflow

* print run status

* add workflow dispatch for testing

* add temp default for inputs

* add temp default for inputs in steps

* modify echo status after run

* add outcome

* print data

* pull echo into separate step

* define dbt_run_status

* run again

* try intentional failed dbt command

* add emoji to status

* fix single quote

* pass data directly

* del testing defaults

* del unused imports
2024-06-20 10:40:48 -06:00
Jack Forgash
12bf4e2e86
AN-4799/Backfill Migration (#329)
* move models to bronze

* blocks backfill logic ez ez ez

* streamline_load models for all 4 methods

* add back a set of views for the complete models to use

* del dbt run history gha workflow

* migrate txs final to modified ts

* upd events to modified

* set default val for LOAD_BACKFILL_VERSION in project yml

* update curated model incr logic
2024-06-12 12:10:27 -06:00
Jack Forgash
f3e6d0bfab
del deprecating price models (#332) 2024-06-12 12:02:08 -06:00
Jack Forgash
ffcb6d1492
add args to core fact_transactions (#331) 2024-06-06 22:34:28 -06:00
Jack Forgash
5ecb01870e
add script field to fact transactions (#330)
* add script field

* add to yml
2024-06-06 21:20:42 -06:00
WHYTEWYLL
f9e451debd
stats authorizer replacement (#328) 2024-06-04 17:43:30 -06:00