Commit Graph

249 Commits

Author SHA1 Message Date
Jack Forgash
4df472bace
AN-5459/point transfers api integration (#378)
* point transfers api integration

* upd 2 silver models

* gha workflow with auth

* upd gha workflow

* add gha on push config for testing

* add print step

* chg echo

* upd auth.py

* rm run on commit from gha

* upd model tags

* merge 2 silver into 1, add yml, upd gha

* upd auth return vals

* add exit 1 on failure

* upd return on success True

* add gha on-run config for final test

* add backup default to env_var(JWT)

* add backup default to env_var(JWT) - 2

* rm run on commit from gha and upd sql limit for balance call

* add yml for evm address model

* add evm address threshold test

* upd gha workflow

* upd per CRs
2024-11-15 09:43:52 -07:00
Jack Forgash
7edd60669c
AN-5418/Flow x EVM address mapping (#377)
* address mapping

* gold

* upd comment, recency threshold, kill distinct
2024-11-11 12:50:01 -07:00
Jack Forgash
bf0f515937
rm line (#375) 2024-11-04 13:32:19 -07:00
Jack Forgash
6ed4afda47
incr strategy to delete+insert (#374) 2024-11-04 12:27:29 -07:00
Jack Forgash
f1c0a24186
upd native token address (#372) 2024-10-29 10:22:35 -06:00
eric-laurello
9b15a87c5b
latency at 2 hours (#371) 2024-10-18 12:38:41 -04:00
Jack Forgash
64a009f0ab
AN-5252/points api integration (#368)
* basic query

* external points api request

* rn REWARD_POINTS and add supplementary models

* upd vault

* add gha workflows

* add headers incl user-agent

* upd header

* rm content type header

* addback secret

* use target

* rn _realtime

* upd silver and add FR view
2024-10-11 14:16:25 -06:00
Jack Forgash
da6606c12f
Update core__ez_token_transfers.yml (#367) 2024-10-10 12:12:14 -06:00
eric-laurello
e77d61f3cc
better gap logic (#366)
fix dupes in tx
rm duplicate unique test
2024-10-09 08:21:16 -04:00
Jack Forgash
96755a007d
AN-5236/new transfers model (#364)
* new transfers models - still a few edge cases

* fix 1 withdrawal 2 deposited edge case

* upd filter in legacy model

* core union all and view -> incremental

* rm silver so
2024-09-19 13:31:36 -06:00
Jack Forgash
24a7caf384
fix receipts model (#363) 2024-09-16 11:08:37 -06:00
Jack Forgash
2988813d42
upd tag to non-core (#362) 2024-09-13 13:21:24 -06:00
Jack Forgash
9a7151bfc1
AN-5209/Upd staking model (#358)
* Upd staking model

* drop _s suffix

* rm event_data col

* upd desc
2024-09-13 11:07:37 -06:00
Jack Forgash
ccf595e199
AN-5100/tx actors model (#361)
* tx actors model

* upd silver

* gold ez tbl

* segment out actors from tx-level participants

* Add alias

* add rn to de-duplicate join in ez

* add incremental_predicates

* final add mod ts cluster, tx_succeeded
2024-09-13 09:40:45 -06:00
Jack Forgash
14d52208aa
rm deprecated views (#359) 2024-09-11 09:09:52 -06:00
Jack Forgash
08f0bce6b4
rn block_hash to hash (#357)
* rn block_hash to hash

* upd block gap test

* unrename gap test col
2024-09-10 10:26:32 -06:00
Jack Forgash
70d0393cfa
AN-5196 coreevm final (#356)
* an-5198-upd-block-gap-test

* evm block gap test

* evm gaps tests

* blocks and txs tests

* logs tests

* add evm gap test to daily test gha

* run evm job in separate gha workflow
2024-09-09 12:02:03 -06:00
Jack Forgash
610f0174fd
swaps final merge strat d+i (#355) 2024-09-07 10:57:24 -04:00
Jack Forgash
d113f4164a
fix typo instert (#354) 2024-09-06 11:56:00 -04:00
Jack Forgash
2dccd4f5ef
Upd Package Lock, fix core_evm incr (#353)
* fix core_evm

* package lock
2024-09-06 11:50:30 -04:00
Jack Forgash
88df737fa2
AN-5203/Deploy flowEVM (#343)
* flow evm init

* flow evm testnet - blocks

* deploy dev udfs, update typo

* send block height as hex

* dev limit

* use stg external table

* some links

* add query to side doc

* upd external tbl to stg & testnet

* silver and evm txs

* testnet silver models pt1

* testnet events final, decode hash udf

* udf get evm chainhead

* upd resource list

* new udf. receipts pipeline. upd testnet model cols. expand readme

* receipts silver

* traces

* vault

* reorg to evm dir

* rm testnet, blocks lookback

* lookbacks, move qualify

* macro and align naming

* del testnet, reset namespace to gen

* silver_evm - receipts and txs

* core_evm fact_blocks & fact_transactions

* fix vault path in get blocks. Logs v1 (need sample)

* core_evm fact_logs

* CR updates

* del readme and add workflow

* upd vault path, batch size

* incr logic on modified to core_evm

* use local utils.udf, add blockNumber col to complete blocks check

* rm col

* correct _invocation_id

* upd nv csv

* incr batch limit due to late start

* add evm tag to model run
2024-09-05 20:43:33 -06:00
Jack Forgash
e37db5668f
d+i (#352) 2024-09-04 18:45:33 -06:00
Jack Forgash
eb3247ca26
last _adj (#348) 2024-08-01 10:25:11 -06:00
Jack Forgash
433e62a63c
AN-4553/deploy new defi gold views (#345)
* bridge complete model

* depr notice on ez. Tests on fact bridge. TODOs - naming convention for amount and use chain IDs??

* ez and fact bridging

* dex swaps

* fix id col name. add platform to dex

* rm adj
2024-08-01 10:22:24 -06:00
Jack Forgash
a600e38457
upd dim metadata tests (#347) 2024-07-31 11:41:57 -06:00
Jack Forgash
3e471404e5
AN-5069/expand onchain metadata mapping (#346) 2024-07-31 08:24:25 -06:00
Jack Forgash
51607b2222
add tag back (#344) 2024-07-26 13:49:04 -06:00
eric-laurello
61c60b99c1
recorded_hour (#342) 2024-07-15 14:33:45 -04:00
eric-laurello
f6b98de014
so & clsutering (#341) 2024-07-15 09:28:47 -06:00
Jack Forgash
30ce62f6a0
AN-4936/Backfill Migration Final (#335)
* del cw models

* core views

* defi views

* gov view

* nft_views

* rm ref to old cw models

* del internal cols

* nv 13-15

* nv 13-15

* nv 17-18

* nv 20

* del temp logic

* upd tests on allday metadata

* upd to warn
2024-07-01 13:27:42 -06:00
Jack Forgash
9127e6de86
AN-4852/Testnet Integration (#326)
* source, bronze, complete, rt views

* complete testnet_ dependency

* upd sources.yml

* upd models and bronze

* upd models.sql

* upd model in bronze views

* adding chainhead_testnet

* add jobs

* fix: hour

* upd api integration

* various fixes. useast2, gha workflows, bad refs, etc

* update udtf_get_base_table

---------

Co-authored-by: WHYTEWYLL <juanmiblanco1@gmail.com>
2024-06-25 12:12:51 -06:00
Jack Forgash
12bf4e2e86
AN-4799/Backfill Migration (#329)
* move models to bronze

* blocks backfill logic ez ez ez

* streamline_load models for all 4 methods

* add back a set of views for the complete models to use

* del dbt run history gha workflow

* migrate txs final to modified ts

* upd events to modified

* set default val for LOAD_BACKFILL_VERSION in project yml

* update curated model incr logic
2024-06-12 12:10:27 -06:00
Jack Forgash
f3e6d0bfab
del deprecating price models (#332) 2024-06-12 12:02:08 -06:00
Jack Forgash
ffcb6d1492
add args to core fact_transactions (#331) 2024-06-06 22:34:28 -06:00
Jack Forgash
5ecb01870e
add script field to fact transactions (#330)
* add script field

* add to yml
2024-06-06 21:20:42 -06:00
WHYTEWYLL
f9e451debd
stats authorizer replacement (#328) 2024-06-04 17:43:30 -06:00
Jack Forgash
0b10065d52
incr batches (#325) 2024-05-23 14:55:23 -06:00
Jack Forgash
48c08901b1
fix 18 (#324) 2024-05-23 12:43:06 -06:00
WHYTEWYLL
f9be7412e6
qualify (#319)
* qualify

* data value

* moving it to flatten event

---------

Co-authored-by: forgash_ <jmfxyz@pm.me>
2024-05-06 09:22:53 -07:00
WHYTEWYLL
a0e441d668
deprecation and new view (#318)
* deprecation and new view

* reorg

* is_deprecated

* deprecated

* upd dbt model tag

---------

Co-authored-by: forgash_ <jmfxyz@pm.me>
2024-05-01 13:49:33 -06:00
WHYTEWYLL
2d85fe3e92
reducing batch size (#282) 2024-05-01 10:58:23 -07:00
Jack Forgash
894788f9b8
AA-4660 / dex swaps upd (#314)
* new swap model

* comment todos

* swaps aggregator model

* swap aggregator parsing

* upd requested fixes

* add date coalesce to ez view

* swaps agg yml

* platform doc
2024-04-22 09:59:21 -06:00
Jack Forgash
0537a64dc0
nv16 to 3mm (#310) 2024-03-21 13:30:11 -06:00
Jack Forgash
5fdadad200
19 big incr (#309) 2024-03-20 13:55:10 -06:00
Jack Forgash
cc8dc32125
Adj backfill - 16,18,19 smaller batches (#308)
* 16 smaller batches, larger backlog

* 18/19 smaller batches, larger backlog
2024-03-20 09:17:49 -06:00
Jack Forgash
575443c9aa
Adj backfill 7 - incr 16, 18, 19 (#307)
* double 16 sql limit, 33% incr on batch

* double 18/19 sql limit, ~33% incr on batch
2024-03-19 15:24:06 -06:00
Jack Forgash
8506282b5d
txres 16, 18. txs 18,19 (#306) 2024-03-19 09:20:59 -06:00
Jack Forgash
68754c046e
decr nv 19 (#305) 2024-03-19 09:13:40 -06:00
Jack Forgash
e9dd16f514
inc batches (#304) 2024-03-18 21:47:04 -06:00
Jack Forgash
a710a8d824
incr sql limit (#303) 2024-03-18 19:40:54 -06:00