Commit Graph

326 Commits

Author SHA1 Message Date
Jack Forgash
3bf75dfd18
fix typo (#340) 2024-06-25 15:01:38 -06:00
Jack Forgash
e27aa3b83b
use us-east-2 integration (#339) 2024-06-25 14:11:59 -06:00
Jack Forgash
965d037877
upd aws_flow_api_dev_2 (#338)
* upd aws_flow_api_dev_2

* update everywhere
2024-06-25 12:45:19 -06:00
Jack Forgash
9127e6de86
AN-4852/Testnet Integration (#326)
* source, bronze, complete, rt views

* complete testnet_ dependency

* upd sources.yml

* upd models and bronze

* upd models.sql

* upd model in bronze views

* adding chainhead_testnet

* add jobs

* fix: hour

* upd api integration

* various fixes. useast2, gha workflows, bad refs, etc

* update udtf_get_base_table

---------

Co-authored-by: WHYTEWYLL <juanmiblanco1@gmail.com>
2024-06-25 12:12:51 -06:00
Shah Newaz Khan
fd840c2c3e
add flow evm v2 udfs (#337) 2024-06-25 07:49:43 -07:00
Jack Forgash
e41b0411f0
adj schedule and rename non core workflow group (#336) 2024-06-20 14:02:35 -06:00
Jack Forgash
64a996b2c7
new workflow/adhoc with alert (#334)
* new workflow

* print run status

* add workflow dispatch for testing

* add temp default for inputs

* add temp default for inputs in steps

* modify echo status after run

* add outcome

* print data

* pull echo into separate step

* define dbt_run_status

* run again

* try intentional failed dbt command

* add emoji to status

* fix single quote

* pass data directly

* del testing defaults

* del unused imports
2024-06-20 10:40:48 -06:00
Jack Forgash
12bf4e2e86
AN-4799/Backfill Migration (#329)
* move models to bronze

* blocks backfill logic ez ez ez

* streamline_load models for all 4 methods

* add back a set of views for the complete models to use

* del dbt run history gha workflow

* migrate txs final to modified ts

* upd events to modified

* set default val for LOAD_BACKFILL_VERSION in project yml

* update curated model incr logic
2024-06-12 12:10:27 -06:00
Jack Forgash
f3e6d0bfab
del deprecating price models (#332) 2024-06-12 12:02:08 -06:00
Jack Forgash
ffcb6d1492
add args to core fact_transactions (#331) 2024-06-06 22:34:28 -06:00
Jack Forgash
5ecb01870e
add script field to fact transactions (#330)
* add script field

* add to yml
2024-06-06 21:20:42 -06:00
WHYTEWYLL
f9e451debd
stats authorizer replacement (#328) 2024-06-04 17:43:30 -06:00
Jack Forgash
cd3e24bb92
rm 14 and 15 (#327) 2024-05-24 09:35:44 -06:00
Jack Forgash
0b10065d52
incr batches (#325) 2024-05-23 14:55:23 -06:00
Jack Forgash
48c08901b1
fix 18 (#324) 2024-05-23 12:43:06 -06:00
Jack Forgash
cc51f4bcca
add 14-16 back for last few (#323) 2024-05-23 11:30:34 -06:00
Jack Forgash
40ef79f4fc
flip to non-batch method (#322) 2024-05-23 11:17:51 -06:00
Jack Forgash
6e288d5661
del 14-16 (#320) 2024-05-06 13:15:08 -06:00
WHYTEWYLL
f9be7412e6
qualify (#319)
* qualify

* data value

* moving it to flatten event

---------

Co-authored-by: forgash_ <jmfxyz@pm.me>
2024-05-06 09:22:53 -07:00
WHYTEWYLL
a0e441d668
deprecation and new view (#318)
* deprecation and new view

* reorg

* is_deprecated

* deprecated

* upd dbt model tag

---------

Co-authored-by: forgash_ <jmfxyz@pm.me>
2024-05-01 13:49:33 -06:00
WHYTEWYLL
2d85fe3e92
reducing batch size (#282) 2024-05-01 10:58:23 -07:00
Jack Forgash
c2353ab0f3
rm transactions history - complete (#316) 2024-04-24 09:55:20 -06:00
Jack Forgash
894788f9b8
AA-4660 / dex swaps upd (#314)
* new swap model

* comment todos

* swaps aggregator model

* swap aggregator parsing

* upd requested fixes

* add date coalesce to ez view

* swaps agg yml

* platform doc
2024-04-22 09:59:21 -06:00
Jack Forgash
8212f29562
quickfix to profile and .env.sample (#313)
* quickfix to profile and .env.sample

* revert dbt_project.yml
2024-04-09 11:29:09 -06:00
Jack Forgash
43c5e45cbc
disable block tx count recency test (#312) 2024-04-03 09:50:39 -06:00
Jack Forgash
797cb9a430
hourly (#311) 2024-03-26 09:22:32 -06:00
Jack Forgash
0537a64dc0
nv16 to 3mm (#310) 2024-03-21 13:30:11 -06:00
Jack Forgash
5fdadad200
19 big incr (#309) 2024-03-20 13:55:10 -06:00
Jack Forgash
cc8dc32125
Adj backfill - 16,18,19 smaller batches (#308)
* 16 smaller batches, larger backlog

* 18/19 smaller batches, larger backlog
2024-03-20 09:17:49 -06:00
Jack Forgash
575443c9aa
Adj backfill 7 - incr 16, 18, 19 (#307)
* double 16 sql limit, 33% incr on batch

* double 18/19 sql limit, ~33% incr on batch
2024-03-19 15:24:06 -06:00
Jack Forgash
8506282b5d
txres 16, 18. txs 18,19 (#306) 2024-03-19 09:20:59 -06:00
Jack Forgash
68754c046e
decr nv 19 (#305) 2024-03-19 09:13:40 -06:00
Jack Forgash
e9dd16f514
inc batches (#304) 2024-03-18 21:47:04 -06:00
Jack Forgash
a710a8d824
incr sql limit (#303) 2024-03-18 19:40:54 -06:00
Jack Forgash
6f52a2f548
upd txs nv 18 (#302) 2024-03-18 18:52:12 -06:00
Jack Forgash
498d590dc8
backfill - upd batch sizing (#300)
* upd batch sizing

* upd txs nv 19
2024-03-18 16:04:23 -06:00
Jack Forgash
a531ee5c98
upd txs away from batch (#299) 2024-03-18 11:28:23 -06:00
WHYTEWYLL
cdc0d9e668
2h (#298) 2024-03-18 10:50:27 -06:00
Jack Forgash
dd2b42d326
fix indent dbt test gha (#290) 2024-03-15 10:34:18 -06:00
WHYTEWYLL
537a8b57c0
v2 to v1 (#296) 2024-03-14 19:25:31 -06:00
WHYTEWYLL
022390ebdc
Fix target (#295)
* hardcoding v2

* v2
2024-03-14 18:58:58 -06:00
WHYTEWYLL
131146940b
hardcoding v2 (#294) 2024-03-14 18:34:20 -06:00
WHYTEWYLL
e90fb88156
Fix job (#293)
* fix job

* key

* space

* format

* one line
2024-03-14 17:11:05 -06:00
WHYTEWYLL
605b43092a
fix job (#292)
* fix job

* key

* space
2024-03-14 16:52:02 -06:00
WHYTEWYLL
0dee1c27e9
adding batch methods for chain and cronjob (#284)
Finetune
2024-03-14 15:38:49 -06:00
Jack Forgash
db39b35ceb
upd workflows to use requirements.txt (#289) 2024-03-13 13:54:26 -06:00
Jack Forgash
f174dc3cd4
add protobuf ver (#288) 2024-03-13 13:22:18 -06:00
Jack Forgash
490b0cdea3
add deps back (#287) 2024-03-13 13:19:07 -06:00
Jack Forgash
2f356f9403
del dbt deps (#285) 2024-03-13 13:12:22 -06:00
Shah Newaz Khan
3d493da486
Stream 803/throughput tune mn 18 (#283)
* add var read for invoke streams

* WIP throughput tune

* added mn 19 batch model

* remove transient tx-results-batch bronze table

* add concurent_requests

---------

Co-authored-by: shah <info@shahnewazkhan.ca>
2024-03-08 14:50:04 -08:00