Commit Graph

10 Commits

Author SHA1 Message Date
Jack Forgash
88df737fa2
AN-5203/Deploy flowEVM (#343)
* flow evm init

* flow evm testnet - blocks

* deploy dev udfs, update typo

* send block height as hex

* dev limit

* use stg external table

* some links

* add query to side doc

* upd external tbl to stg & testnet

* silver and evm txs

* testnet silver models pt1

* testnet events final, decode hash udf

* udf get evm chainhead

* upd resource list

* new udf. receipts pipeline. upd testnet model cols. expand readme

* receipts silver

* traces

* vault

* reorg to evm dir

* rm testnet, blocks lookback

* lookbacks, move qualify

* macro and align naming

* del testnet, reset namespace to gen

* silver_evm - receipts and txs

* core_evm fact_blocks & fact_transactions

* fix vault path in get blocks. Logs v1 (need sample)

* core_evm fact_logs

* CR updates

* del readme and add workflow

* upd vault path, batch size

* incr logic on modified to core_evm

* use local utils.udf, add blockNumber col to complete blocks check

* rm col

* correct _invocation_id

* upd nv csv

* incr batch limit due to late start

* add evm tag to model run
2024-09-05 20:43:33 -06:00
Jack Forgash
fc83740b50
upd nv csv (#224) 2023-11-08 09:37:24 -07:00
WHYTEWYLL
6ce17a7219
Streamline Realtime and Backfill Models (#156)
* add: model to backfill

* fix: node's string format

* add tags

* upd collection model

* mainnet21 hardcoded collections history model

* del tag

* mainnet 21 getblock

* tag for 21

* realtime models

* alias num as height

* realtime tags

* add missing tag and newlines

* backfiller

* backfiller

* move script to folder (renamed) python, upd test accordingly w dir name ch

* upd script to accept model input, update jobs per method call

* error w use_dev arg

* add: silver mdoels

* limit backfill job in python script

* rename silver dbt models to streamline_ and move into silver/core

* explicit casting to silver streamline models

* add documentation to silver streamline models

* run only current mainnet and history mainnet 22 first

* activate schedule for gha

* del hardcoded mainnet models

* move history modes out of subdirs into history dir

* fix GHA vars

* del upstream 1+ from history step

* del tag

---------

Co-authored-by: Jack Forgash <jmfxyz@pm.me>
2023-08-30 08:38:01 -06:00
Shah Newaz Khan
1beb5f8ad6
Stream 392 lq udf (#151)
* node url join optimized | warehouse privilege grants

* added udf api

* revert udtf alias

---------

Co-authored-by: shah <info@shahnewazkhan.ca>
2023-08-22 10:29:42 -07:00
Shah Newaz Khan
d14843bd0c
Stream 98 fix nodeurl (#141)
* fixed node urls

* limited streamline_blocks to candidate node 7 root height

---------

Co-authored-by: shah <info@shahnewazkhan.ca>
2023-08-03 12:30:13 -07:00
Shah Newaz Khan
b344373700
Stream 98 node url seed (#138)
* added clone purge fix make directive

* fixed json parsing for get blocks history

* added aws_lambda_role envar to undo_clone directive | added database grants to lambda role

* get_node_url parsing error

* fixed varchar return type for get_node_url

* node mapping window function success

* removed get_node_url macro | added node_url seed

* removed debug logs | removed create node_url macro

* added filter to node_mapping CTE

* Update models/silver/streamline/core/streamline__blocks.sql

* fixed merge conflict

* Reduce columns for get_blocks_history

---------

Co-authored-by: shah <info@shahnewazkhan.ca>
2023-08-01 14:56:15 -07:00
Jack Forgash
a06fac90ba
update version seed (#131)
* update version sewed

* newline
2023-07-23 09:28:22 -06:00
Jack Forgash
47e679b9d8
tweaks (#107) 2023-02-02 13:38:43 -07:00
Jack Forgash
b81c6c11ea
mainnet-20 (#81) 2022-11-02 13:03:37 -06:00
Jack Forgash
ee7efe3851
AN-2168/Add network (#65)
* net data

* add version
2022-09-19 17:48:12 -04:00