Commit Graph

37 Commits

Author SHA1 Message Date
stanz
27e3414619
AN-6514 Streamline 2.0 Upgrade (#465)
Some checks failed
docs_update / run_dbt_jobs (push) Has been cancelled
docs_update / notify-failure (push) Has been cancelled
dbt_run_streamline_decoded_logs_history / run_dbt_jobs (push) Has been cancelled
dbt_run_streamline_decoded_logs_history / notify-failure (push) Has been cancelled
* rm topshot

* upd yml

* deploy udf

* upd blocks_realtime

* sl func

* bronze upd

* v1 namespace

* bronze v2

* prod endpoint

* define api integrations for v2

---------

Co-authored-by: Jack Forgash <58153492+forgxyz@users.noreply.github.com>
2025-10-24 01:15:13 +07:00
Austin
0e91031c85
account storage (#490)
Some checks are pending
docs_update / run_dbt_jobs (push) Waiting to run
docs_update / notify-failure (push) Blocked by required conditions
2025-10-02 22:39:19 -04:00
Jack Forgash
05da02b5fe
AN-6550/flow testnet v2 (#483)
* flow testnet v2

* set batch sizes

* add QN node_url to sl testnet model

* upd node_url in testnet rt models

* add gha workflows for testnet

* testnet gold models

* upd tag on gold

* upd tests

* upd tests and set min to 280mm

* upd test - rm null

---------

Co-authored-by: shah <info@shahnewazkhan.ca>
2025-09-16 20:32:27 -06:00
Jack Forgash
fc75a1860d
AN-6551/EVM Testnet (#480)
* init evm testnet models

* upd sources.yml

* fix _missing_receipts ref

* set min block

* upd dev streamline resources

* gha and rename schema to jut testnet

* fix refs

* fix refs 2

* tests

* rm space

---------

Co-authored-by: Austin <austin@flipsidecrypto.com>
2025-09-12 11:55:19 -06:00
Jack Forgash
6bc260c838
rm chainwalkers from source list (#477) 2025-09-08 15:12:57 -06:00
Jack Forgash
041626d9bc
AN-6276/add gold view to snag/transaction_entries workflow (#454)
* add gold view to snag/transaction_entries workflow

* add sortDir param

* backfill

* upd gha to hourly
2025-06-17 09:26:38 -06:00
SAI
3d13e03a45
Topshot data (#440)
* livequery UDF model

* streamline models

* Add streamline model for TopShot metadata real-time processing

* buyback table

* add

* topshot and all day

* added streamline changes

* realtime

* update

* updated

* SL work - proposed changes (#441)

* updates

* .

* rev

* view to table

* fixed a few bugs

* sql limit

---------

Co-authored-by: eric-laurello <102970824+eric-laurello@users.noreply.github.com>
Co-authored-by: Eric Laurello <eric.laurello@flipsidecrypto.com>
2025-05-28 15:40:14 -05:00
Austin
ae2a23d66c
scores (#413) 2025-03-03 10:26:42 -05:00
Austin
e119e85c07
An 5719/flow rework (#396)
* core models

* tests

* decoder / abis

* history process

* workflows

* end points

* workflow
2025-01-30 14:11:04 -05:00
Austin
6259ca6b2e
traces (#393)
* traces

* streamline

* retry
2025-01-22 16:02:25 -05:00
Jack Forgash
0b4bb81bd8
AN-5454/ABIs (#388)
* abi streamline pipeline - in prog

* add coalesce

* gha workflow

* CRs
2024-12-04 09:28:25 -07:00
Jack Forgash
6117353b5a
AN-5517/api integration - GET minting/assets (#381)
* api integration - GET minting/assets

* add to gha workflow

* fixes
2024-11-21 14:34:18 -07:00
Jack Forgash
22fe605582
AN-5413/Snag API (#376)
* init api models

* rm

* add vault path

* fix typo json key

* rm qualify from first silver model

* points spend silver model

* upd silver spend columns

* gha workflow and tags

* disable workflow

* disable correct gha

* add yml for silver model

* tag w streamline_non_core

* upd tags, gha workflow, final tweaks

* upd so, cluster, unique_key
2024-11-18 12:35:25 -07:00
Jack Forgash
4df472bace
AN-5459/point transfers api integration (#378)
* point transfers api integration

* upd 2 silver models

* gha workflow with auth

* upd gha workflow

* add gha on push config for testing

* add print step

* chg echo

* upd auth.py

* rm run on commit from gha

* upd model tags

* merge 2 silver into 1, add yml, upd gha

* upd auth return vals

* add exit 1 on failure

* upd return on success True

* add gha on-run config for final test

* add backup default to env_var(JWT)

* add backup default to env_var(JWT) - 2

* rm run on commit from gha and upd sql limit for balance call

* add yml for evm address model

* add evm address threshold test

* upd gha workflow

* upd per CRs
2024-11-15 09:43:52 -07:00
Jack Forgash
64a009f0ab
AN-5252/points api integration (#368)
* basic query

* external points api request

* rn REWARD_POINTS and add supplementary models

* upd vault

* add gha workflows

* add headers incl user-agent

* upd header

* rm content type header

* addback secret

* use target

* rn _realtime

* upd silver and add FR view
2024-10-11 14:16:25 -06:00
Jack Forgash
88df737fa2
AN-5203/Deploy flowEVM (#343)
* flow evm init

* flow evm testnet - blocks

* deploy dev udfs, update typo

* send block height as hex

* dev limit

* use stg external table

* some links

* add query to side doc

* upd external tbl to stg & testnet

* silver and evm txs

* testnet silver models pt1

* testnet events final, decode hash udf

* udf get evm chainhead

* upd resource list

* new udf. receipts pipeline. upd testnet model cols. expand readme

* receipts silver

* traces

* vault

* reorg to evm dir

* rm testnet, blocks lookback

* lookbacks, move qualify

* macro and align naming

* del testnet, reset namespace to gen

* silver_evm - receipts and txs

* core_evm fact_blocks & fact_transactions

* fix vault path in get blocks. Logs v1 (need sample)

* core_evm fact_logs

* CR updates

* del readme and add workflow

* upd vault path, batch size

* incr logic on modified to core_evm

* use local utils.udf, add blockNumber col to complete blocks check

* rm col

* correct _invocation_id

* upd nv csv

* incr batch limit due to late start

* add evm tag to model run
2024-09-05 20:43:33 -06:00
Jack Forgash
9127e6de86
AN-4852/Testnet Integration (#326)
* source, bronze, complete, rt views

* complete testnet_ dependency

* upd sources.yml

* upd models and bronze

* upd models.sql

* upd model in bronze views

* adding chainhead_testnet

* add jobs

* fix: hour

* upd api integration

* various fixes. useast2, gha workflows, bad refs, etc

* update udtf_get_base_table

---------

Co-authored-by: WHYTEWYLL <juanmiblanco1@gmail.com>
2024-06-25 12:12:51 -06:00
Jack Forgash
f3e6d0bfab
del deprecating price models (#332) 2024-06-12 12:02:08 -06:00
WHYTEWYLL
a0e441d668
deprecation and new view (#318)
* deprecation and new view

* reorg

* is_deprecated

* deprecated

* upd dbt model tag

---------

Co-authored-by: forgash_ <jmfxyz@pm.me>
2024-05-01 13:49:33 -06:00
WHYTEWYLL
e7615a0cc6
Update labels (#262)
* a

* lavels source updated

* add core view

* unique id

* delete coalesces
2024-01-31 13:44:59 -03:00
Jack Forgash
4c4ef12ca8
AN-4333/beta views for archiving espn ids for livequery use (#249)
* beta views for archiving espn ids for livequery use

* list cols
2023-12-19 13:40:30 -05:00
WHYTEWYLL
6d6f478df6
alldaynft metadata with LQ (#229)
* base

* clean up; add: silver model

* add: new standards

* fix: refactor

* delete: folders

* refactor simplying

* remove no longer needed

* fix: refactor to silver layer

* ready to merge

---------

Co-authored-by: Desmond Hui <desmond@flipsidecrypto.com>
2023-11-27 07:55:44 -08:00
Jack Forgash
121c3e6a2c
AN-4203/ufc strike metadata (#230)
* ufc strike metadata, plus organized nft folder better

* upd db tag on gold

* upd col name to serial number

* del listing id

* add back listing id
2023-11-20 16:26:39 -07:00
Jack Forgash
5b096dd83f
upd labels source (#223) 2023-11-07 11:48:11 -07:00
Jack Forgash
eb40b6d91d
Backfill Model - Incorporate all external tables (#211)
* upd sources, convert blocks to loop model, fix collections history

* multiple external tbl query macro and blocks update

* del network version.yml output

* add back rt blocks

* lower blocks

* revert str blocks and collections and move change to history view

* bronze history views and move into folders

* history workflow - blocks

* del history step from streamline blocks

* create complete get history models and upd get history streamline views - BLOCKS

* upd remaining method get history views to use history complete tables

* upd txs history dependency note

* upd history gha and del parameterized models

* fix collections external table config

* collections template fix

* upd txs templates

* upd history views

* fix to tx results template / views

* set history schedule to hourly

* del commented out backfill from streamline RT GHAs

* move blocks filter up to cte
2023-10-26 11:31:19 -06:00
Jack Forgash
caf9f4804c
An 3780/schema reorg (#153)
* folder structures

* new views

* update docs overview

* upd sources

* upd sources and move silver from base to core

* del flipside prod db prices v2

* add scheduled tag to new views
2023-08-31 10:38:17 -06:00
Jack Forgash
45f72e71d8
An 3660/observability models (#155)
* blocks completeness

* block tx count external api model

* txs completeness model

* add col alias

* test result agg cte and temp test range

* curr range test

* revert source change - other pr

* xchain silver

* nuke api key & move to secrets, create workflow

* add scheduled tag

* update workflow w cache

* add obs tag

* rem testing range from txs complete

* comment out schedule and del double comman

* add default null for key var
2023-08-23 13:37:16 -06:00
Shah Newaz Khan
2413473512
GHA & Backfill Docs (#149)
* node url join optimized | warehouse privilege grants

* added string interpolation for env based target.database

* revert to candidate node 7 root height

* collections history success

* removed end height from network_version

* removed EOF

* added prod udf

* added tx & tx_result backfill models

* adds FR models

* add prod api integraton

* switched dev flag off

* added gha & docs

* updated serialization png

* added tx specific gha model selection

---------

Co-authored-by: shah <info@shahnewazkhan.ca>
2023-08-16 15:57:04 -07:00
Shah Newaz Khan
fe7f688cc2
Stream 98 collection backfill (#145)
* node url join optimized | warehouse privilege grants

* added string interpolation for env based target.database

* revert to candidate node 7 root height

* collections history success

* removed end height from network_version

* removed EOF

* added prod udf

---------

Co-authored-by: shah <info@shahnewazkhan.ca>
2023-08-10 14:23:29 -07:00
Jack Forgash
09aa518880
An 2719/actions labels tweaks (#105)
* use template for GHA

* add custom notification

* move nft models to folder

* put silver models in folder

* swap labels to crosschain

* move script

* move script

* update failed test list if none
2023-01-26 09:24:49 -07:00
Jack Forgash
404b413147
An 2526/prices (#94)
* silver prices

* core view

* deprecating notice

* swap source

* silver source
2022-12-12 11:18:15 -07:00
desmond-hui
f12f90ede9
source external tables from streamline db (#90) 2022-11-30 14:16:13 -08:00
Jack Forgash
861e667d4b
AN-1870/allday ids (#51)
* allday nft ids

* silver topshot view for compat

* limit allday to 3000

* str

* add nfl all day metadata integration and refactor streamline process

* no longer needed

Co-authored-by: Desmond Hui <desmond@flipsidecrypto.com>
2022-08-26 11:07:40 -07:00
desmond-hui
a1bdcbb529
An 1625/integrate moments minted api (#34)
* clone stages to dev

* add api integration for topshot metadata
2022-06-28 09:24:09 -07:00
Jack Forgash
19841544e8
AN-1344/prices (#24)
* cmc prices

* gecko prices

* adjust $

* core view, no description yet pending swap prices

* prices

* price to price_usd

* address nulls and del mcap

* tests

* test fix
2022-06-02 12:17:34 -06:00
Jack Forgash
6381b49a6a
An 1215/labels (#10)
* labels

* typo

* cluster by address

* docs

* varchar
2022-05-16 16:21:54 -06:00
Desmond Hui
fdc4e6cf12 initial setup files 2022-04-14 11:34:12 -07:00