Commit Graph

32 Commits

Author SHA1 Message Date
stanz
27e3414619
AN-6514 Streamline 2.0 Upgrade (#465)
Some checks failed
docs_update / run_dbt_jobs (push) Has been cancelled
docs_update / notify-failure (push) Has been cancelled
dbt_run_streamline_decoded_logs_history / run_dbt_jobs (push) Has been cancelled
dbt_run_streamline_decoded_logs_history / notify-failure (push) Has been cancelled
* rm topshot

* upd yml

* deploy udf

* upd blocks_realtime

* sl func

* bronze upd

* v1 namespace

* bronze v2

* prod endpoint

* define api integrations for v2

---------

Co-authored-by: Jack Forgash <58153492+forgxyz@users.noreply.github.com>
2025-10-24 01:15:13 +07:00
Austin
0e91031c85
account storage (#490)
Some checks are pending
docs_update / run_dbt_jobs (push) Waiting to run
docs_update / notify-failure (push) Blocked by required conditions
2025-10-02 22:39:19 -04:00
Jack Forgash
05da02b5fe
AN-6550/flow testnet v2 (#483)
* flow testnet v2

* set batch sizes

* add QN node_url to sl testnet model

* upd node_url in testnet rt models

* add gha workflows for testnet

* testnet gold models

* upd tag on gold

* upd tests

* upd tests and set min to 280mm

* upd test - rm null

---------

Co-authored-by: shah <info@shahnewazkhan.ca>
2025-09-16 20:32:27 -06:00
Jack Forgash
7341100552
rm old bronze views (#478) 2025-09-08 15:17:30 -06:00
Austin
197c506d8c
transfers (#460) 2025-06-24 16:12:56 -04:00
Austin
b5e8224ff6
evm prices (#409) 2025-02-11 14:36:35 -05:00
Jack Forgash
42bf946bf0
move streamline dir out of silver (#379)
* move streamline dir out of silver

* move evm streamline from silver->evm

* upd makefile and readme
2024-11-18 14:04:46 -07:00
Jack Forgash
9127e6de86
AN-4852/Testnet Integration (#326)
* source, bronze, complete, rt views

* complete testnet_ dependency

* upd sources.yml

* upd models and bronze

* upd models.sql

* upd model in bronze views

* adding chainhead_testnet

* add jobs

* fix: hour

* upd api integration

* various fixes. useast2, gha workflows, bad refs, etc

* update udtf_get_base_table

---------

Co-authored-by: WHYTEWYLL <juanmiblanco1@gmail.com>
2024-06-25 12:12:51 -06:00
Jack Forgash
12bf4e2e86
AN-4799/Backfill Migration (#329)
* move models to bronze

* blocks backfill logic ez ez ez

* streamline_load models for all 4 methods

* add back a set of views for the complete models to use

* del dbt run history gha workflow

* migrate txs final to modified ts

* upd events to modified

* set default val for LOAD_BACKFILL_VERSION in project yml

* update curated model incr logic
2024-06-12 12:10:27 -06:00
Jack Forgash
f3e6d0bfab
del deprecating price models (#332) 2024-06-12 12:02:08 -06:00
WHYTEWYLL
a0e441d668
deprecation and new view (#318)
* deprecation and new view

* reorg

* is_deprecated

* deprecated

* upd dbt model tag

---------

Co-authored-by: forgash_ <jmfxyz@pm.me>
2024-05-01 13:49:33 -06:00
WHYTEWYLL
e7615a0cc6
Update labels (#262)
* a

* lavels source updated

* add core view

* unique id

* delete coalesces
2024-01-31 13:44:59 -03:00
Jack Forgash
5b096dd83f
upd labels source (#223) 2023-11-07 11:48:11 -07:00
Jack Forgash
caf9f4804c
An 3780/schema reorg (#153)
* folder structures

* new views

* update docs overview

* upd sources

* upd sources and move silver from base to core

* del flipside prod db prices v2

* add scheduled tag to new views
2023-08-31 10:38:17 -06:00
Jack Forgash
45f72e71d8
An 3660/observability models (#155)
* blocks completeness

* block tx count external api model

* txs completeness model

* add col alias

* test result agg cte and temp test range

* curr range test

* revert source change - other pr

* xchain silver

* nuke api key & move to secrets, create workflow

* add scheduled tag

* update workflow w cache

* add obs tag

* rem testing range from txs complete

* comment out schedule and del double comman

* add default null for key var
2023-08-23 13:37:16 -06:00
desmond-hui
e5863f899a
An 2569/only retry req 3 times (#98)
* model api responses that resulted in no metadata

* dont try to get metadata after 3 retries

* fix PR comment

* use bronze model per PR
2022-12-14 17:05:19 -08:00
Jack Forgash
404b413147
An 2526/prices (#94)
* silver prices

* core view

* deprecating notice

* swap source

* silver source
2022-12-12 11:18:15 -07:00
desmond-hui
f12f90ede9
source external tables from streamline db (#90) 2022-11-30 14:16:13 -08:00
Jack Forgash
1d89e84073
AN-2161/events location (#64)
* events location

* its nested

* coalesce approach

* events fix
2022-09-17 00:52:31 -06:00
Jack Forgash
317a8ab617
An-1968/allday silver (#55)
* allday metadata silver

* fixes
2022-08-29 11:45:02 -06:00
desmond-hui
bcc90bacc2
bronze table now holds more than just topshot metadata (#54) 2022-08-26 12:27:26 -07:00
Jack Forgash
861e667d4b
AN-1870/allday ids (#51)
* allday nft ids

* silver topshot view for compat

* limit allday to 3000

* str

* add nfl all day metadata integration and refactor streamline process

* no longer needed

Co-authored-by: Desmond Hui <desmond@flipsidecrypto.com>
2022-08-26 11:07:40 -07:00
Jack Forgash
a952c32600
AN-1690/topshot_metadata (#36)
* topshot metadata

* adjust stats column names

* bronze view and inserted_timestamp
2022-07-06 10:39:24 -04:00
Jack Forgash
d8b0e8d0f0
add assets (#39) 2022-07-01 11:01:37 -06:00
Jack Forgash
6854a94ed1
AN-1638/inserted_timestamp (#35)
* bronze

* del netlify

* append column

* cluster

* incremental logic

* bridge tables

* docs
2022-06-30 13:12:08 -06:00
Jack Forgash
19841544e8
AN-1344/prices (#24)
* cmc prices

* gecko prices

* adjust $

* core view, no description yet pending swap prices

* prices

* price to price_usd

* address nulls and del mcap

* tests

* test fix
2022-06-02 12:17:34 -06:00
Jack Forgash
6381b49a6a
An 1215/labels (#10)
* labels

* typo

* cluster by address

* docs

* varchar
2022-05-16 16:21:54 -06:00
Jack Forgash
80c84fda4a
AN-1122/Silver tx events (#5)
* init. not run or tested

* hard coding silver txs temp

* coalesce, rename type to event_type

* typo

* tests

* formatting

* newline

* nothing

* underscore in config block

* incremental jinga underscore

* upstream underscores

* reconfig cases
2022-05-04 16:40:38 -06:00
Jack Forgash
c3a240d429
AN-1121 Initial push of Silver Transactions (#3)
* tx structure

* yml, qualify, ingested_at

* tests

* block_height

* tests, format, rename error column
2022-05-02 16:01:51 -06:00
Jack Forgash
1ac3da072e del alias 2022-04-18 10:34:27 -06:00
Jack Forgash
007226ac31 bronze txs view 2022-04-18 10:19:06 -06:00
Desmond Hui
fdc4e6cf12 initial setup files 2022-04-14 11:34:12 -07:00