tarikceric
2b6ddb3070
sol daily balances ( #880 )
...
docs_update / run_dbt_jobs (push) Has been cancelled
docs_update / notify-failure (push) Has been cancelled
dbt_run_streamline_solscan_token_list / run_dbt_jobs (push) Has been cancelled
dbt_run_streamline_solscan_token_list / notify-failure (push) Has been cancelled
dbt_test_scheduled_weekly / run_dbt_jobs (push) Has been cancelled
dbt_test_scheduled_weekly / notify-failure (push) Has been cancelled
* sol daily balances
* update tests
* update daily run and balances schedule
2025-10-02 20:35:59 -07:00
tarikceric
afcccba5f5
reorder runs ( #878 )
...
docs_update / run_dbt_jobs (push) Has been cancelled
docs_update / notify-failure (push) Has been cancelled
dbt_run_streamline_solscan_token_list / run_dbt_jobs (push) Has been cancelled
dbt_run_streamline_solscan_token_list / notify-failure (push) Has been cancelled
dbt_test_scheduled_weekly / run_dbt_jobs (push) Has been cancelled
dbt_test_scheduled_weekly / notify-failure (push) Has been cancelled
dbt_test_scheduled / run_dbt_jobs (push) Has been cancelled
dbt_test_scheduled / notify-failure (push) Has been cancelled
* reorder runs
* capitalize
2025-09-25 09:32:51 -07:00
tarikceric
cdfe5bc958
remove decoded logs v1 from workflow ( #877 )
...
* remove decoded logs v1 from workflow
* remove v2 decode test
2025-09-18 09:44:53 -07:00
tarikceric
86a213cef3
update per v1 deletion ( #876 )
2025-09-18 09:12:29 -07:00
tarikceric
e7f690b003
delete past 6months of vote data ( #871 )
2025-09-16 09:32:43 -07:00
tarikceric
1a0e0c5049
remove pyth workflow ( #873 )
2025-09-12 11:13:58 -07:00
tarikceric
d5cf625b50
An 6539/update old sl sources ( #869 )
...
* update tables with sl 1.0 ext tables
* remove ext refresh operation
* remove trailing commas
* remove trailing comma
2025-09-10 10:12:16 -07:00
tarikceric
012390b531
add non_core_hourly job concurrency ( #857 )
2025-07-10 12:52:15 -07:00
tarikceric
818fd59939
An 6361/cte logic txs and idls ( #851 )
...
* update tx's logic
* set active col in idls
* same run and tag for idl tables
* fix tag name
2025-06-23 11:30:33 -07:00
tarikceric
41b7aee5c1
deprecate unused models ( #848 )
...
* deprecate unused models
* disable model
2025-06-04 15:09:59 -07:00
tarikceric
9859e5fa0a
use large warehouse ( #847 )
2025-05-28 13:20:49 -07:00
tarikceric
c18a2fab07
exclude stake snapshot; add alerting ( #845 )
...
* exclude stake snapshot; add alerting
* update name
2025-05-22 14:18:58 -07:00
tarikceric
f1afce74e7
update alerts ( #839 )
...
* update alerts
* move py file
* delete old actions
2025-05-12 11:37:53 -07:00
tarikceric
bf9c5f2a06
Remove/solsniper solanart nft sales ( #832 )
...
* deprecate solanart and solsniper
* remove legacy fact tables
2025-04-28 13:00:01 -07:00
tarikceric
308b1a8179
add integration test files ( #827 )
...
* add integration test files
* update integration test
2025-04-14 10:01:45 -07:00
tarikceric
dd87a5a4d3
move stake accts snapshot to gha workflow file ( #826 )
...
* move stake accts snapshot to gha workflow file
* cleanup
2025-04-10 13:41:32 -07:00
tarikceric
b03cce6a4c
extra core schedule to fill gap ( #817 )
...
* extra core schedule to fill gap
* run name
2025-03-07 13:01:52 -08:00
tarikceric
75a16253d9
hourly schedule for ez dex swaps and upstream ( #815 )
...
* hourly schedule for ez dex swaps and upstream
* hourly schedule for ez dex swaps and upstream
* cleanup
2025-03-06 08:59:36 -08:00
tarikceric
c9b094a934
use new block_production_2
2025-01-30 13:26:50 -08:00
desmond-hui
634d9db3e6
fix name ( #783 )
2025-01-29 07:01:33 -08:00
tarikceric
21825dc2fc
hot fix run tag
2025-01-28 10:08:51 -08:00
desmond-hui
ca55076476
stage block txs data for ingestion to silver ( #781 )
2025-01-28 09:45:21 -08:00
desmond-hui
55220d5458
Switch block tx counts back to solscan ( #774 )
...
* switch back to solscan blocks
* add comment
2025-01-21 09:21:27 -08:00
desmond-hui
6dd339c802
Backfill solana tx index pipeline ( #773 )
...
* wip
* wip
* add bronze tables and streamline source
* add silver table to store backfilled data
* adjust streamline request sizes
* update cluster keys
* make sure bronze data is not null
* update backfill workflow
* fix incremental
* update job frequency
2025-01-21 09:10:01 -08:00
tarikceric
ccd085163c
remove cnft backfill ( #749 )
...
* remove cnft backfill
* add comment
2025-01-07 09:37:43 -08:00
desmond-hui
a3b8cf8458
Deprecate legacy block txs pipeline ( #735 )
...
* move to backfill folder
* remove legacy udfs and calls
* use streamline 2.0 data after cutover block & partition
* update start block to do checks, add streamline 2.0 data
* fix ambiguous reference
* this test isnt used, it is currently ignored in the test workflow
* get partition from streamline 2.0 upstream when available
* add TODOs
* update partition and block cutoffs
2024-12-12 15:40:01 -08:00
desmond-hui
767a92a49b
Deprecate legacy decode logs pipeline - attempt #2 ( #731 )
...
* call streamline 2.0 endpoints
* update request query
* update to use streamline 2.0 data after cutoff
* formatting
* add larger lookback for first run, revert after
* fix comments
* get fields from new data structure, add coalesce for backwards compat
* update cutoff time
2024-12-11 14:38:46 -08:00
desmond-hui
4102bf2b73
revert decoded logs deploy
2024-12-09 10:07:48 -08:00
desmond-hui
420128b2a1
Deprecate legacy decode logs pipeline ( #726 )
...
* call streamline 2.0 endpoints
* update request query
* update to use streamline 2.0 data after cutoff
* formatting
* use new complete tables for backfill macros
* add larger lookback for first run, revert after
* fix comments
2024-12-09 09:13:47 -08:00
desmond-hui
8ea30e9285
Deprecate legacy decode instructions pipeline ( #723 )
...
* update requests model
* only call streamline 2.0 endpoint
* use streamline 2.0 data after cutoff, formatting
* fix id column reference
* remove FR and add comment
* update helper to use new completed table
* update cutoff date, extend lookback
2024-12-09 08:05:34 -08:00
desmond-hui
3ce9fe139b
hotfix, try optimize block txs 2 workflow
2024-12-09 07:49:05 -08:00
desmond-hui
ef07bd37f5
Add backup block txs count pipeline ( #729 )
...
* add backup pipeline to get tx counts from helius
* use helius if solscan not available
* temporarily replace solscan call w/ helius call
2024-12-06 09:29:07 -08:00
desmond-hui
f69c126030
Migrate block txs to streamline 2.0 ( #727 )
...
* add views for block txs streamline 2.0 data
* streamline 2.0 requests for block txs
* fix view macro to allow for no other cols
* add top level block timestamp, adjust batch size
* add workflow for pipeline
* add block tx 2 to gha schedule, reorder records
2024-12-06 07:53:50 -08:00
desmond-hui
f34ae7dc68
temporary job to check if all null mints are wsol ( #725 )
2024-12-04 09:05:16 -08:00
desmond-hui
0caeaca6ae
Migrate solscan token list call to solcan v2 ( #720 )
...
* remove legacy v1 call
* use solscan v2 data moving forward
* cleanup descriptions, columns, tests and formatting
* remove this is never used, remake it if we need in future
2024-11-26 08:59:23 -08:00
desmond-hui
935ca3c728
Migrate solana decoder to streamline 2 ( #711 )
...
* udf to call decoder on streamline 2.0
* bronze instruction decoder models
* add more v2 apis
* add bronze models for streamline 2.0 decoded logs
* add streamline models for 2.0 decoded instructions & logs
* run streamline 2.0 real time decoding pipelines in parallel
2024-11-25 08:37:24 -08:00
desmond-hui
469db641b1
Migrate solscan token metadata to solscan v2 ( #717 )
...
* get solscan token list using v2 api
* bronze models to retrieve token list data
* get token list once per week
* fix workflow name
2024-11-25 08:20:52 -08:00
tarikceric
1b4f329133
remove file path ( #715 )
2024-11-20 16:48:42 -08:00
desmond-hui
8bbc0801fb
Migrate solscan blocks to solscan v2 ( #713 )
...
* use solscan v2.0 api
* delete unused solscan legacy models (#712 )
* reget failed requests
2024-11-20 14:24:51 -08:00
desmond-hui
9a50fb2c57
Update dbt_test_hourly.yml
2024-11-15 06:53:44 -08:00
desmond-hui
cb8951419b
Update dbt_test_hourly.yml
2024-11-15 06:51:03 -08:00
desmond-hui
9d6cd7ec59
Fix table not found error for streamline block txs ( #709 )
...
* materialize the test output as a dbt modeled table
* reference the model instead of test output table
2024-11-14 06:51:52 -08:00
desmond-hui
5f7d79fc3b
refactor using quicknode and latest liverquery function ( #705 )
...
* refactor using quicknode and latest liverquery function
* allow manual workflow execution
2024-11-08 09:35:29 -08:00
desmond-hui
d12f1cd9fa
Deprecate legacy validator metadata ( #698 )
...
* remove legacy assets
* remove silver model
* use bronze directly in model
2024-11-05 10:31:39 -08:00
desmond-hui
b74ff15fd6
Migrate get solscan blocks to 2.0 ( #685 )
...
* streamline requests for solscan blocks
* bronze views for solscan streamline data
* workflow schedule for solscan streamline requests
* add todo comment
* update uri
* update the silver table before requesting the next set of blocks
* swap to using 2.0 data
* update TODO
* change vault path
2024-11-05 09:53:04 -08:00
desmond-hui
0b5863cbf2
Deprecate legacy validators app list api ( #696 )
...
* remove legacy assets
* use streamline 2.0 data in silver model moving forward
2024-11-05 09:07:42 -08:00
desmond-hui
3e084698ed
Migrate validator list to streamline 2.0 ( #691 )
...
* streamliine 2.0 request
* add bronze tables and workflow
* fix workflow name for program accounts
* stagger slightly
2024-11-04 09:57:11 -08:00
desmond-hui
e44589038b
Migrate validator rank metadata ( #692 )
...
* add streamline 2.0 request for validator metadata
* add bronze models
* add workflow
2024-11-04 09:43:03 -08:00
tarikceric
a4da0f567e
model and workflow ( #686 )
...
* model and workflow
* name, filter large partitions, max partition
* formatting
2024-11-01 09:32:02 -07:00
desmond-hui
16224abec9
Deprecate legacy streamline validator vote program accounts ( #688 )
...
* use streamline 2.0 data after cutoff
* remove legacy streamline assets
2024-11-01 08:21:13 -07:00
