desmond-hui
f69c126030
Migrate block txs to streamline 2.0 ( #727 )
...
* add views for block txs streamline 2.0 data
* streamline 2.0 requests for block txs
* fix view macro to allow for no other cols
* add top level block timestamp, adjust batch size
* add workflow for pipeline
* add block tx 2 to gha schedule, reorder records
2024-12-06 07:53:50 -08:00
desmond-hui
78a46b54b3
hotfix disable test due to solscan limits
2024-12-06 07:07:34 -08:00
desmond-hui
2cfa4258eb
hotfix use prod table as reference
2024-12-06 07:07:29 -08:00
tarikceric
2fc321ebdb
remove vote_pubkey ( #728 )
2024-12-05 10:28:28 -08:00
desmond-hui
f34ae7dc68
temporary job to check if all null mints are wsol ( #725 )
2024-12-04 09:05:16 -08:00
desmond-hui
ed5d8fce5e
match to account keys to check that it is wsol mint transfer ( #724 )
2024-12-03 17:59:13 -08:00
desmond-hui
75ecb7fc78
remove partial partitions test ( #722 )
2024-12-02 08:46:46 -08:00
desmond-hui
7c4d296081
hotfix table name
2024-12-02 07:55:53 -08:00
tarikceric
d2404d2348
An 5449/update jup v4v5 gold ( #707 )
...
* move jupv4/v5 to gold jupiter table
* add source
* add cols to view
* adjust test and limit cols
* null cols;suceeded filter;doc update
* convert to tables
* table desc update jup v4/v5 removal
2024-11-29 12:47:56 -06:00
tarikceric
c9d89b3722
recency range on non-whirlpool ( #721 )
2024-11-27 14:41:33 -06:00
tarikceric
e88c33fb1b
get distinct txs ( #718 )
2024-11-27 09:46:27 -06:00
desmond-hui
0caeaca6ae
Migrate solscan token list call to solcan v2 ( #720 )
...
* remove legacy v1 call
* use solscan v2 data moving forward
* cleanup descriptions, columns, tests and formatting
* remove this is never used, remake it if we need in future
2024-11-26 08:59:23 -08:00
desmond-hui
935ca3c728
Migrate solana decoder to streamline 2 ( #711 )
...
* udf to call decoder on streamline 2.0
* bronze instruction decoder models
* add more v2 apis
* add bronze models for streamline 2.0 decoded logs
* add streamline models for 2.0 decoded instructions & logs
* run streamline 2.0 real time decoding pipelines in parallel
2024-11-25 08:37:24 -08:00
desmond-hui
469db641b1
Migrate solscan token metadata to solscan v2 ( #717 )
...
* get solscan token list using v2 api
* bronze models to retrieve token list data
* get token list once per week
* fix workflow name
2024-11-25 08:20:52 -08:00
tarikceric
61750333ce
remove unique_key to insert only ( #719 )
2024-11-22 11:52:54 -08:00
desmond-hui
ca3e864986
deprecate and source as view ( #716 )
2024-11-20 17:07:08 -08:00
tarikceric
1b4f329133
remove file path ( #715 )
2024-11-20 16:48:42 -08:00
desmond-hui
8bbc0801fb
Migrate solscan blocks to solscan v2 ( #713 )
...
* use solscan v2.0 api
* delete unused solscan legacy models (#712 )
* reget failed requests
2024-11-20 14:24:51 -08:00
eric-laurello
ad6b397be7
AN-5523 tags ( #714 )
...
* tags
* file moves, core folder def
* bad move
2024-11-20 16:41:16 -05:00
desmond-hui
aef1a49f21
don't put null data into silver table ( #710 )
2024-11-19 14:52:52 -08:00
desmond-hui
9a50fb2c57
Update dbt_test_hourly.yml
2024-11-15 06:53:44 -08:00
desmond-hui
cb8951419b
Update dbt_test_hourly.yml
2024-11-15 06:51:03 -08:00
desmond-hui
55fef95602
if data is null, don't mark it as complete ( #708 )
2024-11-14 09:05:43 -08:00
desmond-hui
9d6cd7ec59
Fix table not found error for streamline block txs ( #709 )
...
* materialize the test output as a dbt modeled table
* reference the model instead of test output table
2024-11-14 06:51:52 -08:00
tarikceric
46ed9e75bf
handle edge cases ( #706 )
2024-11-11 14:24:13 -08:00
tarikceric
7b139acfba
increase batch size; run interval ( #702 )
2024-11-08 09:45:09 -08:00
desmond-hui
5f7d79fc3b
refactor using quicknode and latest liverquery function ( #705 )
...
* refactor using quicknode and latest liverquery function
* allow manual workflow execution
2024-11-08 09:35:29 -08:00
tarikceric
23dc36894d
fix program_id desc ( #704 )
2024-11-08 09:12:13 -08:00
desmond-hui
4c0ebacb89
only check amount when the tx is successful ( #703 )
2024-11-08 09:00:44 -08:00
desmond-hui
de3ea77db3
wip ( #701 )
2024-11-08 07:01:51 -08:00
tarikceric
bfe74fdca4
add limit cols ( #699 )
2024-11-07 11:50:39 -08:00
desmond-hui
a94464e872
set active stake to 0 when epoch is after deactivation epoch ( #700 )
2024-11-07 09:49:26 -08:00
tarikceric
51e5ed69eb
add pubkey col ( #695 )
2024-11-05 14:50:21 -08:00
tarikceric
e4de79882d
An 5223/jupiter limit orders ( #689 )
...
* add limit order logic
* limit signers
* filter out incorrectly labeled limit swaps
2024-11-05 12:28:12 -08:00
tarikceric
5688bce773
Update/cnft backfill helper ( #697 )
...
* update cnft backfill helper
* add cnft backfill
* revert index, add filter
* run 4x hour
2024-11-05 12:19:29 -08:00
desmond-hui
d12f1cd9fa
Deprecate legacy validator metadata ( #698 )
...
* remove legacy assets
* remove silver model
* use bronze directly in model
2024-11-05 10:31:39 -08:00
desmond-hui
b74ff15fd6
Migrate get solscan blocks to 2.0 ( #685 )
...
* streamline requests for solscan blocks
* bronze views for solscan streamline data
* workflow schedule for solscan streamline requests
* add todo comment
* update uri
* update the silver table before requesting the next set of blocks
* swap to using 2.0 data
* update TODO
* change vault path
2024-11-05 09:53:04 -08:00
desmond-hui
0b5863cbf2
Deprecate legacy validators app list api ( #696 )
...
* remove legacy assets
* use streamline 2.0 data in silver model moving forward
2024-11-05 09:07:42 -08:00
desmond-hui
5e645e8cd0
check for dca program call for is_dca_swap ( #693 )
2024-11-05 06:55:06 -08:00
tarikceric
790138d4e7
add qualify ( #694 )
2024-11-04 10:53:33 -08:00
desmond-hui
3e084698ed
Migrate validator list to streamline 2.0 ( #691 )
...
* streamliine 2.0 request
* add bronze tables and workflow
* fix workflow name for program accounts
* stagger slightly
2024-11-04 09:57:11 -08:00
desmond-hui
e44589038b
Migrate validator rank metadata ( #692 )
...
* add streamline 2.0 request for validator metadata
* add bronze models
* add workflow
2024-11-04 09:43:03 -08:00
desmond-hui
b962553b98
turn off legacy snowflake tasks that populate bronze.blocks2 ( #690 )
2024-11-04 08:56:05 -08:00
tarikceric
a4da0f567e
model and workflow ( #686 )
...
* model and workflow
* name, filter large partitions, max partition
* formatting
2024-11-01 09:32:02 -07:00
desmond-hui
16224abec9
Deprecate legacy streamline validator vote program accounts ( #688 )
...
* use streamline 2.0 data after cutoff
* remove legacy streamline assets
2024-11-01 08:21:13 -07:00
desmond-hui
fb8b97d0af
Deprecate legacy streamline validator vote accounts ( #687 )
...
* update model with 2.0 data
* remove legacy pipeline assets
* remove sp create call
* remove bronze refresh
2024-11-01 08:04:19 -07:00
tarikceric
40c7f77768
Hot fix/gold validator tests ( #683 )
...
* compute units logic
* remove tests
* revert unintentional change
* add threshold tests
2024-10-31 09:03:57 -07:00
desmond-hui
7d911ad9b6
use streamline 2.0 raw data ( #679 )
...
* use streamline 2.0 raw data
* revert value
2024-10-31 08:58:42 -07:00
desmond-hui
180f5a28df
Migrate validator vote program accounts ( #681 )
...
* streamline requests
* bronze models
* add workflow
2024-10-31 07:11:55 -07:00
desmond-hui
d3688507b3
Migrate validator vote accounts to streamline 2.0 ( #680 )
...
* streamline vote accounts requests
* bronze models
* add workflow
2024-10-31 07:09:41 -07:00
