Commit Graph

819 Commits

Author SHA1 Message Date
tarikceric
e4de79882d
An 5223/jupiter limit orders (#689)
* add limit order logic

* limit signers

* filter out incorrectly labeled limit swaps
2024-11-05 12:28:12 -08:00
tarikceric
5688bce773
Update/cnft backfill helper (#697)
* update cnft backfill helper

* add cnft backfill

* revert index, add filter

* run 4x hour
2024-11-05 12:19:29 -08:00
desmond-hui
d12f1cd9fa
Deprecate legacy validator metadata (#698)
* remove legacy assets

* remove silver model

* use bronze directly in model
2024-11-05 10:31:39 -08:00
desmond-hui
b74ff15fd6
Migrate get solscan blocks to 2.0 (#685)
* streamline requests for solscan blocks

* bronze views for solscan streamline data

* workflow schedule for solscan streamline requests

* add todo comment

* update uri

* update the silver table before requesting the next set of blocks

* swap to using 2.0 data

* update TODO

* change vault path
2024-11-05 09:53:04 -08:00
desmond-hui
0b5863cbf2
Deprecate legacy validators app list api (#696)
* remove legacy assets

* use streamline 2.0 data in silver model moving forward
2024-11-05 09:07:42 -08:00
desmond-hui
5e645e8cd0
check for dca program call for is_dca_swap (#693) 2024-11-05 06:55:06 -08:00
tarikceric
790138d4e7
add qualify (#694) 2024-11-04 10:53:33 -08:00
desmond-hui
3e084698ed
Migrate validator list to streamline 2.0 (#691)
* streamliine 2.0 request

* add bronze tables and workflow

* fix workflow name for program accounts

* stagger slightly
2024-11-04 09:57:11 -08:00
desmond-hui
e44589038b
Migrate validator rank metadata (#692)
* add streamline 2.0 request for validator metadata

* add bronze models

* add workflow
2024-11-04 09:43:03 -08:00
desmond-hui
b962553b98
turn off legacy snowflake tasks that populate bronze.blocks2 (#690) 2024-11-04 08:56:05 -08:00
tarikceric
a4da0f567e
model and workflow (#686)
* model and workflow

* name, filter large partitions, max partition

* formatting
2024-11-01 09:32:02 -07:00
desmond-hui
16224abec9
Deprecate legacy streamline validator vote program accounts (#688)
* use streamline 2.0 data after cutoff

* remove legacy streamline assets
2024-11-01 08:21:13 -07:00
desmond-hui
fb8b97d0af
Deprecate legacy streamline validator vote accounts (#687)
* update model with 2.0 data

* remove legacy pipeline assets

* remove sp create call

* remove bronze refresh
2024-11-01 08:04:19 -07:00
tarikceric
40c7f77768
Hot fix/gold validator tests (#683)
* compute units logic

* remove tests

* revert unintentional change

* add threshold tests
2024-10-31 09:03:57 -07:00
desmond-hui
7d911ad9b6
use streamline 2.0 raw data (#679)
* use streamline 2.0 raw data

* revert value
2024-10-31 08:58:42 -07:00
desmond-hui
180f5a28df
Migrate validator vote program accounts (#681)
* streamline requests

* bronze models

* add workflow
2024-10-31 07:11:55 -07:00
desmond-hui
d3688507b3
Migrate validator vote accounts to streamline 2.0 (#680)
* streamline vote accounts requests

* bronze models

* add workflow
2024-10-31 07:09:41 -07:00
tarikceric
46d726abd5
An 5328/update compute units logic (#684)
* compute units logic

* formating

* use block filter

* add type
2024-10-30 16:55:38 -07:00
desmond-hui
2d4829dc5d add back to scheduled run 2024-10-30 15:13:17 -07:00
tarikceric
890a2adab3
An 5156/jupv4 refactor (#672)
* wip

* clean

* add extra join logic

* fix colon

* add to core models

* core models wip

* revert

* cleanup

* revamp logic; pr comment changes

* update logic

* relationship test; logic update

* id truncated logs

* updated truncated logic
2024-10-30 06:58:12 -07:00
desmond-hui
6a2a9f60db undo revert 2024-10-29 20:10:24 -07:00
desmond-hui
a2452ec6c6 temp revert 2024-10-29 17:50:02 -07:00
desmond-hui
a5b15e0540 temporarily remove from schedule while FR is running 2024-10-29 17:25:26 -07:00
desmond-hui
2033940ab4
add silver and gold models (#682) 2024-10-29 17:11:12 -07:00
desmond-hui
b3ac67247c hotfix missing comma 2024-10-18 09:21:51 -07:00
tarikceric
0f8c825794
raydium cpmm swaps (#676)
* raydium cpmm swaps

* remove filter
2024-10-17 08:22:51 -07:00
desmond-hui
7021e4cf0a hotfix update both models in single dbt cmd 2024-10-16 09:58:14 -07:00
desmond-hui
eb42fa2814
Migrate blocks to streamline 2.0 (#675)
* bronze streamline blocks

* complete blocks and streamline requests

* add workflow

* revert

* update cutoff
2024-10-16 09:38:58 -07:00
desmond-hui
bbbae51728
partition by hour (#677)
* partition by hour

* update partition function
2024-10-16 08:01:18 -07:00
desmond-hui
122fa61bc9
An 5047/helius cnft metadata (#669)
* streamline bronze data models

* wip complete and requests nft metadata models

* add source

* formatting

* update columns and explode key

* fix partition key

* update requests logic

* rename to cnft

* run cnft metadata every 10 minutes

* add SO

* formatting
2024-10-15 09:21:52 -07:00
desmond-hui
0e6555d975
fix buffer to be 12 hours instead of 1 day (#674) 2024-10-11 12:08:09 -07:00
desmond-hui
8a3eb81b00 revert tmp changes 2024-10-11 08:32:58 -07:00
desmond-hui
30850c6cae hotfix, tmp hardcode partition to start with 2024-10-11 08:14:41 -07:00
desmond-hui
c90cf493dd hotfix, tmp hardcode partition to start with 2024-10-11 08:13:47 -07:00
desmond-hui
12a20b2a0a hotfix, tmp hardcode partition to start with 2024-10-11 07:57:46 -07:00
desmond-hui
c450df542d remove strealime 1.0 check for rewards, its deprecated 2024-10-11 07:11:52 -07:00
desmond-hui
2befb3b42f
allow workflow to be dispatched ad-hoc (#671) 2024-10-10 08:14:39 -07:00
desmond-hui
8c49d05d92 hotfix workflow name 2024-10-10 08:11:08 -07:00
desmond-hui
cc62a50760
allow workflow to be dispatched ad-hoc (#670) 2024-10-10 07:58:16 -07:00
tarikceric
c6785fa3e2
get all distinct txs; null amt/mint bug (#667)
* get all distinct txs; null amt/mint bug

* formatting
2024-10-08 10:24:14 -07:00
desmond-hui
0d32c421e1
deprecate rewards models built on streamline 1.0 raw data (#668)
* deprecate rewards models built on streamline 1.0 raw data

* remove streamline 1.0 block rewards udf and tasks

* disable streamline 1.0 block rewards request views

* disable complete block rewards, change ref to source
2024-10-08 09:43:16 -07:00
desmond-hui
7a25e4a021
include program logs that are base64 strings (#666) 2024-10-07 09:23:29 -07:00
tarikceric
993bb17f0e remove null test for event_type 2024-10-04 13:44:56 -07:00
tarikceric
8fff4ba7d1
add new dca signer addresses (#665) 2024-10-04 08:21:24 -07:00
desmond-hui
88e7f643e0
v2 reward fees model (#662)
* v2 reward fees model

* v2 reward staking model

* v2 reward voting model

* update formatting
2024-10-04 06:34:52 -07:00
tarikceric
11571d8bdc
add tag to exclude from test; add back events_inner (#663) 2024-10-03 09:22:20 -07:00
desmond-hui
e76e28e9ff hotfix order by 2024-10-03 07:35:39 -07:00
desmond-hui
a4c3eaab4f update cutover values 2024-09-27 09:37:30 -07:00
desmond-hui
0f59a077ac
Rewards streamline 2 (#660)
* wip

* wip

* tmp change to get it to work

* fix service var, change producer values

* wip

* add source and bronze models

* wip rewards

* wip

* wip

* wip

* adjust partition key logic for block rewards

* add dbt depends_on

* compare to completed

* add workflow for calling streamline 2.0 block rewards

* make and use v2 streamline external table macro

* rename and adjust starting block/partition

* update workflow

* match existing schedule
2024-09-27 09:31:33 -07:00
desmond-hui
8aacff420f
deprecate silver__snapshot_stake_accounts (#659) 2024-09-27 06:46:29 -07:00