Commit Graph

962 Commits

Author SHA1 Message Date
tarikceric
b03cce6a4c
extra core schedule to fill gap (#817)
* extra core schedule to fill gap

* run name
2025-03-07 13:01:52 -08:00
eric-laurello
fb6f0fdcdb
add jup to scheduled_non_core_hourly (#816) 2025-03-06 14:40:59 -08:00
tarikceric
75a16253d9
hourly schedule for ez dex swaps and upstream (#815)
* hourly schedule for ez dex swaps and upstream

* hourly schedule for ez dex swaps and upstream

* cleanup
2025-03-06 08:59:36 -08:00
stanley
f00fceb89f
AN-5834 NFT Mints Error Fix (#812)
* upd unique key

* changed testing
2025-03-06 01:12:40 +07:00
desmond-hui
0f9292c2e7
Minor test fixes (#810)
* remove saber tests

* add amount check for cpmm
2025-03-03 08:56:42 -08:00
desmond-hui
40716e1325
replace v1 staking lp actions with v2, add inner_index to gold (#806) 2025-02-17 15:20:57 -08:00
tarikceric
c90fbbd3fa
An 5768/nft sales legacy index (#804)
* wip inner index

* add index to legacy views
2025-02-17 11:11:53 -08:00
tarikceric
82fc03d9a3
add program to cluster (#803)
* add program to cluster

* revert
2025-02-14 10:05:57 -08:00
desmond-hui
fc6e488f2c
remove saber gauges from model updates (#809) 2025-02-14 10:04:07 -08:00
desmond-hui
c932f80517
handle millisecond unix timestamps using snowflake funcs (#807) 2025-02-14 10:03:04 -08:00
tarikceric
94b5f2942c
Update/core noncore schedule (#805)
* update core and noncore runs

* run votes with core
2025-02-14 09:27:12 -08:00
desmond-hui
7593f640d2
add requester predicate (#808) 2025-02-14 09:12:02 -08:00
desmond-hui
979e42cb98 tmp add partition date 2025-02-13 15:55:58 -08:00
desmond-hui
165e50bb5c hotfix auth 2025-02-13 14:24:46 -08:00
tarikceric
e5a497826b
check last timestamp before converting (#800)
* check last timestamp before converting

* test that last_timestamp is less then inserted
2025-02-13 13:17:46 -08:00
desmond-hui
3c229e32ee
fill in error txs (#802) 2025-02-12 08:33:42 -08:00
desmond-hui
bd0abc5adb
Refactor lp actions meteora multi (#795)
* wip

* wip

* fix logic for one token removals

* initial schema and tests

* revert temp test lookback

* PR feedback

* update FR range
2025-02-12 08:00:41 -08:00
desmond-hui
e0772708bf
refactor using events_inner, static program list (#799) 2025-02-12 07:08:56 -08:00
desmond-hui
ebda48ad1d
use row_number to dedupe (#798) 2025-02-12 07:02:24 -08:00
tarikceric
68c1eec35c
optimize cte distinct joins (#797)
* optimize cte distinct joins

* formatting

* formatting
2025-02-11 13:22:16 -08:00
tarikceric
66a9f14810
surface index/inner index (#794)
* surface index/inner index

* update index

* add data_test naming
2025-02-10 11:22:22 -08:00
desmond-hui
9a2112f7ae
Refactor decoded instructions realtime 3 (#796)
* use events_inner, formatting

* get IDLs as static list, remove JOIN
2025-02-10 09:45:42 -08:00
desmond-hui
08c4e84924
Refactor lp actions meteora dlmm (#792)
* initial model

* update full refresh start

* initial schema and tests

* add meteora 2 dlmm and amm relationship tests

* move pruning up

* remove commented out code
2025-02-07 09:26:00 -08:00
tarikceric
08ffd9afab
updte error count (#793) 2025-02-07 07:42:17 -08:00
desmond-hui
3fe9c467ad
Refactor lp actions meteora amm (#791)
* initial model

* predicate updates to remove most lp actions w/o token transfers

* initial schema

* add threshold for tokenA tests
2025-02-06 08:47:59 -08:00
tarikceric
407b00c74c hotfix incremental buffer 2025-02-05 11:27:51 -08:00
tarikceric
f72552bf74
use timestamp filter (#790)
* use timestamp filter

* remove groupby and formatting

* update model incremental logic
2025-02-04 16:25:09 -08:00
tarikceric
fa13e1b7d7
add buffer (#789) 2025-02-04 11:32:33 -08:00
tarikceric
ade741bb53
add takeBidLegacy sales (#788)
* add takeBidLegacy sales

* clean up
2025-02-03 10:21:07 -08:00
tarikceric
c9b094a934 use new block_production_2 2025-01-30 13:26:50 -08:00
tarikceric
f2f0f396d0
add snake case for jupv6 (#787) 2025-01-30 13:25:53 -08:00
desmond-hui
78f8e1dec2
Use stage block txs table for ingesting raw transactions data into silver (#786)
* wip

* change to hold 7 days worth of data

* update to use new upstream
2025-01-30 09:07:37 -08:00
desmond-hui
8d3e10da43
extract columns from value, don't include it in output (#785) 2025-01-30 07:00:54 -08:00
tarikceric
8fdc29d4ee
update mayan bridge (#782) 2025-01-29 09:13:04 -08:00
tarikceric
a4bbf76d56
An 5383/me decoded update (#775)
* models and core update

* add currency address and logic update

* deprecate old table

* use tx_id as unique_key

* remove filter for legacy model

* update tests/cols, cleanup logic

* add cutoff date

* use jinja var, use timestamp to join
2025-01-29 08:38:45 -08:00
desmond-hui
759603a6e1
look for new data in current max partition also (#784) 2025-01-29 07:35:24 -08:00
desmond-hui
634d9db3e6
fix name (#783) 2025-01-29 07:01:33 -08:00
tarikceric
21825dc2fc hot fix run tag 2025-01-28 10:08:51 -08:00
desmond-hui
ca55076476
stage block txs data for ingestion to silver (#781) 2025-01-28 09:45:21 -08:00
desmond-hui
31f532a129
only resend if not exist or error in silver for single day retries (#780) 2025-01-28 07:10:51 -08:00
desmond-hui
2138584d3a
fix bad epoch start/end slots (#777)
* fix bad epoch start/end slots

* WIP

* revert

* deprecate snapshot block production

* add deprecated model into historical

* add new model for block production

* add new model to gold
2025-01-27 07:20:06 -08:00
tarikceric
b048105a4a update meteora init pool nul token accts test 2025-01-23 14:31:41 -08:00
desmond-hui
e16b72085a
change partition key to 15min intervals instead of daily (#778) 2025-01-23 09:37:53 -08:00
desmond-hui
e3c3c29a98
add tx_index to gold (#779) 2025-01-23 09:11:40 -08:00
desmond-hui
af8f038360
Add meteora multi swap for marinade (#776)
* add marinade meteora multi pool liquidity pool actions

* cleanup
2025-01-22 07:56:26 -08:00
desmond-hui
55220d5458
Switch block tx counts back to solscan (#774)
* switch back to solscan blocks

* add comment
2025-01-21 09:21:27 -08:00
desmond-hui
6dd339c802
Backfill solana tx index pipeline (#773)
* wip

* wip

* add bronze tables and streamline source

* add silver table to store backfilled data

* adjust streamline request sizes

* update cluster keys

* make sure bronze data is not null

* update backfill workflow

* fix incremental

* update job frequency
2025-01-21 09:10:01 -08:00
tarikceric
d156d4e8eb hotfix qualify hadeswap sales 2025-01-20 16:47:36 -08:00
desmond-hui
bd52d9032b
Add decoder backfill helper for single dates (#772)
* backfill macro for all verified IDLs for specified date

* fix checking for completed after single date retry

* add block_id predicate for completed subset

* add retry macro for single date

* make macro names consistent
2025-01-15 14:22:09 -08:00
tarikceric
69b4e5e806
add desc to marinade gold pool tables (#771)
* add desc to marinade gold

* cleanup
2025-01-14 12:41:30 -08:00