Commit Graph

20 Commits

Author SHA1 Message Date
desmond-hui
8b33b55737
Backfill txs with vote txs with non vote instructions (#619)
* add model to identify txs to be backfilled

* add workflow to run backfill

* add comment
2024-07-25 06:34:35 -07:00
desmond-hui
dda387f040
realtime scheduling for decoding logs (#579) 2024-06-12 09:04:31 -07:00
Desmond Hui
319b76b669 remove extra double quote 2024-04-29 07:10:08 -07:00
desmond-hui
9d30ea2e3f
remove the cnft backfill task (#546) 2024-04-29 07:04:43 -07:00
tarikceric
1cef5247b9
An 4769/me solsniper cnft sales (#540)
* wip

* wip

* get compressed mint

* add schedule, pr comments update

* temp backfill logic

* backfill only
2024-04-25 10:41:45 -07:00
desmond-hui
7eda8c5cd2
remove cnft backfill from schedule, it is completed (#532) 2024-04-12 09:32:38 -07:00
Desmond Hui
9886ee4654 update cnft backfill scheduler 2024-02-06 06:39:20 -08:00
desmond-hui
92c57a4e86
An 4435/compressed mints backfill helpers (#475)
* wip

* make the DMLs ACID

* add backfill job, rename existing workflow

* check there is data to backfill before continuing
2024-02-05 07:16:02 -08:00
desmond-hui
bc9637a79b
use orchestrator to trigger decoded realtime and backfill (#466) 2024-01-26 07:51:28 -08:00
desmond-hui
68174b45cc
test async workflow orchestration (#461)
* test async workflow orchestration

* update
2024-01-25 08:17:11 -08:00
desmond-hui
bd23649b00
An 4429/setup pyth backfill (#460)
* setup pyth backfill

* wip

* remove dev file

* adjust backfill scheduler, add more runs of complete decoded

* adjust backfill rane
2024-01-24 07:49:59 -08:00
Desmond Hui
cc14acf494 add decoder backfill gha workflow 2024-01-04 09:21:57 -08:00
desmond-hui
73a2d32f29
An 4323/initial streamline 2.0 setup (#430)
* wip

* change udf name, fix surrogate key for inner instruct calls

* (wip) decoded instructions backfill helpers

* complete backfill helpers, clean up views with 0 requests

* rename

* revert

* temp change will revert

* rename

* use streamline 2.0 verify idl api endpoint

* this is placeholder model, will replace existing when ready

* reorg files

* add workflow for decode instructions real time

* use pip cache

* update with prod endpoints

* update sql limit to real value, should be union all

* use ref for model names

* remove placeholder, replace existing model logic

* add new decoder flow to gha

* temp disable incremental

* add inner index to core tables

* match existing behavior until we properly incorporate inner_instruction txs

* temp disable
2024-01-03 11:40:57 -08:00
desmond-hui
8bf643dcd2
make core run as part of non-core (#407) 2023-11-17 07:40:05 -08:00
desmond-hui
f8e0ca0e51
make it 15mins instead of every 10 (#403) 2023-11-15 11:27:56 -08:00
desmond-hui
d32599e851
An 4090/force paralell execution (#402)
* force paralell execution for each udf request

* increase number of commands per workflow, decrease schedule frequency
2023-11-15 09:51:03 -08:00
desmond-hui
c567d20d7b
add compressed nft backfill job to SF (#400) 2023-11-14 10:16:18 -08:00
tarikceric
95e392d5b1
Update/schedule core tags (#396)
* wip

* add schedule tags

* use snowflake tasks

---------

Co-authored-by: Eric Laurello <eric.laurello@flipsidecrypto.com>
2023-11-10 15:59:21 -05:00
desmond-hui
c5e10794c9
this should be the filename (#389) 2023-11-07 08:38:38 -08:00
desmond-hui
2734d36d7c
Dispatch gha via snowflake (#388)
* update package

* setup GHA dispatches via Snowflake tasks

* remove unused workflows

* add model qualifier to only run models in solana

* include task status monitoring workflow
2023-11-07 08:17:36 -08:00