Commit Graph

413 Commits

Author SHA1 Message Date
desmond-hui
fd8c7fa424
add test cases for ez staking (#366) 2023-10-17 10:18:38 -07:00
tarikceric
81b004df53
An 3931/token nft burn mint actions (#360)
* wip

* silver and core tables

* add description

* wip updates

* update location and nft_mint_actions

* update logic

* optimize filter and add _inserted_timestamp

* select metaplex events and join to

* update per pr comments

* add back in program filter
2023-10-16 12:04:13 -07:00
desmond-hui
0ee5603884
Update dbt_run_incremental.yml 2023-10-16 07:57:58 -07:00
desmond-hui
1047c6304b
break up the model to only run 50 requests per invocation (#364) 2023-10-12 09:14:04 -07:00
desmond-hui
1095f69a27
temp change while we resolve solscan api issue (#363) 2023-10-11 07:38:05 -07:00
desmond-hui
0a28d2e90c
change data type by using sysdate (#362) 2023-10-09 10:35:30 -07:00
tarikceric
38ce2c7850
deprecate marinade and coral cube (#361) 2023-10-06 09:46:37 -07:00
desmond-hui
561a9b7f6a
An 3943/get compressed nft addresses (#358)
* external funcs (wip)

* call compressed nft mint parser with external func

* ignore bronze_api models

* move to match standard location

* fix missing mints due to inconsistent ordering

* add a tag to bronze_api model, exclude accordingly
2023-10-04 08:41:01 -07:00
tarikceric
6464730baf
update helius job (#359) 2023-10-03 13:51:23 -07:00
tarikceric
82c0005222
An 3761/helius metadata (#353)
* helius metadata grabs

* update

* exclude null metadata

* adjust increment

* update jobs

* yml and dups

* tags

* use livequery endpoint

* update schema, add error handling

* remove unnecessary ORDER BY

* fix timestamp for backfill start

* update per pr comments

* update status cols
2023-10-03 12:29:36 -07:00
desmond-hui
b27c95d5b6
Update dbt_run_incremental.yml 2023-10-02 09:13:17 -07:00
desmond-hui
0b9ab511fa
Update dbt_run_incremental.yml 2023-10-02 07:48:27 -07:00
desmond-hui
6c5bbb1d63
Update dbt_run_incremental.yml 2023-09-29 09:57:52 -07:00
desmond-hui
e80cd3e8be
Update dbt_run_incremental.yml 2023-09-29 08:13:58 -07:00
desmond-hui
b0adadfedf
reduce max block range filtered per run (#357) 2023-09-28 10:16:37 -07:00
desmond-hui
52c0b832e3
fix path because model file was moved (#356) 2023-09-27 09:52:12 -07:00
desmond-hui
17b02fbd89
An 3858/change historical workflow (#354)
* use perm data models for streamline work

* add process to clean the historical queue

* modify parser historical workflow

* fix query

* make this insert-only, merge is very costly

* add clean queue job

* fix name on build queue workflow

* add cluster keys
2023-09-27 08:50:55 -07:00
desmond-hui
77dfdc5e6a
An 3858/change historical workflow (#351)
* use perm data models for streamline work

* add process to clean the historical queue

* modify parser historical workflow

* fix query

* make this insert-only, merge is very costly

* add clean queue job

* fix name on build queue workflow
2023-09-27 08:15:12 -07:00
tarikceric
a6d57153cd
An 3947/fix solscan token macro (#352)
* add for loop

* remove wait

* add test for recency
2023-09-26 13:48:02 -05:00
desmond-hui
78fa17e348
An 3915/reduce model run times (#350)
* add logic for incremental loads

* cap lookback period for rarely updated models

* improve query time

* missed comments on couple of lines

* more incremental runtime improvements
2023-09-13 10:39:47 -07:00
desmond-hui
57c4934b6a
run more often 2023-09-13 08:52:35 -07:00
desmond-hui
13eed97307
An 3915/reduce model run times (#349)
* add logic for incremental loads

* cap lookback period for rarely updated models

* improve query time

* missed comments on couple of lines
2023-09-12 09:30:13 -07:00
desmond-hui
f8d0d9d90b
An 3915/reduce model run times (#348)
* add logic for incremental loads

* cap lookback period for rarely updated models
2023-09-12 06:55:31 -07:00
desmond-hui
9336347ecc
remove query_tag, using package now (#347) 2023-09-11 10:28:21 -07:00
desmond-hui
ba8c60008a
add logic for incremental loads (#346) 2023-09-11 09:53:47 -07:00
tarikceric
a83156e9e7
Sources and disable old models (#344)
* sources and views for disabled models

* disable models and clean workflow

* reference views

* set full_refresh to false
2023-09-08 10:21:50 -07:00
desmond-hui
94a0136c02
Update dbt_run_incremental.yml 2023-09-08 09:09:16 -07:00
tarikceric
3724d52ecb
add select tags (#345) 2023-09-08 08:33:29 -04:00
tarikceric
76bd1e26f0
An 3900/gold mint and burn actions (#342)
* add descriptions

* burn and mint action core models
2023-09-07 12:53:16 -07:00
desmond-hui
88ec9eb416
Update dbt_run_incremental.yml 2023-09-07 10:47:16 -07:00
desmond-hui
e4a302cf81
Update dbt_run_incremental.yml 2023-09-07 09:31:47 -07:00
desmond-hui
34b56d60a0
offset times from realtime parser (#343) 2023-09-07 07:17:11 -07:00
desmond-hui
8b51b68829
An 3858/add perm idl tables (#340)
* add source for user supplied table

* udf to handle the idl verification process

* verify and store verified idls

* remove legacy code

* change udf name

* fix typo:

* add boolean flag to indicate this is verification process

* remove elements not needed for request

* update historical job to run completed and pointer before view

---------

Co-authored-by: Desmond Hui <desmondhui@Desmonds-MacBook-Pro.local>
2023-09-07 06:57:23 -07:00
tarikceric
f551027521
An 3902/additional candy machine program (#341)
* additional candy machine program

* adjust filter
2023-09-06 13:31:19 -07:00
Desmond Hui
923a853b37 fix typo 2023-09-05 11:15:57 -07:00
tarikceric
78c17ee686
Fix/use date in historic parser models (#338)
* fix naming

* use block_timestamp instead of block_id

* reference new verified idls table

* materialize intermediate table to improve performance

* add incremental logic, change col names

* add condition to check for block id

---------

Co-authored-by: Desmond Hui <desmond@flipsidecrypto.com>
2023-09-05 11:09:01 -07:00
eric-laurello
05d5e0812e
fix for shares (#339) 2023-09-01 07:59:47 -04:00
tarikceric
337d59f3c4
An 3784/schema reorg (#331)
* reorg update

* cleanup

* reformat

* update overview

* match gold update
2023-08-31 09:35:36 -07:00
desmond-hui
57f2231823
An 3858/add perm idl tables (#337)
* add source for user supplied table

* udf to handle the idl verification process

* verify and store verified idls

* remove legacy code

* change udf name

* fix typo:

---------

Co-authored-by: Desmond Hui <desmondhui@Desmonds-MacBook-Pro.local>
2023-08-31 07:19:29 -07:00
eric-laurello
64e7a9b146
remove gold source refs (#336) 2023-08-30 11:14:32 -04:00
tarikceric
95500d603a
update total_pages (#335) 2023-08-28 13:05:01 -07:00
tarikceric
54ee19d2ab
An 3765/parser historical (#334)
* program idl model

* parser historical workflow
2023-08-25 10:34:49 -07:00
xiuy001
00adf2a414
Quick fix registered on time bronze (#333)
* update to add the retry variable and updated the register time

* removed the trigger from unknown github action
2023-08-23 17:01:39 -04:00
xiuy001
bd223de8ab
quick update to update the github action name (#332)
* quick update

* updated

* updated
2023-08-23 14:13:53 -04:00
tarikceric
54bc8c6b35
adjust cluster_by (#328) 2023-08-23 10:56:49 -07:00
tarikceric
9e7896e707
adjust limit (#329) 2023-08-23 10:56:08 -07:00
xiuy001
7bd1a31291
added retry logic (#330)
* added retry logic

* updated to remove the unknown instruction

* updatec
2023-08-23 13:19:11 -04:00
tarikceric
8307619289
An 3648/data observability (#325)
* blocks test

* wip

* transaction observability

* rework models

* add crosschain source

* observability workflow

* observability vars
2023-08-17 16:30:17 -07:00
tarikceric
7be8c45e44
spelling (#327) 2023-08-17 12:46:04 -07:00
tarikceric
5831cd5bf6
adjust recency interval (#326) 2023-08-17 10:37:17 -07:00