Commit Graph

60 Commits

Author SHA1 Message Date
tarikceric
8e76743e00
add additional cols (#885)
Some checks are pending
docs_update / run_dbt_jobs (push) Waiting to run
docs_update / notify-failure (push) Blocked by required conditions
2025-10-30 14:11:10 -07:00
tarikceric
2b6ddb3070
sol daily balances (#880)
Some checks failed
docs_update / run_dbt_jobs (push) Has been cancelled
docs_update / notify-failure (push) Has been cancelled
dbt_run_streamline_solscan_token_list / run_dbt_jobs (push) Has been cancelled
dbt_run_streamline_solscan_token_list / notify-failure (push) Has been cancelled
dbt_test_scheduled_weekly / run_dbt_jobs (push) Has been cancelled
dbt_test_scheduled_weekly / notify-failure (push) Has been cancelled
* sol daily balances

* update tests

* update daily run and balances schedule
2025-10-02 20:35:59 -07:00
tarikceric
b85031957d
An 6559/daily balances (#879)
Some checks failed
docs_update / run_dbt_jobs (push) Waiting to run
docs_update / notify-failure (push) Blocked by required conditions
dbt_run_full_observability / run_dbt_jobs (push) Has been cancelled
dbt_run_full_observability / notify-failure (push) Has been cancelled
* initial table

* update logic

* comment fix

* update test
2025-09-30 12:28:51 -07:00
tarikceric
af5e5c5037
update desc for validator amount (#875) 2025-09-16 14:30:32 -07:00
tarikceric
0472a10772 hot fix validator amounts desc 2025-09-12 13:29:05 -07:00
tarikceric
dc0ab1e01c
An 6526/docs example queries (#870)
* wip

* add sample queries to docs
2025-09-11 12:15:13 -07:00
tarikceric
cc57d44fac
An 6497/lending (#868)
* marginfi and kamino lending tables

* update deposits desc

* add verified tag
2025-09-02 14:02:08 -07:00
tarikceric
9dcb0e154e
update desc for ez_transfers; update transactions (#866) 2025-08-19 13:39:59 -07:00
tarikceric
e6437be363
An 6390/llm descriptions 3 (#860)
* gov descriptions

* marinade descriptions

* cleanup
2025-07-22 10:18:18 -07:00
tarikceric
0e6407486d
An 6390/llm context descriptions 2 (#859)
* update defi table desc

* complete defi table update

* move col desc to folder; add nft docs

* cleanup
2025-07-17 15:29:52 -07:00
tarikceric
5399165667
An 6390/llm context descriptions (#855)
* description rules and fact_txs update

* blocks update

* idls and labels

* wip

* wip

* update desc

* update

* update doc rules

* update table desc per new rules

* updates
2025-07-16 12:26:39 -07:00
tarikceric
ec1f2c24ff
add ez_transfers (#856) 2025-07-10 09:15:55 -07:00
tarikceric
e871c9419c
verified pricing (#854)
* verified pricing

* revert source

* add ez bridge; coalesce for verified

* use coalesce

* use correct bridge cte
2025-07-01 15:54:24 -05:00
tarikceric
5203eae745
add swaps faq links (#844) 2025-05-21 12:42:22 -07:00
tarikceric
ddd8be51a9
An 5709/ez liquidity pool actions (#814)
* wip

* wip

* update tests and models

* update overview and inc

* cleanup; adjust tests

* add raydium stable

* clean up
2025-03-12 11:50:36 -07:00
tarikceric
77d51bd5df
An 5755/gold ez nft sales (#811)
* docs update

* silver and gold tables

* reformat

* clean up

* filter to suceeded sales

* coalesce for pk

* update desc

* join to metadata and use set sol var
2025-03-12 11:44:10 -07:00
tarikceric
65ad7eac1e
add marinade (#770) 2025-01-14 09:11:50 -08:00
desmond-hui
c923480751
Marinade native stakers remap withdraw authority (#746)
* (wip) map withdraw authority using recursion

* WIP v2 staking upstream models

* fix issue with vote accounts and formattiing

* fix inner index expected values

* add docs for common columns

* initial schema

* add native 1 acct, fix dupes, add usd

* initial schema and tests

* add withdraw amount, recency test

* convert lamports to decimals

* add flag for whether still using marinade

* PR feedback

* PR fix

* tmp update to load next batch

* revert tmp change

* revert

* add to scheduler
2025-01-08 08:30:48 -08:00
desmond-hui
1dcd928f73
Orca v2 lp actions (#750)
* wip model

* initial schema and tests

* update unique key

* separate out single token actions to their own cte

* formatting

* add to scheduler
2025-01-07 21:03:49 -08:00
desmond-hui
360d093313
Orca v2 lp initialization model (#747)
* initial model using decoded instructions

* initial schema and tests

* remove from scheduler

* add pool token mint
2025-01-07 07:05:43 -08:00
desmond-hui
b4a953cbf9
add tx_index for data sourced from streamline 2.0 (#738)
* add tx_index for data sourced from streamline 2.0

* update tests and descriptions
2024-12-16 07:54:50 -08:00
tarikceric
b22caeab39
An 4528/events inner (#655)
* initial silver models

* create gold tables

* backfill

* incremental backfill runs

* update run interval

* update tests

* removed filter

* updated per pr comments

* update backfill and cluster/so

* update gold inc filter

* backfill updates

* clean up

* disable fr and update backfill date

* update backfill logic

* correct filter date
2024-09-19 10:53:14 -07:00
tarikceric
ae998cfea2
update swaps docs (#621) 2024-07-25 09:20:17 -07:00
tarikceric
ebfd7c2d56
update jupiter swaps docs (#608) 2024-07-16 08:49:25 -07:00
tarikceric
2bb777668f
balance models (#585)
* balance models

* clean up

* remove 0 balance changes; set null balances to 0

* temp backfill

* remove temp filter

* incremental

* col desc,update cluster and tests

* remove change

* clean

* add col to SO
2024-06-21 12:27:05 -07:00
tarikceric
8d19961ce6
Cleanup/decrease test time and docs update (#584)
* update docs

* update test range

* revert test
2024-06-17 10:46:30 -07:00
desmond-hui
d5d5dfdea0
Silver decoded logs (#586)
* udf to grab program data logs from log messages

* output table with encoded program data in tx logs

* add comments

* setup views and source

* update tag

* wip realtime view

* wip

* fix bad join

* wip

* decoded logs

* add event_type, index, inner_index and refactor existing

* handle additional nested calls

* add columns, add to SO

* use backfill macro

* handle non-contiguous program log messaging

* add log index description

* wip schema

* fix macro name

* add desc and tests for more columns

* refactor logic

* add descriptions

* remove unnecessary offset

* remove commented out code from schema

* add scheduler
2024-06-13 08:27:32 -07:00
desmond-hui
c0d866b4fd
An 4800/tensorswap refactor (#553)
* (wip) initial model

* remove testing lines, add depends on comment

* handle more than  one sale per tx

* separate sol escrow from margin account

* use min_price as sale price for bid sales

* fix column name

* add model docs and tests

* add caveat for tensorswap sales amount description

* add business logic tests
2024-05-08 09:01:42 -07:00
tarikceric
da0fa3a38d
update pricing table name and cols (#503)
* update pricing table name and cols

* update source

* union all

* wip

* sources + documentation

* updat source

* wip

* change name to dim_asset_metadata

* change name to fact_prices_ohlc_hourly

* update prices table/col descriptions

* update view logic to match latest template

* update

* fix ambiguous column

* ez stats update

* ez fix

---------

Co-authored-by: Desmond Hui <desmond@flipsidecrypto.com>
Co-authored-by: Eric Laurello <eric.laurello@flipsidecrypto.com>
2024-05-01 16:01:56 -04:00
tarikceric
1fbf84441f
update idl table (#537)
* update idl table

* add union for idl_hash change

* col desc

* update per pr comments

* rename
2024-04-18 10:12:16 -07:00
tarikceric
ac4d0d8c9e
An 4638/cnft sales (#536)
* tensor swap models

* update code style

* fix

* update tensorswap cnft sales

* update per pr comments

* update logic for mint and transfers, add relationship test

* add relationship test
2024-04-18 07:46:01 -07:00
tarikceric
82e6374925
An 4547/solana stats (#495)
* stats table

* add stats

* clean up

* remove extra model

* fix else clause

* get count from blocks

* add scheduling tag
2024-02-26 11:49:58 -08:00
tarikceric
5168e93fd6
change labels sources and updates (#474)
* new crosschain sources and updates

* add labels yml file
2024-02-01 10:42:30 -08:00
desmond-hui
73a2d32f29
An 4323/initial streamline 2.0 setup (#430)
* wip

* change udf name, fix surrogate key for inner instruct calls

* (wip) decoded instructions backfill helpers

* complete backfill helpers, clean up views with 0 requests

* rename

* revert

* temp change will revert

* rename

* use streamline 2.0 verify idl api endpoint

* this is placeholder model, will replace existing when ready

* reorg files

* add workflow for decode instructions real time

* use pip cache

* update with prod endpoints

* update sql limit to real value, should be union all

* use ref for model names

* remove placeholder, replace existing model logic

* add new decoder flow to gha

* temp disable incremental

* add inner index to core tables

* match existing behavior until we properly incorporate inner_instruction txs

* temp disable
2024-01-03 11:40:57 -08:00
tarikceric
eb0898d11c
An 4136/nft collection names (#409)
* wip

* move logic to silver

* gold table and job

* update core table

* include new and old cols in gold

* incremental logic

* adjust number of calls

* add cluster

* update surrogate key name + remove edition

* cleanup, update surrogate name

* update udf_api, add solscan_collection col

* add pk description

* remove loop and case for pk, fix udf_api prefix

* revert

* pass collection to get name

* add qualify

* add loop

* update loop size

---------

Co-authored-by: Desmond Hui <desmond@flipsidecrypto.com>
2023-11-29 16:55:44 -08:00
tarikceric
891100d4b6
An 4089/block rewards (#395)
* wip

* seperate silver models and create core

* update tag and desc

* update per pr comment

* use prod db source

* adjust fr partition range

* add batc load var

* add gold col descriptions
2023-11-10 15:03:43 -08:00
tarikceric
81b004df53
An 3931/token nft burn mint actions (#360)
* wip

* silver and core tables

* add description

* wip updates

* update location and nft_mint_actions

* update logic

* optimize filter and add _inserted_timestamp

* select metaplex events and join to

* update per pr comments

* add back in program filter
2023-10-16 12:04:13 -07:00
tarikceric
76bd1e26f0
An 3900/gold mint and burn actions (#342)
* add descriptions

* burn and mint action core models
2023-09-07 12:53:16 -07:00
tarikceric
337d59f3c4
An 3784/schema reorg (#331)
* reorg update

* cleanup

* reformat

* update overview

* match gold update
2023-08-31 09:35:36 -07:00
tarikceric
b72bd178d3
update tags/docs (#321) 2023-08-02 17:56:35 +02:00
tarikceric
0ce90d9180
Update docs (#302)
* update docs and model descriptions

* update amount desc
2023-06-06 11:48:04 -07:00
tarikceric
2560502fe7
fix links (#272) 2023-03-08 12:30:29 -08:00
tarikceric
39eee681c3
add doc overview page (#271) 2023-03-08 11:34:07 -08:00
tarikceric
81f5e54399
An 2787/new nft sale program (#265)
* add instant_sell model

* marketplace description

* model creation

* add test cases

* finalize logic

* exclude instant_sell model

* update amm_sell model name
2023-02-28 11:47:57 -08:00
tarikceric
4bf749bcb7
An 2663/orca lp actions (#249)
* initial models

* descriptions for liquidity pool columns

* WIP

* get mints that occur during swaps

* correct description tag

* update ymls

* correct model references

* update yml

* update model references and column names

* update incremental logic

* update yml definitions

* revise unique col combo

* wip

* remove null amounts

* additional filter

* add index+inner_index to unique key

* create final joined table

* set inner_index to -1 instead of null

* inner_index refactoring

* additional tests

* exclude models from incremental
2023-02-15 08:57:34 -08:00
desmond-hui
70c5c016a5
An 2297/aggregated swaps (#178)
* create testing data

* table w failed and successful txfers

* initial model

* create transfers2 and testing data

* add expected results

* testing additions

* check-in

* remove not-null requirement

* add business test cases, simplify, need acct owners

* wip

* clean tests and update model

* update model for edge cases

* fix expected test case

* check in

* logic for unordered swaps

* create single model for all dex swaps

* check in updates

* remove mint actions

* general model

* remove jup v4

* clean up

* update transfers2

* update name

* test that specific tx are excluded

* initial changes per pr comments

* add program_id

* Add base_events and combine union

* uncomment incremental logic

* move block_id filter to base_events

* remove flatten, map accounts directly to transfer to/from

* filter out non-swap actions and fix join logic

* remove raydium logic and rename

* remove raydium swap in test

* Include TRPY swaps

* update table config

* add program_id column to yml

* initial aggregated swaps model

* remove dependency on csv for tx excluded test

* remove duplicate test case

* add additional test records

* updates per PR comments

* remove dependency of excluded tx test on csv

* remove unnecessary program_id

* remove orca dex references

* additional inner join logic

* query cleanup/formatting

* add test cases

* add back delegate mapping for saber + test cases

* An 2455/intermediate swaps raydium (#161)

* Intermediate swaps model for raydium

* add test cases, remove unnecessary filter and hook

* tweak event filters and join optimizations

* revisions per pr comments

* update excluded tx tests and remove csv dependency

* add token accts

* add test cases, round amts to 8 decimals

* use associated accts given in swap instruction

* handle multisig authorities

* add test case

Co-authored-by: Desmond Hui <desmond@flipsidecrypto.com>

* include raydium, update test cases

* formatting

* add reusable swap col descriptions

* add test cases from other intermediate models

* fix dupes, add tests

* use new silver model and dim labels

* remove unused transfers2 model

* add missing test case

* update demo share

Co-authored-by: tarikceric <tarik@flipsidecrypto.com>
Co-authored-by: tarikceric <46071768+tarikceric@users.noreply.github.com>
2022-12-08 12:46:43 -08:00
desmond-hui
8a8262e9ec
An 2324/stake pool actions (#147)
* intial lido model

* wip

* change action words, add more pools

* wip'

* redo deposit stake logic

* initial socean model

* stake pool column descriptions

* wip

* force dbt to 0.9.2

* fix model syntax, update test

* socean tests

* match output columns with other models, add tests

* marinade stake pool model

* update description to specify SOL

* initial core view

* eversol wip

* eversol actions and tests

* add core stake pool
2022-11-03 08:18:13 -07:00
desmond-hui
af2ce900af
An 1605/nft mints refactor (#102)
* refactor nft mints model

* An 1949/bt (#95)

* date limit some program

* block timestamp

* fixes

* fix

* An 1937/blocks txs2 (#94)

* blocks

* transactions and deduping wip

* silver reorganization

* remove tx count from blocks

* wip

* load blocks backfill incrementally

* wip

* wip

* wip

* remove unused comments

* fix ref to wrong table

* update to tests

* test fixes

* moved yawww bids

* merge main & fix refs

Co-authored-by: Desmond Hui <desmond@flipsidecrypto.com>

* description updates (#96)

* fix missing incremental block (#97)

* reduce batch load size (#98)

* Adjust tx2 incremental load size (#99)

* reduce batch load size

* revert change

* revert change

* minor cleanup and add model output comparison test

* move models to nft folder

* add test case

* update/add descriptions and tests

* adjust unique key

* adjust unique key, add columns to output

* add alias for new tx_id name from underlying model

* add index + inner_index to output and unique key

* remove inner index test

* fix unique key

Co-authored-by: Jessica Huhnke <91915469+jhuhnke@users.noreply.github.com>
2022-09-14 07:50:59 -07:00
Jessica Huhnke
b10f7897e1
An 1615 nft seller (#61)
* magic eden sellers

* opensea seller

* SMB seller

* solanart

* solport seller

* add column to core model

* fixes to ME models

* fixed backwards seller & purchaser

* changes to MEV1

* update purchaser

* fix col name ref

* updates to tests

* fix merge issue smb

* seller in solanart

Co-authored-by: Desmond Hui <desmond@flipsidecrypto.com>
2022-06-27 09:58:08 -05:00
desmond-hui
3a82774a82
An 1636/convert solana to use inserted timestamp (#60)
* setting to append new columns on incremental for existing models

* add _inserted_timestamp to applicable models

* update yml descriptions
2022-06-22 06:13:44 -07:00