desmond-hui
2e0dc81b00
add community curation resources ( #138 )
2022-10-18 13:09:55 -07:00
Desmond Hui
5fcc87f95d
fix regular incemental for daily signers
2022-10-17 17:02:50 -07:00
Desmond Hui
a6d4c7c614
do more days per batch now that the data is more evenly distributed
2022-10-17 14:08:38 -07:00
Desmond Hui
b360766cb4
remove ;
2022-10-17 10:39:33 -07:00
Desmond Hui
fda9375072
fix batch load issue for 1 day at a time
2022-10-17 10:39:25 -07:00
jkallogjeri
d364e86997
Hadeswap NFT sales ( #129 )
...
* Hadeswap NFT sales
* added to ez table
* incremental fix
* removed ingested_at
* incremental blob + program date
* reverting to original incremental blob
* fix dups
Co-authored-by: jhuhnke <jessica@flipsidecrypto.com>
2022-10-16 15:04:44 -05:00
Jessica Huhnke
8083bb8902
An 1903/signers ( #119 )
...
* signers table wip
* merge main and remove test addresses
* flatten signers and instructions arrays
* daily signers wip
* signers wip, some test failures
* incremental model changes
* incremental changes - dumped FR date limit
* exclude chain admin programs
* updates to incremental
* updates to tests
* incremental fixes
* and condition
* changes to incremental and formatting
* updates to incremental
* remove ver2 references
* remove unintended change
* add upper bound for _inserted_timestamp for downstream ctes
* do 1 day loads
* update docs
Co-authored-by: Desmond Hui <desmond@flipsidecrypto.com>
2022-10-14 17:38:20 -07:00
desmond-hui
01d954f945
expose address table lookups col ( #135 )
...
* expose address table lookups col
* add col description
2022-10-14 12:33:07 -07:00
desmond-hui
075f2bb493
output gap range instead of single block id ( #134 )
2022-10-14 11:04:47 -07:00
desmond-hui
24abba5782
fix references ( #133 )
2022-10-13 16:09:13 -07:00
desmond-hui
c29d990444
An 2145/fix tests ( #132 )
...
* deprecate test no longer have tx_count col
* add block filter for null test
* rename
2022-10-13 15:31:34 -07:00
desmond-hui
9d6841fabb
change v2 references ( #131 )
2022-10-13 11:48:55 -07:00
desmond-hui
d573bf32cb
An 2145/hot swap ( #130 )
...
* update table references
* rename of *2 models
* swap old and *2 models; update refs
* An 2145/add error col to completed log (#126 )
* add error column to completed table output
* fix group by
* add error column for completed blocks update
* auto fill block gaps
* gap test for blocks2
* re-request missing txs real-time
* test for bronze to silver data load
* add error col, match updated
* test for missing partition in transactions or votes
* test for tx gaps in streamline data
* exclude partition 1877
* fix group by
* remove hardcoded prod db references
* change v2 references to v1
* make version change same as main
* no longer need historical staking lp actions, included in regular model (#128 )
* no longer need historical staking lp actions, included in regular model
* remove additional resources related to historical staking lp actions
* avoid name clash, remove duplicate test
* remove ingested_at from models
* tx_count no longer a col
* remove invalid condition, col didnt exist
* remove min block_id filter
* remove deprecated columns
Co-authored-by: tarikceric <tarik@flipsidecrypto.com>
2022-10-13 11:19:41 -07:00
desmond-hui
7875c613b1
add transaction version col ( #127 )
2022-10-12 10:20:49 -07:00
tarikceric
fd46fe1779
An 2258/tests for streamline based models ( #125 )
...
* Consistent range for block_timestamp filter
* yml files for new streamline models
* yml and update block_id for owner test
2022-10-10 13:40:20 -07:00
tarikceric
4e9c126266
An 2143 nft models from streamline data ( #124 )
...
* An 2143/Initial commit of new NFT models
* Remove unnecessary tables
* update filtering in existing models
* create nft model from streamline source
* create model from streamline source
* remove unnecessary join
* remove block_timestamp filter
* consistent filtering to block_timestamp
* Create models from streamline and update existing
* fix filter range and update from prev changes
* use silver_events2 table
2022-10-07 18:19:02 -07:00
desmond-hui
c84a168f84
An 2240/hot swap transfers ( #123 )
...
* same change as transactions2
* swap transfers2 with transfers
2022-10-07 10:36:25 -07:00
desmond-hui
e3c5ddc6af
An 2142/adjust test conditions ( #122 )
...
* set null threshold test on wrong column
* results from earlier blocks can have no event type
2022-10-07 08:32:52 -07:00
Desmond Hui
f141369c19
index now string, default 9 decimal places
2022-10-06 16:37:52 -07:00
desmond-hui
cf75e9f70f
fix nft seller issue, add output test cases ( #121 )
2022-10-06 15:08:08 -07:00
tarikceric
2fc597d0ff
An 2142 lpactions and transfers from streamline data ( #120 )
...
* Initial commit of models
* update model filters
* Update block_id range
* Revise per PR comments
* Select from events2 and 'succeeded' col
* Fix full-refresh error
* Update tests
* Fix conditional 'and' statements
* revise block_timestamp test
* Edit block start range
* Add 'transferWithSeed' event_type
2022-10-06 12:02:30 -07:00
desmond-hui
5c5ab8bffc
An 2216/votes2 test failures ( #115 )
...
* wip
* update tests
2022-10-06 11:35:35 +08:00
Jessica Huhnke
83aae2dad4
change labels reference to xchain repo ( #118 )
2022-10-06 11:29:44 +08:00
tarikceric
8b6e2719e3
An 2142 lpactions and transfers from streamline data ( #117 )
...
* Initial commit of models
* update model filters
* Update block_id range
* Revise per PR comments
* Select from events2 and 'succeeded' col
* Fix full-refresh error
* Update tests
* Fix conditional 'and' statements
* revise block_timestamp test
* Edit block start range
2022-10-05 16:35:19 -07:00
tarikceric
c4b6268a74
An 2142 lpactions and transfers from streamline data ( #113 )
...
* Initial commit of models
* update model filters
* Update block_id range
* Revise per PR comments
* Select from events2 and 'succeeded' col
* Fix full-refresh error
* Update tests
* Fix conditional 'and' statements
* revise block_timestamp test
2022-10-05 15:55:34 -07:00
desmond-hui
43cdef6fb4
get block timestamp from bronze when available ( #116 )
2022-10-05 14:26:25 -07:00
Desmond Hui
35ca0a3d72
increase batch load max slot
2022-10-03 08:46:35 -07:00
Desmond Hui
3bb1a1a739
increase batch load max slot
2022-10-03 08:45:40 -07:00
desmond-hui
d6baa134d4
An 2140/events model from streamline data ( #111 )
...
* events2 model and new udf to get list of programids from inner instructions
* test file
2022-09-22 09:55:45 -07:00
desmond-hui
39f6997d38
lock amt located in diff part of json ( #110 )
2022-09-22 08:52:23 -07:00
Desmond Hui
7b0e6e6009
change min block_id range for inner_instructions2
2022-09-21 10:28:32 -07:00
desmond-hui
d1c1800a11
older blocks dont have timestamps or fees ( #109 )
2022-09-19 16:20:25 -07:00
Desmond Hui
19c82ca33b
remove external table refresh, now handled by lambda
2022-09-19 15:03:58 -07:00
desmond-hui
58d1853c87
An 2141/internal silver models ( #108 )
...
* wip
* add max backfill date/block, include pyth oracle programs
* inner instructions model
2022-09-19 10:44:51 -07:00
desmond-hui
7d4de39991
add candy machine v1 to mints model ( #107 )
2022-09-18 14:50:16 -04:00
Desmond Hui
952340e417
hotfix remove semi-colon
2022-09-16 11:14:45 -07:00
desmond-hui
abaaa55dd2
pretty much all blocks before this have null timestamps ( #106 )
2022-09-16 10:46:36 -07:00
desmond-hui
e369cf0968
make real time gap buffer larger ( #105 )
2022-09-16 08:33:50 -07:00
desmond-hui
74f1ac7159
add macros to refresh tables in streamline database ( #104 )
2022-09-15 08:26:45 -07:00
desmond-hui
8a00a94959
An 2134/migrate external tables ( #103 )
...
* reference new external table location
* delete line
* change warehouse
2022-09-15 07:38:07 -07:00
desmond-hui
af2ce900af
An 1605/nft mints refactor ( #102 )
...
* refactor nft mints model
* An 1949/bt (#95 )
* date limit some program
* block timestamp
* fixes
* fix
* An 1937/blocks txs2 (#94 )
* blocks
* transactions and deduping wip
* silver reorganization
* remove tx count from blocks
* wip
* load blocks backfill incrementally
* wip
* wip
* wip
* remove unused comments
* fix ref to wrong table
* update to tests
* test fixes
* moved yawww bids
* merge main & fix refs
Co-authored-by: Desmond Hui <desmond@flipsidecrypto.com>
* description updates (#96 )
* fix missing incremental block (#97 )
* reduce batch load size (#98 )
* Adjust tx2 incremental load size (#99 )
* reduce batch load size
* revert change
* revert change
* minor cleanup and add model output comparison test
* move models to nft folder
* add test case
* update/add descriptions and tests
* adjust unique key
* adjust unique key, add columns to output
* add alias for new tx_id name from underlying model
* add index + inner_index to output and unique key
* remove inner index test
* fix unique key
Co-authored-by: Jessica Huhnke <91915469+jhuhnke@users.noreply.github.com>
2022-09-14 07:50:59 -07:00
tarikceric
b57c7144e3
Solana votes2 ( #100 )
...
* Create votes2 model
* Create yml file
* Remove unnecessary comments
* Remove instruction columns
* Add _partition_id column
* Remove test for _partition_id
2022-09-13 15:22:02 -07:00
desmond-hui
00875ce3ae
add boolean as possible param data type for clone ( #101 )
2022-09-13 10:55:18 -04:00
desmond-hui
5c9d5c33b7
Adjust tx2 incremental load size ( #99 )
...
* reduce batch load size
* revert change
* revert change
2022-09-12 13:27:04 -04:00
desmond-hui
273e7c6427
reduce batch load size ( #98 )
2022-09-12 08:16:41 -07:00
desmond-hui
f7c55fa546
fix missing incremental block ( #97 )
2022-09-09 10:35:54 -07:00
Jessica Huhnke
2af06a3d4a
description updates ( #96 )
2022-09-08 09:52:01 -05:00
Jessica Huhnke
bb9e889004
An 1937/blocks txs2 ( #94 )
...
* blocks
* transactions and deduping wip
* silver reorganization
* remove tx count from blocks
* wip
* load blocks backfill incrementally
* wip
* wip
* wip
* remove unused comments
* fix ref to wrong table
* update to tests
* test fixes
* moved yawww bids
* merge main & fix refs
Co-authored-by: Desmond Hui <desmond@flipsidecrypto.com>
2022-09-07 13:52:44 -05:00
Jessica Huhnke
c324ce8834
An 1949/bt ( #95 )
...
* date limit some program
* block timestamp
* fixes
* fix
2022-09-07 12:59:51 -05:00
desmond-hui
266f1d325d
Revert task changes ( #93 )
...
* revert task changes temporarily add real time call to historical
* missed a section for txs
* adjust schedule/warehouse
2022-09-02 14:16:32 -07:00
