Commit Graph

30 Commits

Author SHA1 Message Date
xiuy001
b842d7ea72
added the create udfs for traces (#817) 2024-02-13 15:10:44 -05:00
drethereum
fdf8ca1f1a
add/decoder-udf (#770)
add old decoder udf
2023-11-30 16:16:26 -07:00
drethereum
5b0351567b
AN-4078/upgrade-decoded-logs (#755)
* upgraded decoded logs and removed old udf

* update package for fsc-utils test

* blur and x2y2 updates

---------

Co-authored-by: sam <sam@flipsidecrypto.com>
2023-11-15 11:44:16 -07:00
Matt Romano
73ea9d2ed1
AN-3464/utils-macros-update (#609)
* update package version repoint macros and tests

* fix function delete

* remove udf to hex with inputs

* 1.4.1 update
2023-07-18 15:19:49 -07:00
drethereum
283c7fde43
update/fsc-utils (#576)
* updated package version

* updated workflows

* env

* main

* inputs

* create udfs
2023-06-06 13:12:56 -06:00
Julius Remigio
a07401febb
AN-3303/datashares-macro (#559) 2023-05-24 14:54:25 -07:00
Austin
8d9ebbc618
Event abis2 (#540)
* range based

* change partition

* event abis

* remove incremental

* add udf

* remove column

* edit macro

* handle tuples

* stash

* handle tuples

* add event name udf and renamed functions

* remodel
2023-05-16 13:55:46 -04:00
xiuy001
db707035aa
An 2032/an 2033/committees sync committees (#283)
* push the update of the committees dbt table models

* push updated table changes to dev

* initiate the committees run

* update

* updated

* removed some unused tables

* updated the path

* updated

* updated

* updated the streamline call

* updated

* updated the naming thing

* updated

* removed redundnent code

* updated

---------

Co-authored-by: yulike <xiuyangguan@gmail.com>
2023-02-16 16:10:05 -05:00
xiuy001
ac3381a526
An 2027 ethereum pos receipts reads (#373)
* updated

* added the models for the receipts dbt

* updated

* updated

* updated

* removed the traces

* updated naming conversion

* updated naming

* added the traces models

* updated the parameter

* tuned the parameters
2023-02-06 13:40:00 -05:00
Austin
57c1e166e6
An 2605/decoded data (#327)
* decoded data

* rename

* - update udf to check if value is a list

* - add try/except in udf_transform_logs

* - add schema paraemter when calling macro for decoding logs

* - fixed transform udf

* - removed extraneous list for transformed events

* - removed unused variables in transform_logs macro

* - fixed dupe transformed events

* - removed nesting of components

* updates

* remove array check

* docs

* docs

Co-authored-by: Julius Remigio <14811322+juls858@users.noreply.github.com>
2022-12-21 16:16:11 -05:00
Julius Remigio
105fcaf7ca
AN-2470/decoder-view (#291) 2022-12-15 12:55:17 -08:00
drethereum
bd5d4a4a33
AN-2390/update-vars-udf-sps (#265)
* added project level variable and associated IF statements to on-run-start macros to default UDF/SP updates to False

* removed users file
2022-11-11 08:49:56 -07:00
Julius Remigio
b3c62e6e0b
AN-2293/AN-2029/PL-170/data-decoding (#253) 2022-11-09 11:46:22 -08:00
Ryan-Loofy
9435790060
Hotfix (#239) 2022-10-28 15:50:03 -04:00
Ryan-Loofy
aa37bdcf63
Added DBT UDFs (#237)
* Added DBT UDFs

- added Macros for: call_node, call_api, call_read_batching

* Overloading call node UDF + updated parameters

* Rename to udf_api

* Updates parameters for read batching udf

* Add method as a parameter

* - rename udfs

* - rename

Co-authored-by: Julius Remigio <14811322+juls858@users.noreply.github.com>
2022-10-28 15:29:14 -04:00
Ryan-Loofy
43ea5d3605
updated blocks, transactions, and beacon blocks models (#221)
* updated blocks, transactions, and beacon blocks models

- added post hooks to history and realtime models
- added instructions in readme for using variables
- updated naming conventions

* disable models
2022-10-05 17:42:43 -04:00
Anthony G
e3d0e469f9
streamline eth v1 blocks, txs & beacon blocks (#188)
* streamline eth v1 blocks

* - added sources file for bronze external table
- updated complete, and realtime models
- added history and beacon blocks model
- added macros and udfs for beacon blocks model

* blocks and transactions files added, sources updated

* updated blocks, transactions, and beacon blocks

- updated blocks, transactions, and beacon blocks
-  added udfs for hitting the node directly and keeping up with chainhead from snowflake

* comment out post hooks

* updated to jinja sql

* deleted post hooks

* added comment with start block for eth 2

* use height instead of block number

* delete streamline transactions

* reaname to blocks and transactions

Co-authored-by: Ryan-Loofy <63126328+Ryan-Loofy@users.noreply.github.com>
2022-10-04 21:16:34 -04:00
Ryan-Loofy
e41c853e5f
Added Streamline models for Contract ABI Model (#157)
* Added Streamline models for Contract ABI Model

* Bug where NULL contract addresses show up for failed transactions

* Added block number to contract abis model

* Update Partition Function

* Fixed partition function

* Squashed commit of the following:

commit 2b7b8f51a7
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Fri Sep 2 11:43:58 2022 -0400

    synths and curve pools (#180)

commit a5e7301a85
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Thu Sep 1 15:23:37 2022 -0400

    An 1540/final reads pivot (#179)

    * stash

    * market stats

    * stash

    * stash

    * remove test file

    * compound

    * more curve reads

    * remove bronze token reads

    * final changes

    * docs

    * commit

    * docs final

    * jinja

commit b6ccfe50fc
Author: Vahid-flipside <98771482+Vahid-flipside@users.noreply.github.com>
Date:   Wed Aug 31 15:53:02 2022 -0400

    An 1980/improving sushi tables (#178)

    * improving borrowing and lending tables

    * formatting

commit bb5f8327d0
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Wed Aug 31 12:53:08 2022 -0400

    creator fee change (#177)

commit a533ca9fbb
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Wed Aug 31 11:27:08 2022 -0400

    updates (#176)

commit 6b7feb6040
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Tue Aug 30 21:16:07 2022 -0400

    An 1982/optimize complete balances (#175)

    * change partition

    * parition

    * update

commit 0241b788c7
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Tue Aug 30 17:38:03 2022 -0400

    fix (#174)

commit 275a46659b
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Tue Aug 30 16:42:51 2022 -0400

    An 1540/uni pivot (#172)

    * stash

    * stash

    * stash uni

    * tests + docs ymls

    * docs

    * stash

    * stash

    * - add modified date to bronze.reads

    * stash

    * final

    * udfs

    * Hex_to_int macros added to same file, NULL test case considered in both clauses

    * Changed keyword, made inputs case insensitive

    * Formatting error

    Co-authored-by: Julius Remigio <14811322+juls858@users.noreply.github.com>
    Co-authored-by: Ryan-Loofy <63126328+Ryan-Loofy@users.noreply.github.com>

commit e67f95c534
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Mon Aug 29 15:47:11 2022 -0400

    An 1959/sudo fee (#168)

    * fix fees

    * new seaport fee contract

    * token fees

commit d99e7a52c5
Author: Julius Remigio <14811322+juls858@users.noreply.github.com>
Date:   Sun Aug 28 00:00:55 2022 -0700

    - fix space in virtual column name

commit 8f95f3727d
Author: Julius Remigio <14811322+juls858@users.noreply.github.com>
Date:   Sat Aug 27 23:58:23 2022 -0700

    - convert None to null

commit 2896657df8
Author: Julius Remigio <14811322+juls858@users.noreply.github.com>
Date:   Sat Aug 27 23:37:13 2022 -0700

    - correctly handle nulls

commit d26ec3a9a9
Author: Julius Remigio <14811322+juls858@users.noreply.github.com>
Date:   Fri Aug 26 20:12:11 2022 -0700

    AN-1910/optimize-streamline-reads (#169)

    * - add limit 1 to streamline post hook queries
    - only update udfs if they don't exist
    - use if/else in clone sproc

    * - add grant usage on schemas and database

    * - remove commented code

    * - fixes

    * - removed extraneous where clause

    * - removed commented code

    * - revert

commit bb1d715fc6
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Fri Aug 26 09:15:11 2022 -0400

    tweak block test (#167)

commit 6f178b11c9
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Thu Aug 25 20:04:59 2022 -0400

    convert to hex (#166)

    * convert to hex

    * more x

    * max

commit d39caab469
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Thu Aug 25 19:28:49 2022 -0400

    fix view mistake (#165)

commit 67f657555e
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Tue Aug 23 15:22:21 2022 -0400

    turn back on tests (#162)

commit 036b23fd0b
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Tue Aug 23 11:32:16 2022 -0400

    An 1874/sudo swap (#160)

    * sudo model

    * docs and tests

    * model final

    * docs

    * remove

commit dd92edddc7
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Mon Aug 22 22:19:31 2022 -0400

    registered (#159)

commit 01158b242d
Author: Austin <93135983+austinFlipside@users.noreply.github.com>
Date:   Mon Aug 22 19:42:00 2022 -0400

    incremental improvements (#158)

Co-authored-by: Julius Remigio <14811322+juls858@users.noreply.github.com>
2022-09-06 14:37:19 -04:00
Austin
275a46659b
An 1540/uni pivot (#172)
* stash

* stash

* stash uni

* tests + docs ymls

* docs

* stash

* stash

* - add modified date to bronze.reads

* stash

* final

* udfs

* Hex_to_int macros added to same file, NULL test case considered in both clauses

* Changed keyword, made inputs case insensitive

* Formatting error

Co-authored-by: Julius Remigio <14811322+juls858@users.noreply.github.com>
Co-authored-by: Ryan-Loofy <63126328+Ryan-Loofy@users.noreply.github.com>
2022-08-30 16:42:51 -04:00
Austin
968e1b9a66
An 1746/compound reads views (#127) 2022-08-12 16:13:28 -07:00
Julius Remigio
cad43293ea
AN-1824/optimize-streamline-posthook (#121) 2022-07-26 18:37:14 -07:00
Ryan-Loofy
081c2c9abd
An 1682/eth balances lambda view (#107)
* stage view

* eth balances lambda views

* add udfs

* - add udfs for token balalnces history, realtime

* - fix virtual column name

* - fix virtual column name

* - fix partition by bug in real time views

* added configuration files and eth balances streamline udfs

* - add historical loads to real time view

* got rid of extra underscore

* - removed history udfs

* - removed spaces from column name

* - removed extra comma

* - fixed external table indent
- fixed column names

* change incremental

* - removed unused config parameters

* updating create udfs macro

Co-authored-by: austinFlipside <austin@flipsidecrypto.com>
Co-authored-by: Julius Remigio <14811322+juls858@users.noreply.github.com>
2022-07-19 12:58:11 -04:00
desmond-hui
3fc6d2593d
add community dev and dbt container (#108) 2022-07-13 14:41:28 -04:00
Julius Remigio
0d06d9948b
AN-1586/erc20-balances-streamline (#104)
* commit

* update

* - renamed folder, file

* - fixed streamline view
- renamed schema, table

* - removed extra columns from model
- add clustering

* - set streamline model to not update columns

* - create external table for token_balances

* comment

* - split streamline view to historical, realtime

* - fix cte references

* - renamed cte

* - fixed column reference bug

* - use table alias

* add deposits and use topics for addresses

* - corrected unique_key

* filter for weth

* - fixed bronze.token_balances
- add except clause to steramline.token_balances
- add date filter to only check the last completed day

* completed records silver model

* - removed figment from source path

* - removed figment from external table path

* - add udfs, sps for streamline.token_balances

* - moved exclude clause to view

* -cleaned up quotes

* - create sub project for erxternal tables
- bug fixes
- created new bronze source for external tables

* - bug fixes

* - add bronze sub-project info to readme.MD

* inserted

* - added prehook

* - hard coded table name in pre-hook

* - added indent

* - updated target folder to use parent directory

Co-authored-by: austinFlipside <austin@flipsidecrypto.com>
2022-07-06 12:53:25 -04:00
Julius Remigio
359b43dc5e - created schema parameter
- removed redundant public macro
2022-05-27 09:38:26 -07:00
Julius Remigio
7aa76acc75 - create python udf
- clean up create_udfs.sql
- clean up macro names for creating udfs
2022-05-26 18:53:42 -07:00
Desmond Hui
9e8b543995 ingest 3rd party nft metadata as external table api integration 2022-04-18 14:00:13 -07:00
austinFlipside
fb999dbbf1
Add/new tables (#13) 2022-03-02 13:12:01 -08:00
austinFlipside
d681d23b19 updates, deleted a comment in code too 2022-02-17 20:25:14 -05:00
austinFlipside
c02f3cdfc3 hex updates 2022-02-16 19:51:00 -05:00