Commit Graph

480 Commits

Author SHA1 Message Date
Jack Forgash
f174dc3cd4
add protobuf ver (#288) 2024-03-13 13:22:18 -06:00
Jack Forgash
490b0cdea3
add deps back (#287) 2024-03-13 13:19:07 -06:00
Jack Forgash
2f356f9403
del dbt deps (#285) 2024-03-13 13:12:22 -06:00
Shah Newaz Khan
3d493da486
Stream 803/throughput tune mn 18 (#283)
* add var read for invoke streams

* WIP throughput tune

* added mn 19 batch model

* remove transient tx-results-batch bronze table

* add concurent_requests

---------

Co-authored-by: shah <info@shahnewazkhan.ca>
2024-03-08 14:50:04 -08:00
Shah Newaz Khan
0d3128f868
Stream 798/tx batch tuning (#280)
* adds tx result batch make directive | bronze make directive

* batch tx_results success

* revert collections bronze scope

* revert tx results history bronze

---------

Co-authored-by: shah <info@shahnewazkhan.ca>
2024-03-04 13:33:25 -08:00
eric-laurello
5734a9b743
fix inc stats models (#281) 2024-03-01 14:40:47 -05:00
WHYTEWYLL
989fdb6cfa
add stats flow, gas pending (#279)
* add stats flow, gas pending

* fee to table

* stats flow

* fix float, schedule
2024-02-26 16:13:58 -03:00
WHYTEWYLL
3cc7463512
semicolumn (#278) 2024-02-21 07:21:05 -03:00
WHYTEWYLL
6b65655da8
Finetune (#277)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18

* reducing job

* var del

* increasing producer batch size

* increasing batch size and worker

* workers limit

* reducing producer

* add fin

* fix doubled key values
2024-02-20 12:07:10 -03:00
WHYTEWYLL
7384530ccf
Finetune (#276)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18

* reducing job

* var del

* increasing producer batch size

* increasing batch size and worker

* workers limit

* reducing producer
2024-02-15 20:03:40 -03:00
WHYTEWYLL
4a723f90c5
Finetune (#275)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18

* reducing job

* var del

* increasing producer batch size

* increasing batch size and worker

* workers limit
2024-02-15 19:18:36 -03:00
WHYTEWYLL
99d1e0812a
Finetune (#274)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18

* reducing job

* var del

* increasing producer batch size

* increasing batch size and worker
2024-02-15 19:07:37 -03:00
WHYTEWYLL
7c5cca0278
Finetune (#273)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18

* reducing job

* var del

* increasing producer batch size
2024-02-15 18:09:34 -03:00
WHYTEWYLL
1043c83d4f
Finetune (#272)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18

* reducing job

* var del
2024-02-15 17:08:45 -03:00
WHYTEWYLL
298a2530b9
Finetune (#271)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18
2024-02-15 13:10:51 -03:00
WHYTEWYLL
17191eacd0
Finetune (#270)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error
2024-02-14 15:07:30 -03:00
Jack Forgash
3261a09b4a
fix model selection in history (#269) 2024-02-13 19:06:27 -07:00
Jack Forgash
668b22097b
expliticly call putstanding NV and methods (#268) 2024-02-13 14:50:37 -07:00
Shah Newaz Khan
dbebfbf0a0
fix udf 2 api integration (#267)
Co-authored-by: shah <info@shahnewazkhan.ca>
2024-02-13 08:26:57 -08:00
WHYTEWYLL
35c6053bcd
Finetune (#266)
* test a from the base line on env var

* quotes
2024-02-13 11:30:01 -03:00
WHYTEWYLL
759836fc8d
An 4437 add or account for all day burned moments (#263)
* a

* filter previus attempts

* fix empty pack

* del filt

* severity adjust
2024-02-05 15:07:51 -03:00
WHYTEWYLL
6d53230f0a
Fix labels (#265)
* add deleted

* hotfix
2024-01-31 16:11:00 -03:00
WHYTEWYLL
39d17e3f12
add deleted (#264) 2024-01-31 14:20:56 -03:00
WHYTEWYLL
e7615a0cc6
Update labels (#262)
* a

* lavels source updated

* add core view

* unique id

* delete coalesces
2024-01-31 13:44:59 -03:00
WHYTEWYLL
1a6a72f5f2
An 4442 flow dbt1.7 (#261)
* pkg lock and dbt docs

* update: 1.7

* profile

* update docs

---------

Co-authored-by: forgash_ <jmfxyz@pm.me>
2024-01-30 15:44:19 -03:00
Jack Forgash
e3e9b6ec89
NFLAD Challenge - del dup wallets (#260)
* del 3/4 dup wallets

* del last
2024-01-22 12:02:30 -07:00
Jack Forgash
cb95faf856
beta view w rosters (#259) 2024-01-20 14:32:15 -07:00
Jack Forgash
e0818966ad
AN-4428/add user agent to topshot and upd metadata job (#258)
* add user agent to topshot and upd metadata job

* upd agent

* upd limit to 600
2024-01-18 09:19:18 -07:00
WHYTEWYLL
59b3a5b4b5
fix: parse (#248)
* fix: parse

* fix: hex parse

* fix: format

* add: fix

* delete: last month filter

* a

* fix: parser

* delete: date filter
2024-01-16 12:09:37 -07:00
WHYTEWYLL
2fe9333eea
add: user agent to not get ban (#257) 2024-01-10 14:29:37 -03:00
Jack Forgash
7c87cd4225
Beta allday espn id view (#255) 2024-01-05 12:57:55 -07:00
Jack Forgash
074c11c55a
fix id col in dim allday metadata (#253) 2024-01-04 09:03:25 -07:00
Jack Forgash
ed9f306241
upd schedule to hourly (#254)
* upd schedule to hourly

* revert allday metadata
2024-01-03 16:33:56 -07:00
Jack Forgash
b26bf67732
upd desc on views (#251) 2023-12-19 17:26:19 -05:00
Jack Forgash
6e666d29a7
upd history cron - daily (#250) 2023-12-19 16:09:14 -05:00
Jack Forgash
4c4ef12ca8
AN-4333/beta views for archiving espn ids for livequery use (#249)
* beta views for archiving espn ids for livequery use

* list cols
2023-12-19 13:40:30 -05:00
WHYTEWYLL
50962af5a5
fix: usdc mint transfers (#247)
* fix: usdc mint transfers

* format

* refactor
2023-12-18 11:57:18 -03:00
WHYTEWYLL
5c4e7bfdf8
fix: errors (#246)
* fix: errors

* format

* fix: typo
2023-12-15 07:21:42 -08:00
Jack Forgash
9690c3102c
chg schedule to 3x/hour (#244)
* chg schedule to 3x/hour

* blocks

* dbt schd
2023-12-13 19:32:13 -07:00
Jack Forgash
cf26afc365
chg schedule to 4x/hour (#243) 2023-12-13 08:33:54 -07:00
WHYTEWYLL
e8851383c9
Flow - add pk/inserted & modified dates/_invocation id (#239)
* add: keys core

* add: silver labels jk

* add: silver metadata jk

* add silver prices pk

* add: silver staking jk

* add: silver swaps and transfers jk

* fix: doc

* gold core pk

* gold: defi keys

* price and half nfts

* add missing comma in silver__streamline_blocks

* add: nfts

* fix: models

* list col names in swaps_events_s

* add underscore _invocation

* fix: gold layer

* delete: description

* fix: order and names

* delete: unecesarry qualify

* fix: errors

* fix: name

* dix: name

* rename id

* add: pk to topshot

* add: dim rename

* fix dim metadata views

---------

Co-authored-by: Jack Forgash <58153492+forgxyz@users.noreply.github.com>
2023-12-12 11:49:18 -08:00
Jack Forgash
c51d0c38b3
incr to 3x/hr (#242) 2023-12-11 16:52:05 -07:00
Jack Forgash
28e4dd0981
upd lookback in tx res cte (#241)
* upd lookback in tx res cte

* autofmt
2023-12-06 16:13:17 -07:00
Jack Forgash
971d555dff
update prod clone macro (#240) 2023-12-06 13:12:46 -07:00
WHYTEWYLL
9dae9f240f
Pipeline metadata (#238)
* add: if condition

* removed row_list

* add:  gold view, fix macro, and silver models

* gold view extension

* add: test bronce

* g

* adding test

* add: test

* add: working test

* delete: tags

* delete: hardcode ref
2023-12-04 07:16:32 -08:00
WHYTEWYLL
150fbea1ab
fix: dedeuplicates (#237) 2023-11-29 08:44:07 -08:00
WHYTEWYLL
3e5e0a4bdd
Update silver__nft_allday_metadata_s.sql (#236) 2023-11-29 08:29:39 -08:00
WHYTEWYLL
d3b3c9667f
Update dbt_run_moments_metadata.yml (#235) 2023-11-29 06:44:14 -08:00
Jack Forgash
df7b62123c
Streamline Backfill: upd workflow activate txs tx results (#233)
* upd workflow activate txs tx results

* upd schedule to 30 mins
2023-11-27 12:22:55 -07:00
desmond-hui
b0c422cfdf
reduce risk of running livequery_models accidentally (#234) 2023-11-27 08:09:06 -08:00