Commit Graph

448 Commits

Author SHA1 Message Date
Jack Forgash
cc8dc32125
Adj backfill - 16,18,19 smaller batches (#308)
* 16 smaller batches, larger backlog

* 18/19 smaller batches, larger backlog
2024-03-20 09:17:49 -06:00
Jack Forgash
575443c9aa
Adj backfill 7 - incr 16, 18, 19 (#307)
* double 16 sql limit, 33% incr on batch

* double 18/19 sql limit, ~33% incr on batch
2024-03-19 15:24:06 -06:00
Jack Forgash
8506282b5d
txres 16, 18. txs 18,19 (#306) 2024-03-19 09:20:59 -06:00
Jack Forgash
68754c046e
decr nv 19 (#305) 2024-03-19 09:13:40 -06:00
Jack Forgash
e9dd16f514
inc batches (#304) 2024-03-18 21:47:04 -06:00
Jack Forgash
a710a8d824
incr sql limit (#303) 2024-03-18 19:40:54 -06:00
Jack Forgash
6f52a2f548
upd txs nv 18 (#302) 2024-03-18 18:52:12 -06:00
Jack Forgash
498d590dc8
backfill - upd batch sizing (#300)
* upd batch sizing

* upd txs nv 19
2024-03-18 16:04:23 -06:00
Jack Forgash
a531ee5c98
upd txs away from batch (#299) 2024-03-18 11:28:23 -06:00
WHYTEWYLL
cdc0d9e668
2h (#298) 2024-03-18 10:50:27 -06:00
Jack Forgash
dd2b42d326
fix indent dbt test gha (#290) 2024-03-15 10:34:18 -06:00
WHYTEWYLL
537a8b57c0
v2 to v1 (#296) 2024-03-14 19:25:31 -06:00
WHYTEWYLL
022390ebdc
Fix target (#295)
* hardcoding v2

* v2
2024-03-14 18:58:58 -06:00
WHYTEWYLL
131146940b
hardcoding v2 (#294) 2024-03-14 18:34:20 -06:00
WHYTEWYLL
e90fb88156
Fix job (#293)
* fix job

* key

* space

* format

* one line
2024-03-14 17:11:05 -06:00
WHYTEWYLL
605b43092a
fix job (#292)
* fix job

* key

* space
2024-03-14 16:52:02 -06:00
WHYTEWYLL
0dee1c27e9
adding batch methods for chain and cronjob (#284)
Finetune
2024-03-14 15:38:49 -06:00
Jack Forgash
db39b35ceb
upd workflows to use requirements.txt (#289) 2024-03-13 13:54:26 -06:00
Jack Forgash
f174dc3cd4
add protobuf ver (#288) 2024-03-13 13:22:18 -06:00
Jack Forgash
490b0cdea3
add deps back (#287) 2024-03-13 13:19:07 -06:00
Jack Forgash
2f356f9403
del dbt deps (#285) 2024-03-13 13:12:22 -06:00
Shah Newaz Khan
3d493da486
Stream 803/throughput tune mn 18 (#283)
* add var read for invoke streams

* WIP throughput tune

* added mn 19 batch model

* remove transient tx-results-batch bronze table

* add concurent_requests

---------

Co-authored-by: shah <info@shahnewazkhan.ca>
2024-03-08 14:50:04 -08:00
Shah Newaz Khan
0d3128f868
Stream 798/tx batch tuning (#280)
* adds tx result batch make directive | bronze make directive

* batch tx_results success

* revert collections bronze scope

* revert tx results history bronze

---------

Co-authored-by: shah <info@shahnewazkhan.ca>
2024-03-04 13:33:25 -08:00
eric-laurello
5734a9b743
fix inc stats models (#281) 2024-03-01 14:40:47 -05:00
WHYTEWYLL
989fdb6cfa
add stats flow, gas pending (#279)
* add stats flow, gas pending

* fee to table

* stats flow

* fix float, schedule
2024-02-26 16:13:58 -03:00
WHYTEWYLL
3cc7463512
semicolumn (#278) 2024-02-21 07:21:05 -03:00
WHYTEWYLL
6b65655da8
Finetune (#277)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18

* reducing job

* var del

* increasing producer batch size

* increasing batch size and worker

* workers limit

* reducing producer

* add fin

* fix doubled key values
2024-02-20 12:07:10 -03:00
WHYTEWYLL
7384530ccf
Finetune (#276)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18

* reducing job

* var del

* increasing producer batch size

* increasing batch size and worker

* workers limit

* reducing producer
2024-02-15 20:03:40 -03:00
WHYTEWYLL
4a723f90c5
Finetune (#275)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18

* reducing job

* var del

* increasing producer batch size

* increasing batch size and worker

* workers limit
2024-02-15 19:18:36 -03:00
WHYTEWYLL
99d1e0812a
Finetune (#274)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18

* reducing job

* var del

* increasing producer batch size

* increasing batch size and worker
2024-02-15 19:07:37 -03:00
WHYTEWYLL
7c5cca0278
Finetune (#273)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18

* reducing job

* var del

* increasing producer batch size
2024-02-15 18:09:34 -03:00
WHYTEWYLL
1043c83d4f
Finetune (#272)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18

* reducing job

* var del
2024-02-15 17:08:45 -03:00
WHYTEWYLL
298a2530b9
Finetune (#271)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error

* increasing producer_batch_size

* add: transactions mainnet

* mainet 18
2024-02-15 13:10:51 -03:00
WHYTEWYLL
17191eacd0
Finetune (#270)
* test a from the base line on env var

* quotes

* fine tune trasnactions and results

* format

* error
2024-02-14 15:07:30 -03:00
Jack Forgash
3261a09b4a
fix model selection in history (#269) 2024-02-13 19:06:27 -07:00
Jack Forgash
668b22097b
expliticly call putstanding NV and methods (#268) 2024-02-13 14:50:37 -07:00
Shah Newaz Khan
dbebfbf0a0
fix udf 2 api integration (#267)
Co-authored-by: shah <info@shahnewazkhan.ca>
2024-02-13 08:26:57 -08:00
WHYTEWYLL
35c6053bcd
Finetune (#266)
* test a from the base line on env var

* quotes
2024-02-13 11:30:01 -03:00
WHYTEWYLL
759836fc8d
An 4437 add or account for all day burned moments (#263)
* a

* filter previus attempts

* fix empty pack

* del filt

* severity adjust
2024-02-05 15:07:51 -03:00
WHYTEWYLL
6d53230f0a
Fix labels (#265)
* add deleted

* hotfix
2024-01-31 16:11:00 -03:00
WHYTEWYLL
39d17e3f12
add deleted (#264) 2024-01-31 14:20:56 -03:00
WHYTEWYLL
e7615a0cc6
Update labels (#262)
* a

* lavels source updated

* add core view

* unique id

* delete coalesces
2024-01-31 13:44:59 -03:00
WHYTEWYLL
1a6a72f5f2
An 4442 flow dbt1.7 (#261)
* pkg lock and dbt docs

* update: 1.7

* profile

* update docs

---------

Co-authored-by: forgash_ <jmfxyz@pm.me>
2024-01-30 15:44:19 -03:00
Jack Forgash
e3e9b6ec89
NFLAD Challenge - del dup wallets (#260)
* del 3/4 dup wallets

* del last
2024-01-22 12:02:30 -07:00
Jack Forgash
cb95faf856
beta view w rosters (#259) 2024-01-20 14:32:15 -07:00
Jack Forgash
e0818966ad
AN-4428/add user agent to topshot and upd metadata job (#258)
* add user agent to topshot and upd metadata job

* upd agent

* upd limit to 600
2024-01-18 09:19:18 -07:00
WHYTEWYLL
59b3a5b4b5
fix: parse (#248)
* fix: parse

* fix: hex parse

* fix: format

* add: fix

* delete: last month filter

* a

* fix: parser

* delete: date filter
2024-01-16 12:09:37 -07:00
WHYTEWYLL
2fe9333eea
add: user agent to not get ban (#257) 2024-01-10 14:29:37 -03:00
Jack Forgash
7c87cd4225
Beta allday espn id view (#255) 2024-01-05 12:57:55 -07:00
Jack Forgash
074c11c55a
fix id col in dim allday metadata (#253) 2024-01-04 09:03:25 -07:00