sourcegraph/internal
Tomás Senart 8854605846
extsvc: Change default rate limits of npm and Go external services (#34042)
This commit changes the default rate limit configs of npm and Go
external services to be unlimited by default, and for a higher default
of 16 req/s to be filled in when auto-completing in the Monaco editor of
the UI.

Unlike the GitHub or GitLab APIs, neither the public npm registry nor
the public Go modules proxy (i.e proxy.golang.org) document an enforced
req/s rate limit. For private registries / proxies, site-admins can
manually configure their desired rate limits.

The request pattern for npm and Go sources is also different than GitHub
and GitLab sources in that they execute a lot more individual requests
since there are no batch endpoints used (except for multiple versions of
a single package). This means we need a far higher rate limit in order
for these external services to sync in a reasonable amount of time,
as well as leave some quota for lazy-syncing individual packages via
dependencies search.
2022-04-19 11:50:46 +00:00
..
actor Backend: add AnonymousUID to Actor struct (#32475) 2022-03-11 07:58:07 -06:00
api gitserver: Add BatchLog (#33195) 2022-04-07 18:19:20 +00:00
authz Remove roaring.Bitmaps from all of the authz/permissions code (#33333) 2022-04-11 09:22:08 -04:00
cmd Update base alpine images (#33938) 2022-04-14 17:37:12 -03:00
codeintel unpack: Extract function to create zip archive in tests (#34006) 2022-04-18 11:28:51 -05:00
comby all: replace regexp with grafana/regexp (#30948) 2022-02-14 09:08:21 +00:00
conf auth: add config options for account lockout (#33999) 2022-04-19 15:05:29 +08:00
cookie usage stats: Send device id in backend logs (#25920) 2021-10-12 17:41:33 +08:00
database Insights: persist search context filters and resolve in the GraphQL (#33818) 2022-04-14 11:57:47 -07:00
debugserver debugserver: Add /healthz and /ready endpoints (#19846) 2021-04-08 20:21:29 +00:00
deviceid middleware: only register device id on dotcom (#25954) 2021-10-12 21:45:36 +08:00
diskcache diskcache: Refactor EncodeKeyComponents (#32301) 2022-03-08 12:08:07 -07:00
encryption Add metric for payload size (#33655) 2022-04-11 10:28:18 +02:00
endpoint endpoint: recover from errors in discovery (#31225) 2022-02-16 14:32:46 +00:00
env errors: Introduce internal package (#30558) 2022-02-07 15:03:45 +00:00
errcode errors: Introduce internal package (#30558) 2022-02-07 15:03:45 +00:00
eventlogger api: seperate internal client into internalapi (#28151) 2021-11-25 11:02:57 -08:00
extsvc extsvc: Change default rate limits of npm and Go external services (#34042) 2022-04-19 11:50:46 +00:00
featureflag chore: Update go-mockgen (#33678) 2022-04-08 16:07:50 -05:00
fileutil sg: update binary correctly instead of renaming file (#33957) 2022-04-15 08:52:07 +02:00
gitserver gitserver: support suffix .git for go modules (#33942) 2022-04-19 11:05:50 +02:00
goroutine chore: Update go-mockgen (#33678) 2022-04-08 16:07:50 -05:00
gosyntect syntax-highlighter: Add C# Support (#31811) 2022-03-02 12:02:36 -05:00
gqltestutil insights: Add backend integration tests (#33451) 2022-04-07 15:39:41 -04:00
honey Add Datadog tracing library (#31939) 2022-02-28 11:18:56 -07:00
hostname Store hostname of workerutil Record processor on job dequeue (#21739) 2021-06-21 13:10:11 +01:00
httpcli golangci-lint: enable unparam linter (#31856) 2022-02-28 15:31:44 +01:00
httpserver httpserver: Make pre-shutdown sleep configurable (#28159) 2021-11-24 18:16:40 -06:00
httptestutil errors: Introduce internal package (#30558) 2022-02-07 15:03:45 +00:00
insights chore: Update go-mockgen (#33678) 2022-04-08 16:07:50 -05:00
inventory golangci-lint: enable unparam linter (#31856) 2022-02-28 15:31:44 +01:00
jsonc errors: Introduce internal package (#30558) 2022-02-07 15:03:45 +00:00
lazyregexp all: replace regexp with grafana/regexp (#30948) 2022-02-14 09:08:21 +00:00
logging logging: Print iTerm link to the log's source file:line in VS Code (#30439) 2022-02-01 20:55:40 +00:00
luasandbox luasandbox: Add RunScriptNamed (#34029) 2022-04-19 11:54:09 +02:00
metrics repo-updater: Increase time allowed to sync repo in background (#33490) 2022-04-06 14:47:01 +02:00
mutablelimiter mutablelimiter: Clean up comments (#23712) 2021-08-09 14:36:44 +02:00
observation lib/errors: new MultiError error type and utilities (#31466) 2022-02-18 11:07:02 -08:00
oobmigration chore: Update go-mockgen (#33678) 2022-04-08 16:07:50 -05:00
pathmatch all: replace regexp with grafana/regexp (#30948) 2022-02-14 09:08:21 +00:00
profiler Add Datadog profiler (#32020) 2022-03-01 17:44:03 -07:00
pubsub errors: Introduce internal package (#30558) 2022-02-07 15:03:45 +00:00
randstring
ratelimit ratelimit: Increase default burst to 10 (#33608) 2022-04-08 10:13:43 +02:00
rcache rcache: handle redis not instantly expiring (#33724) 2022-04-11 17:34:06 +02:00
redispool errors: Introduce internal package (#30558) 2022-02-07 15:03:45 +00:00
repos bitbucketcloud: add required client methods for Batch Changes (#33944) 2022-04-14 16:17:33 -07:00
repotrackutil Enforce unconvert lint (#18746) 2021-03-01 12:28:08 -07:00
repoupdater search: Quickly sync new versions of dependency repos (#31925) 2022-02-28 14:54:59 +00:00
resetonce add resetable sync.Once for timed caching of ctags globs (#32082) 2022-03-02 22:08:35 +00:00
search Code monitors: simplify last searched (#33732) 2022-04-12 14:18:18 +00:00
security New Password Policy (#31881) 2022-04-11 11:29:35 -05:00
sentry lib/errors: new MultiError error type and utilities (#31466) 2022-02-18 11:07:02 -08:00
services/executors golangci-lint: enable unparam linter (#31856) 2022-02-28 15:31:44 +01:00
slack errors: Introduce internal package (#30558) 2022-02-07 15:03:45 +00:00
src-cli Bump src-cli to latest release (#33902) 2022-04-14 14:23:44 +02:00
src-prometheus errors: Introduce internal package (#30558) 2022-02-07 15:03:45 +00:00
symbols Squirrel: local code intel for Java using tree-sitter (#32122) 2022-03-30 14:51:34 -06:00
sysreq errors: Introduce internal package (#30558) 2022-02-07 15:03:45 +00:00
temporarysettings temporary settings: graphql backend (#24295) 2021-08-26 07:57:22 -07:00
testutil gitserver: add db connections which are needed for future instantiation of gitserver clients with db connections (#32769) 2022-03-22 11:07:54 +03:00
timeutil search: Move FakeClock to timeutil (#17283) 2021-01-14 11:24:46 -07:00
trace Support traceURLs with Datadog (#32024) 2022-04-12 09:04:12 -07:00
tracer Support traceURLs with Datadog (#32024) 2022-04-12 09:04:12 -07:00
txemail errors: Introduce internal package (#30558) 2022-02-07 15:03:45 +00:00
types extsvc: Redact urls field in Go modules connection config (#33180) 2022-04-14 18:29:55 +00:00
unpack unpack: Extract function to create zip archive in tests (#34006) 2022-04-18 11:28:51 -05:00
uploadstore chore: Update go-mockgen (#33678) 2022-04-08 16:07:50 -05:00
usagestats gitserver: refactor gitserver.Client and its usage (#32890) 2022-03-23 14:39:54 +03:00
vcs gitserver: Make batch-log concurrency configurable (#33945) 2022-04-18 12:34:52 -05:00
version errors: Introduce internal package (#30558) 2022-02-07 15:03:45 +00:00
workerutil workerutil: Fix flaky TestWorkerConcurrent (#33847) 2022-04-13 15:38:38 +00:00