sourcegraph/enterprise/cmd/executor-queue/README.md
Erik Seliger 968bea1eea
Implement executor queue for batch changes executor (#22555)
This commit contains several smaller pieces:

- Run executor-queue as part of enterprise

- Make health server port configurable

Otherwise, it's impossible to run two executors on the same machine (required for dev when running code intel AND batch changes).

- Make port for executor queue configurable

- Add batch spec execution DB entity

- Overpromise implementation of batches queue in executor-queue

- Add shared config for reusing env vars across queues

These fields will also be required in the batches queue, so we need to make them sharable. Defining them in both places causes a validation error.

- Add batch spec executions queue to executor-queue

- Add resetter for executor worker
2021-07-05 12:27:40 +02:00

9 lines
586 B
Markdown

# Executor queue
The executor-queue service maintains the executor work queues. Executor instances poll for and perform jobs from a particular queue. The executor-queue service locks in-progress jobs via a Postgres transaction. Executors and the executor-queue will periodically reconcile in-progress jobs via heartbeat requests. This is a singleton service that is accessible via a frontend proxy authenticated via a shared token.
## Work queues
- The `codeintel` queue contains unprocessed lsif_index records
- The `batches` queue contains unprocessed batch_spec_execution records