mirror of
https://github.com/sourcegraph/sourcegraph.git
synced 2026-02-06 18:31:54 +00:00
This PR introduces three main components:
Enqueuer – a thin layer responsible for actually inserting the syntactic indexing records into the database.
Scheduler - a service that
Identifies repositories that haven't been processed in a while
Identifies policies that match those repositories (policies that have syntactic indexing enabled)
Identifies commits that match any of the policies
And finally, enqueues the jobs to index the discovered repositories and commits
Scheduler job – a periodic routine that triggers Scheduler on with specified interval. This job runs as part of the main Worker service, and only schedules jobs if the experimental syntactic indexing feature is enabled.
Refactoring:
Making some methods public in policies.Service to make it easier to test logic that depends on glob matching of repository names (this matching requires a separate state to be updated)
Extracting some test utilities into a separate package
---------
Co-authored-by: Varun Gandhi <varun.gandhi@sourcegraph.com>
|
||
|---|---|---|
| .. | ||
| shared | ||
| BUILD.bazel | ||
| CODENOTIFY | ||
| image_test.yaml | ||
| main.go | ||
| README.md | ||
Syntactic code intel worker
🚧 WORK IN PROGRESS 🚧
Stateless service that handles generating SCIP data for codebases using Tree-sitter for powering syntax-based code navigation.
Design docs (Sourcegraph internal)