Code AI platform with Code Search & Cody
Go to file
sourcegraph-release-guild-bot e464b488ff
[Backport 5.2] graphqlbackend/telemetry: add query for recently exported events (#59041)
* graphqlbackend/telemetry: add query for recently exported events (#57029)

Adds a `telemetry { exportedEvents { ... } }` query that allows a site admin to view recently exported events, before they are removed from the queue by the queue cleaner after `TELEMETRY_GATEWAY_EXPORTER_EXPORTED_EVENTS_RETENTION`, which defaults to 24 hours. This is very different from `event_logs` because it provides a `protojson` rendering of the "true" event payload - the data shown is exactly the data that was exported (except the export happens over proto), whereas the `event_logs` equivalent is translated from the raw data and may be missing some things. The new query and resolver supports pagination.

This is useful in local development to see events without interrogating the telemetry-gateway's local dev logging mode or connecting it to a real telemetry-gateway and querying BigQuery.

This can also be useful if a customer wants to see what is getting exported - right now, there's no easy way to do so without asking someone at Sourcegraph to check BigQuery, or for the customer to parse the raw proto payloads in the database themselves. I have a feeling this ask will eventually arise as we roll out v2 telemetry adoption more broadly.

Closes https://github.com/sourcegraph/sourcegraph/issues/57027

## Test plan

Unit and integration tests, and some manual testing with `sg start` and running some searches:

![image](https://github.com/sourcegraph/sourcegraph/assets/23356519/ab39d9ad-829f-475a-b093-411edbcdf579)

---------

Co-authored-by: Joe Chen <joe@sourcegraph.com>
(cherry picked from commit 5bfda07b52)

* fixup

---------

Co-authored-by: Robert Lin <robert@bobheadxi.dev>
Co-authored-by: Warren Gifford <warren@sourcegraph.com>
2024-01-09 23:30:04 +00:00
.aspect Bump NodeJS to v18 (#56546) 2023-09-13 17:48:33 +02:00
.buildkite bazel: move backcompat tests to their own pipeline (#55489) 2023-08-22 16:57:25 +00:00
.github ci: remove scip actions for codyintel.sourcegraphcloud.com (#56833) 2023-09-20 14:47:43 +00:00
.vscode Remove GitHub proxy service (#56485) 2023-09-14 19:43:40 +02:00
client [Backport 5.2] Code Insights: Remove no new line check from capture group insight (#59410) 2024-01-09 11:19:12 -05:00
cmd [Backport 5.2] graphqlbackend/telemetry: add query for recently exported events (#59041) 2024-01-09 23:30:04 +00:00
dev p4: remove skips (#58808) 2023-12-06 17:57:48 +02:00
doc [Backport 5.2] Add Cody providers to pings (#58937) 2023-12-13 11:25:54 -05:00
docker-images [Backport 5.2] docker-images/dind: upgrade to 24.0.7 (#58740) 2023-12-04 10:47:20 -05:00
enterprise [Backport 5.2] graphqlbackend/telemetry: add query for recently exported events (#59041) 2024-01-09 23:30:04 +00:00
internal [Backport 5.2] graphqlbackend/telemetry: add query for recently exported events (#59041) 2024-01-09 23:30:04 +00:00
lib [Backport 5.2] graphqlbackend/telemetry: add query for recently exported events (#59041) 2024-01-09 23:30:04 +00:00
migrations [Backport 5.2] Embeddings: fix low-hanging issues with scheduling job (#58651) 2023-11-29 10:28:01 +00:00
monitoring [Backport 5.2] graphqlbackend/telemetry: add query for recently exported events (#59041) 2024-01-09 23:30:04 +00:00
schema [Backport 5.2] code-search: add configuration for rejecting unverified commits (#58599) 2023-11-28 17:02:41 -05:00
src-tauri Auto setup Cody App from VS Code (#56716) 2023-09-20 21:11:43 +05:30
testing Merge enterprise and non-enterprise server images (#56446) 2023-09-11 14:39:27 +02:00
third_party local: fix issues when cross-compiling syntax-highlighter to produce a container image on Mac machines (#55969) 2023-08-22 12:46:43 +02:00
third-party-licenses chore: update third-party licenses (#56335) 2023-09-18 07:45:46 +00:00
ui/assets [Search Jobs]: Add special zero state for the initial empty state (#56516) 2023-09-13 13:17:03 -03:00
windows/installer/cody Disable services that are causing issues on Windows. (#54263) 2023-06-27 19:08:53 +00:00
wolfi-images [Backport 5.2] wolfi: add redis cli to server image (#58804) 2023-12-06 10:00:19 -05:00
wolfi-packages [Backport 5.2] Build: bump hash for perforce API (#59398) 2024-01-08 18:44:33 -05:00
.bazel_fix_commands.json bazel: add command sets that uses bazel under the hood (#48460) 2023-03-02 11:31:51 +01:00
.bazelignore Remove completions review tool (#55201) 2023-07-21 17:03:16 +02:00
.bazeliskrc build: update to Aspect CLI 5.5.4 (#54468) 2023-06-29 22:44:05 -07:00
.bazelrc Bump NodeJS to v18 (#56546) 2023-09-13 17:48:33 +02:00
.bazelversion Update bazel to 6.1.1 (#50472) 2023-04-11 10:51:21 +02:00
.browserslistrc web: migrate from yarn to pnpm (#46143) 2023-01-11 19:50:09 -08:00
.dockerignore web: migrate from yarn to pnpm (#46143) 2023-01-11 19:50:09 -08:00
.editorconfig chore: Add .lua to editorconfig. (#44267) 2022-11-11 15:25:32 +08:00
.eslintignore bazel: implement custom ESLint Bazel rule (#52062) 2023-05-22 04:05:45 -07:00
.eslintrc.js Eslint fix type imports (#54920) 2023-08-10 21:12:31 +02:00
.gitattributes github: show bazel diff again (#54719) 2023-07-07 16:43:45 +00:00
.gitignore cody web: provide suggestions in context selector (#56039) 2023-09-11 04:25:47 +05:30
.graphqlrc.yml
.hadolint.yaml
.mailmap mailmap: add entries for Eric and Renovate (#50966) 2023-04-25 09:42:22 +02:00
.mocharc.js build: still need BAZEL_BINDIR for webpack_bundle custom rule (#48796) 2023-03-07 20:02:11 -08:00
.npmrc pnpm: remove update notifier message (#51630) 2023-05-10 08:53:39 +02:00
.percy.yml ci: percy defer snapshots upload (#54116) 2023-06-25 18:57:49 -07:00
.pre-commit-config.yaml dev: add a pre-commit hook to searches for tokens (#56499) 2023-09-12 16:20:44 +02:00
.prettierignore bazel: move backcompat tests to their own pipeline (#55489) 2023-08-22 16:57:25 +00:00
.stylelintignore rework plugin structure and implement frontside blogpost (#46883) 2023-02-15 11:49:51 +02:00
.stylelintrc.json web: drop bootstrap depenedency (#41401) 2022-09-07 03:11:26 -07:00
.tool-versions Bump NodeJS to v18 (#56546) 2023-09-13 17:48:33 +02:00
.trivyignore
babel.config.jest.js bazel: fix the web application bundle in Bazel (#50383) 2023-04-10 21:16:12 -07:00
babel.config.js bazel: fix the web application bundle in Bazel (#50383) 2023-04-10 21:16:12 -07:00
BUILD.bazel Allow to run e2e tests locally (#55998) 2023-08-29 11:08:47 -05:00
CHANGELOG.app.md update code references to "Sourcegraph App" -> "Cody App" (#56747) 2023-09-19 12:31:12 -10:00
CHANGELOG.md backport: grpc: add automatic retry support to all services (#59404) 2024-01-09 14:10:16 -08:00
CODENOTIFY nix: update pnpm hash (#51512) 2023-05-05 12:51:59 +00:00
CONTRIBUTING.md Docs: Fix docs page link in main CONTRIBUTING.md (#45160) 2022-12-05 14:57:45 +01:00
deps.bzl [Backport 5.2] telemetrygateway: use time-ordered UUID v7 for events (#59016) (#59042) 2023-12-15 21:04:13 -05:00
doc.go
eslint-relative-formatter.js bazel: implement custom ESLint Bazel rule (#52062) 2023-05-22 04:05:45 -07:00
flake.lock sg: use bazel run universtal-ctags (#55944) 2023-08-18 16:02:46 +00:00
flake.nix sg: use bazel run universtal-ctags (#55944) 2023-08-18 16:02:46 +00:00
gen.go chore: Update go-mockgen (#44305) 2022-11-11 19:24:00 +00:00
go.mod backport: grpc: add automatic retry support to all services (#59404) 2024-01-09 14:10:16 -08:00
go.sum [Backport 5.2] telemetrygateway: use time-ordered UUID v7 for events (#59016) (#59042) 2023-12-15 21:04:13 -05:00
graphql-schema-linter.config.js
gulpfile.js web: drop legacy GraphQL schema generator (#45945) 2022-12-25 18:10:20 -08:00
jest.config.base.js bazel: wildcard jest tests (#49282) 2023-03-17 03:38:49 -07:00
jest.config.js
jest.snapshot-resolver.js bazel: wildcard jest tests (#49282) 2023-03-17 03:38:49 -07:00
junit.xml SGM-6462 - Add About Sourcegraph CTA to main nav in dotcom (#56228) 2023-09-05 13:41:23 -04:00
LICENSE relicense all paths other than MIT licensed code, client/cody*, jetbrains, VS code, and browser extension to enterprise (#53345) (#53345) 2023-06-13 10:28:11 -07:00
LICENSE.enterprise
lighthouserc.js web: migrate from yarn to pnpm (#46143) 2023-01-11 19:50:09 -08:00
linter_deps.bzl bzl: port go compiler directives linter from sg lint to nogo (#54485) 2023-06-30 14:31:15 +02:00
mockgen.temp.yaml Add GraphQL read resolvers for code hosts (#55882) 2023-08-21 13:10:22 +00:00
mockgen.test.yaml [Backport 5.2] internal/telemetry: add telemetrytest mock for testing (#56987) 2023-09-25 10:04:22 -04:00
mockgen.yaml mocks: Reorganize mock definitions into multiple files (#36967) 2022-06-27 20:59:16 +00:00
nogo_config.json backport: grpc: add automatic retry support to all services (#59404) 2024-01-09 14:10:16 -08:00
package.json Bump NodeJS to v18 (#56546) 2023-09-13 17:48:33 +02:00
pnpm-lock.yaml [Backport 5.2] client/web: add telemetry v2 client (#57939) (#58085) 2023-11-03 21:14:13 +00:00
pnpm-workspace.yaml cody: development branch (#49761) 2023-03-23 20:41:11 +01:00
postcss.config.js
prettier.config.js clean up Cody CSS to increase shareability and improve display in web app (#50279) 2023-04-03 12:29:05 -07:00
README.md relicense all paths other than MIT licensed code, client/cody*, jetbrains, VS code, and browser extension to enterprise (#53345) (#53345) 2023-06-13 10:28:11 -07:00
renovate.json
SECURITY.md
service-catalog.yaml lib/servicecatalog: init to distribute catalog (#46999) 2023-01-26 17:22:27 -08:00
sg.config.yaml [Backport 5.2] client/web: add telemetry v2 client (#57939) (#58085) 2023-11-03 21:14:13 +00:00
shell.nix Bump NodeJS to v18 (#56546) 2023-09-13 17:48:33 +02:00
sonar-project.properties Use Buildkite to run Sonarcloud (#54875) 2023-07-21 12:16:03 -04:00
stamp_tags.bzl Switch to OCI/Wolfi based image (#52693) 2023-06-02 12:12:52 +02:00
svgo.config.js
tsconfig.all.json remove cody code that was moved to separate cody repo (#54729) 2023-07-10 00:31:47 -10:00
tsconfig.base.json web: fix pnpm-lock issue (#47478) 2023-02-09 22:04:31 -08:00
tsconfig.eslint.json web: fix pnpm-lock issue (#47478) 2023-02-09 22:04:31 -08:00
WORKSPACE Bump NodeJS to v18 (#56546) 2023-09-13 17:48:33 +02:00

DocsContributingTwitterDiscord

Build status Scorecard Latest release Discord Contributors


Sourcegraph makes it easy to read, write, and fix code—even in big, complex codebases.

  • Code search: Search all of your repositories across all branches and all code hosts.
  • Code intelligence: Navigate code, find references, see code owners, trace history, and more.
  • Fix and refactor: Roll out large-scale changes to many repositories at once and track big migrations.

Getting started



Development

Refer to the Developing Sourcegraph guide to get started.

Documentation

The doc directory has additional documentation for developing and understanding Sourcegraph:

License

This repository contains primarily non-OSS-licensed files, and some OSS licensed files (for example, IDE extensions). We maintain one repository rather than two separate repositories mainly for development convenience.

See the LICENSE for an explanation of how files are licensed.