Commit Graph

21 Commits

Author SHA1 Message Date
sourcegraph-buildkite
01bff9bdfb
security: Auto-update package lockfiles for Sourcegraph base images (#64303)
Automatically generated PR to update package lockfiles for Sourcegraph
base images.

Built from Buildkite run
[#286112](https://buildkite.com/sourcegraph/sourcegraph/builds/286112).
## Test Plan
- CI build verifies image functionality

Co-authored-by: Buildkite <buildkite@sourcegraph.com>
2024-08-06 15:57:37 +00:00
sourcegraph-buildkite
dc6facd544
security: Auto-update package lockfiles for Sourcegraph base images (#64180)
Automatically generated PR to update package lockfiles for Sourcegraph
base images.

Built from Buildkite run
[#285343](https://buildkite.com/sourcegraph/sourcegraph/builds/285343).
## Test Plan
- CI build verifies image functionality

Co-authored-by: Buildkite <buildkite@sourcegraph.com>
Co-authored-by: Vincent <evict@users.noreply.github.com>
Co-authored-by: Shivasurya <s.shivasurya@gmail.com>
2024-08-02 13:20:03 -04:00
sourcegraph-buildkite
d498442148
security: Auto-update package lockfiles for Sourcegraph base images (#64035)
Automatically generated PR to update package lockfiles for Sourcegraph
base images.

Built from Buildkite run
[#283970](https://buildkite.com/sourcegraph/sourcegraph/builds/283970).
## Test Plan
- CI build verifies image functionality

Co-authored-by: Buildkite <buildkite@sourcegraph.com>
2024-07-24 11:46:40 +00:00
sourcegraph-buildkite
8efbdc2d49
security: Auto-update package lockfiles for Sourcegraph base images (#63606)
Automatically generated PR to update package lockfiles for Sourcegraph
base images.

Built from Buildkite run
[#281769](https://buildkite.com/sourcegraph/sourcegraph/builds/281769).
## Test Plan
- CI build verifies image functionality

Co-authored-by: Buildkite <buildkite@sourcegraph.com>
2024-07-10 09:21:27 +01:00
sourcegraph-buildkite
eeff45b5f5
security: Auto-update package lockfiles for Sourcegraph base images (#63145)
Automatically generated PR to update package lockfiles for Sourcegraph
base images.

Built from Buildkite run
[#280656](https://buildkite.com/sourcegraph/sourcegraph/builds/280656).
## Test Plan
- CI build verifies image functionality

Co-authored-by: Buildkite <buildkite@sourcegraph.com>
2024-07-02 17:07:34 +01:00
sourcegraph-buildkite
872e23f956
security: Auto-update package lockfiles for Sourcegraph base images (#63104)
Automatically generated PR to update package lockfiles for Sourcegraph
base images.

Built from Buildkite run
[#277149](https://buildkite.com/sourcegraph/sourcegraph/builds/277149).
## Test Plan
- CI build verifies image functionality

Co-authored-by: Buildkite <buildkite@sourcegraph.com>
2024-06-05 16:04:36 +00:00
Will Dollman
6fbb78abb0
Revert "security: Auto-update package lockfiles for Sourcegraph base images (#63067)" (#63102)
This reverts commit 3fc155dc4d.

<!-- 💡 To write a useful PR description, make sure that your description
covers:
- WHAT this PR is changing:
    - How was it PREVIOUSLY.
    - How it will be from NOW on.
- WHY this PR is needed.
- CONTEXT, i.e. to which initiative, project or RFC it belongs.

The structure of the description doesn't matter as much as covering
these points, so use
your best judgement based on your context.
Learn how to write good pull request description:
https://www.notion.so/sourcegraph/Write-a-good-pull-request-description-610a7fd3e613496eb76f450db5a49b6e?pvs=4
-->


## Test plan

- CI

<!-- All pull requests REQUIRE a test plan:
https://docs-legacy.sourcegraph.com/dev/background-information/testing_principles
-->


## Changelog

<!--
1. Ensure your pull request title is formatted as: $type($domain): $what
2. Add bullet list items for each additional detail you want to cover
(see example below)
3. You can edit this after the pull request was merged, as long as
release shipping it hasn't been promoted to the public.
4. For more information, please see this how-to
https://www.notion.so/sourcegraph/Writing-a-changelog-entry-dd997f411d524caabf0d8d38a24a878c?

Audience: TS/CSE > Customers > Teammates (in that order).

Cheat sheet: $type = chore|fix|feat $domain:
source|search|ci|release|plg|cody|local|...
-->

<!--
Example:

Title: fix(search): parse quotes with the appropriate context
Changelog section:

## Changelog

- When a quote is used with regexp pattern type, then ...
- Refactored underlying code.
-->
2024-06-05 15:42:44 +00:00
sourcegraph-buildkite
3fc155dc4d
security: Auto-update package lockfiles for Sourcegraph base images (#63067)
Automatically generated PR to update package lockfiles for Sourcegraph
base images.

Built from Buildkite run
[#277067](https://buildkite.com/sourcegraph/sourcegraph/builds/277067).
## Test Plan
- CI build verifies image functionality

Co-authored-by: Buildkite <buildkite@sourcegraph.com>
2024-06-05 16:24:13 +01:00
Will Dollman
d5c9c3a3c1
Publish sourcegraph-dev image (#63031)
* Publish sourcegraph-dev image

* Add comment to sourcegraph-dev yaml

* Update sg-dev confighash

* Add bazel refs
2024-06-03 14:41:54 +01:00
sourcegraph-buildkite
4fd12ab649
security: Auto-update package lockfiles for Sourcegraph base images (#62749)
Auto-update package lockfiles for Wolfi base images at 2024-05-24 16:35:58 UTC

Co-authored-by: Buildkite <buildkite@sourcegraph.com>
2024-05-24 17:56:45 +01:00
sourcegraph-buildkite
705c884beb
Auto-update package lockfiles for Sourcegraph base images (#62688)
Auto-update package lockfiles for Wolfi base images at 2024-05-16 03:08:51 UTC

Co-authored-by: Buildkite <buildkite@sourcegraph.com>
2024-05-17 00:24:51 +01:00
sourcegraph-buildkite
200ad688ed
Auto-update package lockfiles for Sourcegraph base images (#62523)
Auto-update package lockfiles for Wolfi base images at 2024-05-14 03:11:26 UTC

Co-authored-by: Buildkite <buildkite@sourcegraph.com>
2024-05-14 21:13:47 +01:00
sourcegraph-buildkite
46efc7d1e9
Auto-update package lockfiles for Sourcegraph base images (#62326)
Auto-update package lockfiles for Wolfi base images at 2024-05-07 03:06:04 UTC

Co-authored-by: Buildkite <buildkite@sourcegraph.com>
2024-05-07 16:59:55 -04:00
Erik Seliger
e9d7e95876
Upgrade git to 2.45.0 and unpin old cURL version (#62282)
We recently reverted the cURL version to 8.6.0 because it was incompatible with Git.
In the new Git release, there was a workaround put in that should make it work with latest cURL again before upstream cURL is fixed.
By that we can use the latest version again and don't need to ship a cURL with known CVEs in the next release.

Test plan:

Git integration tests are still working, E2E tests can still successfully look at repository contents, and will test that we can successfully clone the k8s repo which failed previously.
2024-04-30 17:52:52 +02:00
Will Dollman
0d7ab3e62e
Revert publishing wolfi base images (#62117)
* Revert build base images

* Revert 'MANUAL REBUILD' comment in image configs

* sg wolfi lock
2024-04-25 11:33:00 +01:00
Will Dollman
a2c92189a9
Temporarily republish base images for backport (#62077)
* Add base image building back to pipeline

Effectively reverting 66dfb2deec

* Bump all base image configs to trigger rebuidl

* Update lockfile hashes

* sg wolfi lock to update packages

Although we're publishing images, they're still built with wolfi and there are several packages we want to update
2024-04-22 11:25:19 +01:00
Will Dollman
b78da0f1a0
Pin cURL version and update packages for release (#62044)
* Pin curl to version without git fetch bug

* sg wolfi lock
2024-04-19 16:29:43 +01:00
Will Dollman
144999c1f3
Publish sourcegraph-base image (#62002)
* Publish sourcegraph-base image

* Add oci_defs

* Remove dind from legacy image builds - this breaks runtype.CandidateNoTest

* Switch executor-vm command to bazel

* Set isCandidate true when using CandidateNoTest run type

* Rename sourcegraph and sourcegraph-base to better reflect their current purposes

sourcegraph -> sourcegraph-base
sourcegraph-base -> sourcegraph-template

* Re-lock sourcegraph-template

* Update wolfi target

* Add Aspect bazelrc to executor-vm build.sh

This script may be run locally or on CI, so handle both cases

* Tweak bazelrc generation

* Update configHashes - bodge alert
2024-04-19 14:44:06 +01:00
Will Dollman
d56fa926dd
Build images end-to-end using Bazel v2 (#61845)
* wip

* gitserver (mostly) wolfi 4 bazel

* the big heck of all things

* Add rules_apko lock translation rules to WORKSPACE

* Call apko_repositories() more

* fix rules_apko to handle our shorter repo urls

* fix workspace from rebase, and missing locks

* visibility on wolfi_base_image

* hand-fix a lock coz apko lock is 🅱️roken

* remove chainguard repo+keyring from base

* update locks

* add chainguard repo+keychain to single server manifest

* unrelated fixes, server+grafana still h*cked

* fix postgres-exporter

* the big fix

* aws lib got bumped?

* downgrade sso-oidc? idk

* ignore wolfi locks from prettier

* dynamically do the locks with a reporule

* document and make nice :nails:

* bazel run @rules_apko//apko patch

* Fix .typo.typo

* Update tooling for end-to-end Bazel images (#61106)

* Update sg wolfi image to build using Bazel

* bazel run @rules_apko//apko patch

* Fix .typo.typo

* Add update-images and implement apko YAML change monitoring

* Use bazel apko and add support for additional repos

* Refactor sg wolfi

* Rework wolfi base image auto-update pipeline

* sg bazel configure

* [rough] Add --check flag to sg wolfi lock

* Refactor sg wolfi lock --check

* Simplify check and update apko lock hash operations

* Fix resolveImagePath when running in bazel

* Fixup logic error in CheckApkoLockHashes

* Tweak DoBaseImageBuild output

* Remove debug output

* Fix sg wolfi lock --check behaviour for all images

* Replace base image build step with apko lock --check

* Remove debug line

* Minor fixups for CI step

* Wrap with AnnotatedCmd

* Fixup annotation

* Update apko lockfiles

* Allow additional repos to be passed

* Update build-base-image.sh with bazel + add back to pipeline

* Ensure that modified base images are rebuilt

* Solve bazelception

* Remove timestamp for bit-level reproducibility

* Skip local keygen when running on buildkite

* Add workaround for lack of local repo support in rules_apko

* Run apkoOps first as it's quick and might fail

* Remove blocking allBaseImagesBuilt step

* Remove unused promethus-gcp image

* Add special cases to resolveImagePath

* Cleanly handle case where no bazel build path exists

This could happen in cases where a base image is only used outside of sourcegraph/sourcegraph,
or if you've added a new base image config but haven't added the associated Bazel scaffolding

* Add debugging around failing docker builds

* More debugging

* Normalise apko_lockfile to match repo.bzl

* Fixup apko docker call

* Try passing imageconfigdir differently to docker

* Run ls in different container

* Soft-fail when using legacy build in Buildkite

* Add missing include

* Workaround for building sourcegraph and sourcegraph-dev

* Add postgresql-client package to server

This contains createdb, which was recently moved from postgresql

* Inflate postgres-12-codeinsights image to avoid rules_apko errors

* Remove update line from yaml files

* Fix issue caused by moving base sourcegraph image

* Remove apk-tools from server

* Update lockfiles

* Address review feedback

* Remove debug lines

* fix unbound var

---------

Co-authored-by: Noah Santschi-Cooney <noah@santschi-cooney.ch>

* go mod tidy + gazelle-update-repos after merging main

* Use aspect bazel cache

* Use Aspect bazel caching when calling bazel in bash and sg

* Append annotation

* Run apko lock on aspect agent

* Remove base image builds

Discussion in https://sourcegraph.slack.com/archives/C05EVRLQEUR/p1712307465660509

* Remove unused functionality

* Update BaseImageConfig comments

* Rewrite wolfi-images/README.md

* Add .apko/range.sh to .gitattributes

* Remove "wolfi" from :base_image and :base_tarball targets

* remove allowlist extras from debugging

* Tweak user instructions around package testing

* Add agent healthcheck to buildkite scripts

* prettier

* sg bazel configure

* bazel run //:gazelle-update-repos

---------

Co-authored-by: Noah Santschi-Cooney <noah@santschi-cooney.ch>
Co-authored-by: Noah S-C <noah@sourcegraph.com>
2024-04-12 16:18:43 +01:00
Will Dollman
2c1d55c00e
Revert "Hackathon: Build images end-to-end using Bazel (#60785)" (#61644)
This reverts commit 44db6658b6.
2024-04-05 13:43:19 +00:00
Will Dollman
44db6658b6
Hackathon: Build images end-to-end using Bazel (#60785)
* wip

* gitserver (mostly) wolfi 4 bazel

* the big heck of all things

* Add rules_apko lock translation rules to WORKSPACE

* Call apko_repositories() more

* fix rules_apko to handle our shorter repo urls

* fix workspace from rebase, and missing locks

* visibility on wolfi_base_image

* hand-fix a lock coz apko lock is 🅱️roken

* remove chainguard repo+keyring from base

* update locks

* add chainguard repo+keychain to single server manifest

* unrelated fixes, server+grafana still h*cked

* fix postgres-exporter

* the big fix

* aws lib got bumped?

* downgrade sso-oidc? idk

* ignore wolfi locks from prettier

* dynamically do the locks with a reporule

* document and make nice :nails:

* bazel run @rules_apko//apko patch

* Fix .typo.typo

* Update tooling for end-to-end Bazel images (#61106)

* Update sg wolfi image to build using Bazel

* bazel run @rules_apko//apko patch

* Fix .typo.typo

* Add update-images and implement apko YAML change monitoring

* Use bazel apko and add support for additional repos

* Refactor sg wolfi

* Rework wolfi base image auto-update pipeline

* sg bazel configure

* [rough] Add --check flag to sg wolfi lock

* Refactor sg wolfi lock --check

* Simplify check and update apko lock hash operations

* Fix resolveImagePath when running in bazel

* Fixup logic error in CheckApkoLockHashes

* Tweak DoBaseImageBuild output

* Remove debug output

* Fix sg wolfi lock --check behaviour for all images

* Replace base image build step with apko lock --check

* Remove debug line

* Minor fixups for CI step

* Wrap with AnnotatedCmd

* Fixup annotation

* Update apko lockfiles

* Allow additional repos to be passed

* Update build-base-image.sh with bazel + add back to pipeline

* Ensure that modified base images are rebuilt

* Solve bazelception

* Remove timestamp for bit-level reproducibility

* Skip local keygen when running on buildkite

* Add workaround for lack of local repo support in rules_apko

* Run apkoOps first as it's quick and might fail

* Remove blocking allBaseImagesBuilt step

* Remove unused promethus-gcp image

* Add special cases to resolveImagePath

* Cleanly handle case where no bazel build path exists

This could happen in cases where a base image is only used outside of sourcegraph/sourcegraph,
or if you've added a new base image config but haven't added the associated Bazel scaffolding

* Add debugging around failing docker builds

* More debugging

* Normalise apko_lockfile to match repo.bzl

* Fixup apko docker call

* Try passing imageconfigdir differently to docker

* Run ls in different container

* Soft-fail when using legacy build in Buildkite

* Add missing include

* Workaround for building sourcegraph and sourcegraph-dev

* Add postgresql-client package to server

This contains createdb, which was recently moved from postgresql

* Inflate postgres-12-codeinsights image to avoid rules_apko errors

* Remove update line from yaml files

* Fix issue caused by moving base sourcegraph image

* Remove apk-tools from server

* Update lockfiles

* Address review feedback

* Remove debug lines

* fix unbound var

---------

Co-authored-by: Noah Santschi-Cooney <noah@santschi-cooney.ch>

* go mod tidy + gazelle-update-repos after merging main

* Use aspect bazel cache

* Use Aspect bazel caching when calling bazel in bash and sg

* Append annotation

* Run apko lock on aspect agent

* Remove base image builds

Discussion in https://sourcegraph.slack.com/archives/C05EVRLQEUR/p1712307465660509

* Remove unused functionality

* Update BaseImageConfig comments

* Rewrite wolfi-images/README.md

* Add .apko/range.sh to .gitattributes

* Remove "wolfi" from :base_image and :base_tarball targets

* remove allowlist extras from debugging

* Tweak user instructions around package testing

* Add agent healthcheck to buildkite scripts

* prettier

---------

Co-authored-by: Noah Santschi-Cooney <noah@santschi-cooney.ch>
Co-authored-by: Noah S-C <noah@sourcegraph.com>
2024-04-05 13:57:45 +01:00