145 Commits

Author SHA1 Message Date
Clark Boylan
2cbd400c4e Remove Gerrit 3.5 images
This disables the upgrade testing temporarily with the intention of
adding it back again when we build 3.7 images and can test the 3.6 to
3.7 upgrade.

Change-Id: I102795248ab9e692e4558257d94d5b3e0b73267e
2023-01-10 12:32:32 -08:00
Zuul
b879e5fad7 Merge "Fork the maxking/docker-mailman images" 2022-11-22 18:11:24 +00:00
Clark Boylan
12d4355385 Fork the maxking/docker-mailman images
These images have a number of issues we've identified and worked
around. The current iteration of this change is essentially
identical to upstream but with a minor tweak to allow the latest
mailman version, and adjusts the paths for hyperkitty and postorius
URLs to match those in the upstream mailman-web codebase, but
doesn't try to address the other items. However, we should consider
moving our fixes from ansible into the docker images where possible
and upstream those updates.

Unfortunately upstream hasn't been super responsive so far hence this
fork. For tracking purposes here are the issues/PRs we've already filed
upstream:

  https://github.com/maxking/docker-mailman/pull/552
  https://github.com/maxking/docker-mailman/issues/548
  https://github.com/maxking/docker-mailman/issues/549
  https://github.com/maxking/docker-mailman/issues/550

Change-Id: I3314037d46c2ef2086a06dea0321d9f8cdd35c73
2022-11-21 16:51:02 +00:00
Clark Boylan
5e8d704278
Update Gerrit images to 3.5.4 and 3.6.3
Gerrit made new releases and we should update to them. Release notes can
be found here:

  https://www.gerritcodereview.com/3.5.html#354
  https://www.gerritcodereview.com/3.6.html#363

The main improvement for us is likely to be the copy approvals
performance boosts and error handling. We still need to run that prior
to our 3.6 upgrade.

Note we currently only run 3.5 in production but we test the 3.6 upgrade
from our current production version so it makes sense to update the 3.6
image as well.

Change-Id: Idf9a16b443907a2d0c19c1b6ec016f5d16583ad2
2022-11-11 13:20:36 +11:00
Clark Boylan
ee359c7e3b Add python 3.11 docker images
Python 3.11 has been released. Once the parent commit of this commit
lands we will have removed our python3.8 images making room for
python3.11 in our image list. Add these new images which will make way
for running and testing our software on this new version of python.

Change-Id: Idcea3d6fa22839390f63cd1722bc4cb46a6ccd53
2022-10-25 10:43:29 -07:00
Clark Boylan
df4f11393b Drop python 3.8 base image builds
Python 3.11 is coming up and running image builds for all the pythons
gets overwhelming fast. We end up with so many jobs that landing any one
change to our base images becomes difficult. To reduce the total count
we remove builds for 3.8 to make room for 3.11. Only a few things appear
to still be using the 3.8 images and their updates are all listed as
depends on below.

Depends-On: https://review.opendev.org/c/opendev/gerritbot/+/861474
Depends-On: https://review.opendev.org/c/opendev/grafyaml/+/861475
Depends-On: https://review.opendev.org/c/opendev/statusbot/+/861476
Depends-On: https://review.opendev.org/c/zuul/zuul-client/+/861477
Depends-On: https://review.opendev.org/c/zuul/zuul-operator/+/861478
Depends-On: https://review.opendev.org/c/zuul/zuul-registry/+/861479
Change-Id: Ifa44ed0586f54b7ee4d6e37ba32235d63a30addb
2022-10-14 14:34:03 -07:00
Clark Boylan
3e3e053f49 Resync gerrit plugin versions to latest gerrit releases
This was missed in the effort to push out Gerrit 3.5.3 as well as the
ssh rsa sha2 fixes. That said it should be mostly fine as all of the
plugins tagged 3.5.2 have tagged the same commit with 3.5.3. Making this
largely a bookkeeping change.

There is one bit that isn't strictly bookkeeping and that is the
plugins/its-base checkout. Against gerrit 3.5 we convert from a master
checkout [0] to a stable-3.5 [1] checkout as this branch exists now.
Against gerrit 3.6 we convert from a stable-3.6 checkout to a master
checkout. I suspect that a stable-3.6 branch existed for a short period
of time and was cleaned up and zuul is using an old cached state.

The change for its-base on gerrit 3.5 does represent a reversion of
three commits but they all seem related to gerrit 3.6 so I expect this
is fine.

[0] https://gerrit.googlesource.com/plugins/its-base/+log/refs/heads/master
[1] https://gerrit.googlesource.com/plugins/its-base/+log/refs/heads/stable-3.5

Change-Id: I619b28fe642ca8b57eb533157ec0a441f6b66890
2022-10-13 16:54:12 -07:00
Clark Boylan
970d5f6a06 Update python builder and base image
It is a good idea ot periodically update our base python images. Now is
a good time to do it as we've got debian bullseye updates and python
minor releases. The bullseye updates fix a glibc bug that was affecting
Ansible in the zuul images. With this update we'll be able to remove the
workaround for that issue.

We also update the builder image's apt-get process to include a clean to
match tbe base image. This is more for consistency than anything else.

Finally update job timeouts for builds as it seems we occasionally need
more time particularly for emulated arm64 builds.

Change-Id: I31483ff434f19f408aef3b63cb2cd24044a8bf29
2022-09-13 11:39:10 -07:00
Clark Boylan
1da5615477 Add Gerrit 3.6 jobs
This adds Gerrit 3.6 image build jobs as well as CI testing for this
version of Gerrit. Once we've got images that build and function
generally we'll reenable the upgrade job and work through that.

Change-Id: I494a21911a2279228e57ff8d2b731b06a1573438
2022-06-21 16:54:36 -07:00
Clark Boylan
063ec0f5a7 Remove Gerrit 3.4 jobs
This removes our Gerrit 3.4 image builds as well as testing. We should
land this after an appropriate amount of time has passed since the 3.5
upgrade that we are unlikely to revert.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/847057
Change-Id: Iefa7cc1157311f0239794b15bea7c93f0c625a93
2022-06-21 16:27:46 -07:00
Clark Boylan
819d3ce480 Update Gerrit images to 3.4.5 and 3.5.2
3.4.5 is a fairly minor update. Some bugs are fixed and jgit is updated.

3.4.5 release notes:
  https://www.gerritcodereview.com/3.4.html#345

3.5.2 is a bigger update and important adds support for being able to
upgrade to 3.6.0 later. There is a new copy-approvals command that must
be run offline on 3.5.2 before upgrading to 3.6.0. This copies approvals
in the notedb in a way that 3.6.0 can handle them apparently. The
release notes indicate this may take some time to run. We don't need to
run it now though and instead need to make note of it when we prepare
for the 3.6.0 upgrade.

3.5.2 release notes:
  https://www.gerritcodereview.com/3.5.html#352

For now don't overthink things and instead just get up to date with our
images.

Change-Id: I837c2cbb09e9a4ff934973f6fc115142d459ae0f
2022-05-25 08:37:33 -07:00
Clark Boylan
183f2a9c9c Update Gerrit build checkouts
This will ensure we rebuild our gerrit images on the latest content from
upstream.

Change-Id: Ibcb1d076d897d9e24d7351dae156b37142ad0f34
2022-04-25 11:14:40 -07:00
Zuul
4de58bd423 Merge "Add Bullseye Python 3.10 base images" 2022-04-20 23:21:06 +00:00
Zuul
42d51e4d2d Merge "Remove python3.7-bullseye docker images" 2022-04-20 22:33:00 +00:00
Zuul
7efc08e7b4 Merge "Remove our buster python images" 2022-04-20 16:42:06 +00:00
Clark Boylan
90effa2af0 Add Bullseye Python 3.10 base images
Now that we've cleaned up the old unused images we can look forward to
new Python. Add Python 3.10 base images based on Bullseye.

As part of this process we update the default var values in our
Dockerfiles to set Bullseye and Python3.10 as our defaults as these
should be valid for some time. We also tidy up some yaml anchor names to
make future copy and paste for new versions of images easier to perform
text replacement on.

Change-Id: I4943a9178334c4bdf10ee5601e39004d6783b34c
2022-04-20 08:39:52 -07:00
Clark Boylan
2d43f9322b Remove python3.7-bullseye docker images
Everything is running on 3.8 or newer which should allow us to remove
the 3.7 images. This reduces the total set before we add python3.10
images and acts as good cleanup.

Change-Id: I2cc02fd681485f35a1b0bf1c089a12a4c5438df3
2022-04-18 13:42:30 -07:00
Clark Boylan
78999b020e Remove our buster python images
We've moved onto bullseye for just about everything at this point. It is
possible there are stragglers and the removal of these jobs should flag
them if their dependencies and requirements are set properly. Otherwise
they'll continue to pull the historical builds on docker hub. Either way
we'll either shake them out or they will continue until they can move to
bullseye.

We remove these in preparation for adding python3.10 images which don't
make sense for buster and our total image catalog is getting large
enough that successfully building and promoting this entire set is
getting problematic. A bit of spring cleaning on what we can commit to
before we commit to some new stuff.

Depends-On: https://review.opendev.org/c/opendev/gear/+/838402
Depends-On: https://review.opendev.org/c/opendev/storyboard/+/838403
Change-Id: I58c4d314ca4f4be3f1e17ec267a4c324cabf0c2a
2022-04-18 13:42:03 -07:00
Clark Boylan
dfcbcd1808 Switch Refstack image over to python3.9
Refstack is running python3.9 jobs now and they appear to be passing.
Update our image to python3.9 so that we are consistently using
python3.9 in as many locations as possible. Maybe one day we can drop
the 3.7 and 3.8 image builds too.

Change-Id: Iadb84f8f3756fe717ab6bcda0303bc23ff69ad6d
2022-04-18 13:23:39 -07:00
Clark Boylan
3381b58fbd Use deb-docker mirror for upload image too
Upload is based on build, since it builds and uploads for the
gate. This means we need to add the mirror here too, so that we're
installing docker from the deb mirror.

We convert to https at the same time for both jobs.

Change-Id: Ie1ff253e6cfc3e666a4e6be919a08f3a5d041319
2022-03-15 16:05:47 -07:00
Clark Boylan
47c242ff21 Pull gerrit/plugins/gitiles from stable branch not tag
This plugin was updated to accomodate the ${hash} substition in gerrit
gitweb weblinks. We now need this updated version to build Gerrit
successfully but there is no tag for it yet. Just use the branch to
address this.

Change-Id: I4b0fd4ac845cc4289f78aacfa536db4185f12d38
2022-03-03 10:48:03 -08:00
Clark Boylan
a3cc983502 Add Gerrit 3.5 image builds and testing
This will build gerrit 3.5 images and run it through our standard Gerrit
testing. Upgrade testing from 3.4 to 3.5 to follow in followup changes.

Change-Id: I76d0389d1455e62b242aad1926b3a09830301801
2022-02-03 08:09:14 -08:00
Zuul
fd3cd75f7c Merge "Stop building Gerrit 3.3 images" 2022-02-03 05:50:59 +00:00
Zuul
f339b7cdab Merge "Better organize gerrit plugins in job defs" 2022-02-02 23:51:23 +00:00
Clark Boylan
4e9da3c255 Stop building Gerrit 3.3 images
We've upgraded to 3.4 and don't appear to be reverting. Remove the 3.3
images as they are no longer needed.

Note we comment out the review upgrade testing jobs until we have 3.5
images building.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/827562
Change-Id: I0e3cb81b790ab06c690ed0245526e4f47911c584
2022-02-02 14:03:28 -08:00
James E. Blair
1492f22faa Use grafyaml container image
Instead of building a local grafana image with grafyaml installed,
use the plain upstream grafana image along with the newly created
separate opendev grafyaml image to run the dashboards.

Depends-On: https://review.opendev.org/780119
Change-Id: If0d584f848f213aeea385885e3decfaee6303de5
2022-01-20 09:25:00 +11:00
Zuul
4fdb4907fd Merge "Update Gerrit images to 3.3.9 and 3.4.3" 2022-01-18 17:39:11 +00:00
Zuul
d2016bcba0 Merge "Update refstack image to bullseye" 2022-01-12 17:50:17 +00:00
Clark Boylan
7f5f0bd4df Update refstack image to bullseye
Some spring cleaning now that bullseye is available. While we are at it
we fix up the job requires and provides for the related image building
and service testing jobs too.

Change-Id: I8a392e06df66b2e0c85157e61e529bb649d8ad58
2022-01-10 11:20:24 -08:00
Clark Boylan
de10234b9b Better organize gerrit plugins in job defs
The comments around the organization of these plugins wasn't accurate.
Instead of grouping them by git repo state group them by what
functionality they affect.

Change-Id: I6a21574e7079b7ddda520f727bef5562e5999126
2022-01-10 09:17:42 -08:00
Clark Boylan
3fdec9d20f Update Gerrit images to 3.3.9 and 3.4.3
This includes the fixes for right to left unicode that we've already
picked up, but now in an official release. It also updates Elasticsearch
support to prevent use with elasticsearch versions that are vulnerable
to log4shell. We don't use elasticsearch with Gerrit so this doesn't
affect us.

Change-Id: Ifbba7391bd16bc20c003293030a71e0ea787d0c7
2021-12-27 11:41:56 -08:00
Zuul
a1885ef992 Merge "Update limboria ircbot to bullseye" 2021-12-15 22:27:33 +00:00
Zuul
29fbc1f078 Merge "Update matrix-eavesdrop image to bullseye" 2021-12-15 17:46:36 +00:00
Zuul
57d5e116a0 Merge "Update the accessbot image to bullseye" 2021-12-14 23:40:39 +00:00
Zuul
63fb188aa3 Merge "Update the hound image to bullseye" 2021-12-13 22:08:29 +00:00
Clark Boylan
22957c6549 Update limboria ircbot to bullseye
Spring cleaning updates of our docker images now that bullseye is out.

Change-Id: I5e4b84edd2c5a8e196659e4815c5b349c0226393
2021-12-13 09:22:17 -08:00
Clark Boylan
ed0526cd8b Update the accessbot image to bullseye
This is general spring cleaning that we are going to try and do for our
images now that bullseye is out.

Change-Id: Iad8f5b76896b88a6aafbfba0c38d0749b9d5c88f
2021-12-13 09:18:56 -08:00
Clark Boylan
b07d5eca37 Update matrix-eavesdrop image to bullseye
Just some spring cleaning now that bullseye is released.

Change-Id: I9641dae9ee7679fb45bef93e770f69d9673d75bf
2021-12-13 09:12:10 -08:00
Clark Boylan
8530ed39a1 Update the hound image to bullseye
Just some spring cleaning now that bullseye has released.

Change-Id: I1202400932860a04841d376b9f10beb89acc175c
2021-12-13 09:04:20 -08:00
Clark Boylan
999edcc88b Remove melody
We don't need this plugin right now

Change-Id: I7b2f0d831579076d890ef8dd3bbe6e14fa1371bc
2021-12-10 10:00:41 -08:00
Clark Boylan
4285b40928 Upgrade to gerrit 3.3.8
There are new gerrit releases. This change updates our production 3.3
image to 3.3.8. We also update Our 3.4 image to 3.4.2 to keep up there.

Release notes for both:

  https://www.gerritcodereview.com/3.3.html#338
  https://www.gerritcodereview.com/3.4.html#342

Seems to largely be bugfixes and reindexing improvements.

Change-Id: Iae8aa403b4001937320767d4166a6af2bc89a2ea
2021-11-29 16:18:15 -08:00
Zuul
7ef6520aad Merge "Update zookeeper-statsd to python3.9 on bullseye" 2021-11-05 20:46:07 +00:00
Clark Boylan
0f51ccf87f Update zookeeper-statsd to python3.9 on bullseye
We're currently on python3.9 on buster.

Change-Id: Ib8be56d44c89850cd63d700694cda174aa2efa4f
2021-11-04 16:49:04 -07:00
Clark Boylan
fd0aba7445 Update haproxy-statsd to bullseye and python3.9
We should generally try to keep these things up to date so do it now.

Change-Id: I59c21959094a87eb5a1e6f80e0a72be47370c072
2021-11-04 15:53:35 -07:00
Clark Boylan
2f11da87b0 Build Gerrit 3.3.7 images
This updates our Gerrit 3.3 images to the new 3.3.7 release.

Change-Id: Ib676be49bcc9cd4633dbe6fe87dd6e3a32185a55
2021-10-14 11:46:44 -07:00
Zuul
da1bd39a2a Merge "Remove Gerrit 3.2 images" 2021-10-12 20:59:11 +00:00
Zuul
39285a57e4 Merge "Start building gerrit 3.4" 2021-10-10 22:30:40 +00:00
Clark Boylan
46faa6626b Remove Gerrit 3.2 images
This should be merged after we are on 3.3 and happy with the state of
things.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/813081
Change-Id: I4173df5e4ae38af6423402be0299470323762da2
2021-10-07 20:07:38 +00:00
Monty Taylor
d49f399b17 Start building gerrit 3.4
Change-Id: I9cd8c9e1fb837dae91057da9bc80a3f15e566a59
2021-10-07 11:54:50 -07:00
Clark Boylan
c42099717b Fix gerrit image dep in zuul config
When we moved gerrit to bullseye images we failed to update this
depedency in zuul. Fix that.

Change-Id: I2cc4f8ca8137c4b78d437ab695e8ff831178e1f5
2021-10-07 11:50:13 -07:00