Commit Graph

17582 Commits (2c194e5cbf0b0bc0486bae5fcf3e294021369964)

Author SHA1 Message Date
Zuul 2c194e5cbf Merge "mirror: Add centos-stream link" 2021-11-16 00:27:45 +00:00
Ian Wienand ebc90eac5b mirror: Add centos-stream link
Missed this with I483c2982a6931e7d6fc97ab82f7750b72d2ef265; this
ensure the mirror webserver exports the directory.

Change-Id: I6e14cdace213a6af6df65b8ddb09bb3a167fbf9b
2021-11-16 09:25:56 +11:00
Zuul 1129e6855a Merge "Lower UID/GID range max to make way for containers" 2021-11-15 20:20:19 +00:00
Zuul 23e218a789 Merge "Cleanup users might have used" 2021-11-15 17:56:55 +00:00
Ian Wienand 855efc9010 Enable mirroring of 9-stream
This is a re-implementation of
I195ebee548071b0b89bd5bf64b251595271178ca that puts 9-stream in a
separate AFS volume

(Note the automated volume name "mirror.centos-stream" comes just
short of the limit)

Change-Id: I483c2982a6931e7d6fc97ab82f7750b72d2ef265
2021-11-15 17:54:54 +11:00
Ian Wienand d97eff271c Revert "Enable mirroring of centos stream 9 contents"
This reverts commit 8591ce2b5c.

It did not click that this is written to use
/afs/ as the base directory.  The
mirror/ directory has volumes mounted in it -- i.e. centos-stream has
to be a new volume (and also has to be "vos released" separately, the
existing script won't do it).

The simplest way to do this is to treat this separately.  I'll propose
this in a follow-on.

Change-Id: If7b8239adf7635da4f0c317287d23daf5ab0f4bf
2021-11-15 17:05:33 +11:00
Zuul 3c4a93fa7c Merge "Enable mirroring of centos stream 9 contents" 2021-11-15 05:23:13 +00:00
Chandan Kumar (raukadah) 8591ce2b5c Enable mirroring of centos stream 9 contents
It picks the rackspace mirror from this list
which is present in US.

It moves base directory to centos-stream to be consistent to centos

We will only synchronize x86_64 and aarch64 arches as those are the only
ones used in opendev CI. We also exculde source and debug directories to
optimize space usage as those are only required for debugging purposes.

Change-Id: I195ebee548071b0b89bd5bf64b251595271178ca
2021-11-12 09:41:26 +01:00
Zuul f793f30f8f Merge "reprepro: stop mirroring Debian stretch" 2021-11-12 00:45:41 +00:00
Zuul 9d62d024da Merge "gerrit: mark file reviewed during testing" 2021-11-11 05:31:46 +00:00
Ian Wienand f09460c498 reprepro: stop mirroring Debian stretch

Change-Id: I88c248645144c1f21d1c03d7d5b820b747f91089
2021-11-10 15:11:52 +11:00
Zuul 890d59cd5f Merge "Switch IPv4 rejects from host-prohibit to admin" 2021-11-09 20:36:01 +00:00
Zuul 4a118cf402 Merge "Retry cloning" 2021-11-09 20:22:57 +00:00
James E. Blair 1a48e06b54 Purge ZK snapshots more frequently
It looks like 6 hours is too infrequent and is enough time for the
disk to fill up when we're busy.  Instead, purge old snapshots every
2 hours, which looks like it should give us plenty of headroom with
our current usage pattern.

Change-Id: Ieb92d052e633e9326c41367442f036cc333c40f2
2021-11-08 07:34:46 -08:00
Zuul 28243caa7f Merge "Adjust RefStack build for osf->openinfra rename" 2021-11-08 02:20:52 +00:00
Zuul be2a12808e Merge "refstack: don't chown db directory" 2021-11-08 02:00:10 +00:00
Zuul 14919559c7 Merge "Add LE config for zuul01" 2021-11-08 00:51:26 +00:00
Ian Wienand 75e160180b gerrit: mark file reviewed during testing
Marking a file as "reviewed" will update the accountPatchDb database
and test the mariadb connection.

Change-Id: Ifaee5981e0977d7d1135275e7d8a0790075f670b
2021-11-08 10:39:49 +11:00
James E. Blair 1f88e74169 Add LE config for zuul01
The service-zuul playbook isn't happy without it.

Change-Id: I46bc43b2a7daa0a17dfbb6de664df1a38f344e75
2021-11-05 14:07:49 -07:00
Zuul 7ef6520aad Merge "Update zookeeper-statsd to python3.9 on bullseye" 2021-11-05 20:46:07 +00:00
Zuul a4cf92bb56 Merge "Run zookeeper-statsd as the zookeeper user" 2021-11-05 20:46:04 +00:00
Zuul 268665dc18 Merge "Run haproxy-statsd as uid 1000" 2021-11-05 19:28:31 +00:00
Zuul 2f77c9d76f Merge "Update haproxy-statsd to bullseye and python3.9" 2021-11-05 18:12:15 +00:00
Jeremy Stanley 698bb3df21 Lower UID/GID range max to make way for containers
In order to avoid unfortunate collisions with statically assigned
container account UIDs and GIDs, cap normal users at 9999. That way
we can set our containers to use IDs 10000 and above.

Make sure adduser/addgroup's adduser.conf gets adjusted to match the
values we set in the login.defs referenced by the lower-level
useradd/groupadd tools too. We're not using non-Debian-derivative
servers these days, so don't bother to try making this work on other
distributions for the time being.

Change-Id: I0068d5cea66e898c35b661cd559437dc4049e8f4
2021-11-05 18:06:55 +00:00
Clark Boylan 2828a51ef9 Run haproxy-statsd as uid 1000
This aligns it with what we have done for zookeeper-statsd.

Change-Id: Ida0e3c3e7dbcaf915119f7e2677edf95c7550eea
2021-11-05 16:45:32 +00:00
Zuul 3da6615b36 Merge "gerrit: don't chown mariadb container directory" 2021-11-05 09:25:17 +00:00
Clark Boylan 76a03f111d Cleanup users might have used
Cloud images bake in an ubuntu/centos/admin user then prevent root
logins. Early on in our boot process we copy authorized keys to root
then logout and back in again as root and proceed from there. This means
it should be safe to remove these "helpful" user accounts that we don't
use. Clean them up as they can only cause problems.

Change-Id: I9dc1e580cb69004f071370c21c2a5fda09e0cf5b
2021-11-04 16:57:54 -07:00
Clark Boylan 0f51ccf87f Update zookeeper-statsd to python3.9 on bullseye
We're currently on python3.9 on buster.

Change-Id: Ib8be56d44c89850cd63d700694cda174aa2efa4f
2021-11-04 16:49:04 -07:00
Clark Boylan 47cbfbf96a Run zookeeper-statsd as the zookeeper user
We may as well align it with the other processes running on this system.

Change-Id: I6de0e5463b3dc66eae46a771d70d1d741527a35e
2021-11-04 16:48:59 -07:00
Clark Boylan d1eaa07918 Don't set lodgeit db dir perms
The mariadb container is overriding these and we can race ansible
setting them back to root and the mariadb container starting up
resulting in a sad database.

Change-Id: Ib88f6aec83e73baf95a660165d13839f7baeed3d
2021-11-04 16:06:49 -07:00
Clark Boylan fd0aba7445 Update haproxy-statsd to bullseye and python3.9
We should generally try to keep these things up to date so do it now.

Change-Id: I59c21959094a87eb5a1e6f80e0a72be47370c072
2021-11-04 15:53:35 -07:00
Ian Wienand 88c984694e refstack: don't chown db directory
See I8d8ce5c62c660875d5c6eed54c686996576ec9df; mariadb containers
chown this to their internal user, we don't want to reset it.

Change-Id: If33a26438c6aa63d0ef0e02bdad6a643070be922
2021-11-05 09:39:29 +11:00
Ian Wienand 5f1c603b3d gerrit: don't chown mariadb container directory
We are currently re-chowning the running db directories back to root,
causing havoc for the db.  Drop the explicit permissions to avoid

Change-Id: I8d8ce5c62c660875d5c6eed54c686996576ec9df
2021-11-05 08:26:56 +11:00
Zuul 4e84d29e38 Merge "gerrit: update theme to javascript plugin" 2021-11-04 19:54:01 +00:00
Ian Wienand 6e232716e7 gerrit: update theme to javascript plugin
Gerrit 3.4 deprecates HTML-based plugins, so the old theme doesn't
work.  I have reworked this into a javascript plugin.

This should look the same, although I've achieved things in different

This doesn't register light and dark variants; since
background-primary-color is white, by setting the
header-background-color to this we get white behind the header bar,
and it correctly switches to the default black(ish) when in dark mode
(currently its seems the header doesn't obey dark mode, so this is an

I'm not sure what's going on with the extant header-border-image which
is a linear gradient all of the same color.  I modified this down to
1px (same as default) and made it fade in-and-out of the logo colour,
just for fun.

Change-Id: Ia2e32731c1cfe97639de2ec0e7660c7ed583e045
2021-11-04 18:45:18 +11:00
Zuul aee7d04b19 Merge "Add Fedora 35 mirror" 2021-11-03 23:42:35 +00:00
Ian Wienand b9d98cca21 borg-backup: skip .checkpoint archives
We may see an archive with ".checkpoint" on the end, as described in
[1]; the short version is this that borg stamps this every 30 minutes
and may appear if a long backup is interrupted.  Skip this when making
the list of archives to prune.

We noticed this on wiki-test; for clarity the list of archives looks

 wiki-upgrade-test-filesystem-2021-02-16T02:56:09.checkpoint Tue, 2021-02-16 02:56:11 [c444a0765e5791f3f68f08624d1efd80bf8a3ebc96bb225f08e4013befa2b460]
 wiki-upgrade-test-filesystem-2021-02-16T17:45:04 Tue, 2021-02-16 17:45:06 [b901b55ac3bf9abecba024caebad5ba7cd1a966e3f00b366f6cff45feba7bdff]
 wiki-upgrade-test-mysql-2021-02-16T18:35:09 Tue, 2021-02-16 18:35:11 [1d38cd3b4b1b3927b543e4ccc6c794cd3a513a70979ff025bbf303e1fe5e490f]
 wiki-upgrade-test-filesystem-2021-02-17T17:45:05 Wed, 2021-02-17 17:45:07 [f665e275c0014a21b82efaece5d36525a4ce6cb423253d5bd0b1323b230fa53a]


Change-Id: Ia33f46305ef8f541efb7c7150d4bb2e977b01d46
2021-11-03 12:39:10 +11:00
Ian Wienand 3918e15295 Add Fedora 35 mirror
Change-Id: I8dda96f4f23b331122b294329888698d1a4c7cd5
2021-11-03 08:08:54 +11:00
Ian Wienand 0b1a1ac099 Drop Fedora 33 mirror
Change-Id: Iee0f242ca155ea6ef254192cbbd7961f23e1c93e
2021-11-03 08:06:19 +11:00
Clark Boylan 04d60e25bf Rebuild gerrit images
Get the latest and greated gerrit and openjdk stuff.

Change-Id: I540d4d12fc4387e3912c191413aa77ce8ed60207
2021-11-01 13:18:47 -07:00
Zuul 66571449a3 Merge "reprepro: add note on removing components" 2021-10-29 23:41:08 +00:00
James E. Blair 879f37419c Add zuul01 to inventory
Change-Id: I7f43c51279847b1e28aa28d5232a3717f818ff51
2021-10-29 10:43:13 -07:00
Jeremy Stanley 25dc84fecf Update launch-node's default from bionic to focal
We only use Ubuntu 20.04 LTS (Focal) for new servers now.

Change-Id: I357a8c35ff608e43031bef64a58eefca3cd651e4
2021-10-29 16:42:48 +00:00
Ian Wienand 26d955f344 reprepro: add note on removing components
Change-Id: Ia50861042bb159a9e351321b2503f193eca4e576
2021-10-29 18:04:42 +11:00
Zuul c7398abb4c Merge "Reduce htcachclean limit on our mirrors" 2021-10-29 04:50:46 +00:00
Ian Wienand 458a06da8f reprepro: stop mirroring ubuntu-ports Xenial
We are no longer building or supporting ARM64 Xenial so do not need
this in the mirror.

Change-Id: Ifdaf07e6572e8c5cb2482c988acf0b6f93859782
2021-10-29 09:16:43 +11:00
Zuul b11ea07415 Merge "Upgrade to gitea 1.15.6" 2021-10-28 20:11:34 +00:00
Clark Boylan 9bec46ed2c Reduce htcachclean limit on our mirrors
We previously set the limit to 70200M on a ~98GB filesystem.
Unfortunately we are able to jump from the ~70GB limit to a full
filesystem before htcachclean happens to run again. Reduce the limit to
60000M to give us more headroom and hopefully avoid filling the fs
between cache clean runs.

Change-Id: I8aa45eb0c396b54dbb3ec84e5ba8fd4ec7da9e27
2021-10-28 11:29:17 -07:00
Clark Boylan f2cd358b70 Upgrade to gitea 1.15.6
Another bug fix release. We upgrade to keep up and not fall behind.
Release notes can be found at:

Change-Id: I44874476d6fd09f3333205b3036ed12000560cba
2021-10-28 08:37:04 -07:00
Zuul b73a99bc1e Merge "Limit zuul stop/start playbooks to zuul02" 2021-10-27 22:51:13 +00:00