17600 Commits

Author SHA1 Message Date
Ian Wienand
3c993c317b haproxy: map in config as ro
The container shouldn't need to write to its config

Change-Id: Iadbe7b663615623fbd6201aa1f2557b0eb267179
2021-12-01 09:57:05 +11:00
Ian Wienand
f29aa2da16 Make haproxy role more generic
This makes the haproxy role more generic so we can run another (or
potentially even more) haproxy instance(s) to manage other services.

The config file is moved to a variable for the haproxy role.  The
gitea specific config is then installed for the gitea-lb service by a
new gitea-lb role.

statsd reporting is made optional with an argument.  This
enables/disables the service in the docker compose.

Role documenation is updated.

Needed-By: https://review.opendev.org/678159
Change-Id: I3506ebbed9dda17d910001e71b17a865eba4225d
2021-12-01 09:55:45 +11:00
Zuul
81155d6e8f Merge "Update etherpad to 1.18.16" 2021-11-29 22:01:48 +00:00
Zuul
b2c1a9c545 Merge "Refactor infra-prod jobs for parallel running" 2021-11-29 19:58:44 +00:00
Clark Boylan
ce67fad1f5 Update etherpad to 1.18.16
This updates our etherpad image to version 1.18.16. To do this we've had
to adopt the upstream Dockerfile locally and introduce our own edits as
upstream hasn't build images for this release or the previous one.

Minor updates are made to the upstream Dockerfile to update the
maintainer directive and convert from using a local copy of the source
code to a git clone.

Change-Id: I561680072085caff751e08b6f2fd79dee1d4efe8
2021-11-29 08:44:55 -08:00
Jeremy Stanley
a96bbca946 Add zuul01 to cacti
It would be nice to get some idea of how its resource utilization
compares to 02, especially as it runs on a smaller flavor.

Change-Id: If00a949a575949cb3b1a2d8268ae29e4c4965a0b
2021-11-23 22:43:54 +00:00
Clark Boylan
ee9cec707b Partial revert of matrix-gerritbot user change
It complains about not being able to get or create the default cache
directory (but doesn't tell us what that directory is). We'll have to
sort this out later.

Change-Id: I5ce7a875ede77c6203d1b5d06da97f8c52ee48e1
2021-11-19 10:10:22 -08:00
Zuul
76a605a1dc Merge "Run matrix-gerritbot with gerritbot user" 2021-11-19 16:49:23 +00:00
Zuul
7cea2a9f83 Merge "infra-prod: remove master override steps" 2021-11-19 02:43:22 +00:00
Zuul
4f2d4cef4c Merge "Run gerritbot with a user that will be shared with matrix-gerritbot" 2021-11-18 19:00:16 +00:00
Zuul
2dfb8db232 Merge "infra-prod: remove duplicated bridge key setup" 2021-11-18 04:39:08 +00:00
Ian Wienand
d0467bfc98 Refactor infra-prod jobs for parallel running
Refactor the infra-prod jobs to specify dependencies so they can run
in parallel.

Change-Id: I8f6150ec2f696933c93560c11fed0fd16b11bf65
2021-11-18 10:31:11 +11:00
Ian Wienand
2bc34a1593 infra-prod: remove master override steps
The dependent change moves this into the common infra-prod-base job so
we don't have to do this in here.

Change-Id: I444d2844fe7c7560088c7ef9112893da1496ae62
Depends-On: https://review.opendev.org/c/opendev/base-jobs/+/818189
2021-11-18 09:07:00 +11:00
Ian Wienand
150b3a70da infra-prod: remove duplicated bridge key setup
The known_host key is written out by the parent infra-prod-base job in
the run-production-playbook.yaml step [1].  We don't need to do this
here again.

[1] 2c194e5cbf/playbooks/zuul/run-production-playbook.yaml (L1)

Change-Id: I514132b2dbc20ac321a79ca2eb6d4c8b11c4296d
2021-11-18 09:05:55 +11:00
Zuul
0a279742fc Merge "gerrit: test reviewed flag add/delete/add cycle" 2021-11-17 20:33:42 +00:00
Zuul
2c194e5cbf Merge "mirror: Add centos-stream link" 2021-11-16 00:27:45 +00:00
Ian Wienand
ebc90eac5b mirror: Add centos-stream link
Missed this with I483c2982a6931e7d6fc97ab82f7750b72d2ef265; this
ensure the mirror webserver exports the directory.

Change-Id: I6e14cdace213a6af6df65b8ddb09bb3a167fbf9b
2021-11-16 09:25:56 +11:00
Zuul
1129e6855a Merge "Lower UID/GID range max to make way for containers" 2021-11-15 20:20:19 +00:00
Zuul
23e218a789 Merge "Cleanup users launch-node.py might have used" 2021-11-15 17:56:55 +00:00
Ian Wienand
855efc9010 Enable mirroring of 9-stream
This is a re-implementation of
I195ebee548071b0b89bd5bf64b251595271178ca that puts 9-stream in a
separate AFS volume

(Note the automated volume name "mirror.centos-stream" comes just
short of the limit)

Change-Id: I483c2982a6931e7d6fc97ab82f7750b72d2ef265
2021-11-15 17:54:54 +11:00
Ian Wienand
d97eff271c Revert "Enable mirroring of centos stream 9 contents"
This reverts commit 8591ce2b5c689b5e438fc0bfe9d410be7e344fb1.

It did not click that this is written to use
/afs/.openstack.org/mirror/centos-stream as the base directory.  The
mirror/ directory has volumes mounted in it -- i.e. centos-stream has
to be a new volume (and also has to be "vos released" separately, the
existing script won't do it).

The simplest way to do this is to treat this separately.  I'll propose
this in a follow-on.

Change-Id: If7b8239adf7635da4f0c317287d23daf5ab0f4bf
2021-11-15 17:05:33 +11:00
Zuul
3c4a93fa7c Merge "Enable mirroring of centos stream 9 contents" 2021-11-15 05:23:13 +00:00
Chandan Kumar (raukadah)
8591ce2b5c Enable mirroring of centos stream 9 contents
It picks the rackspace mirror from this list
https://admin.fedoraproject.org/mirrormanager/mirrors/CentOS/9-stream/x86_64
which is present in US.

It moves base directory to centos-stream to be consistent to centos
mirrors.

We will only synchronize x86_64 and aarch64 arches as those are the only
ones used in opendev CI. We also exculde source and debug directories to
optimize space usage as those are only required for debugging purposes.

Change-Id: I195ebee548071b0b89bd5bf64b251595271178ca
2021-11-12 09:41:26 +01:00
Zuul
f793f30f8f Merge "reprepro: stop mirroring Debian stretch" 2021-11-12 00:45:41 +00:00
Zuul
9d62d024da Merge "gerrit: mark file reviewed during testing" 2021-11-11 05:31:46 +00:00
Ian Wienand
f09460c498 reprepro: stop mirroring Debian stretch
Depends-On: https://review.opendev.org/c/openstack/project-config/+/817339

Change-Id: I88c248645144c1f21d1c03d7d5b820b747f91089
2021-11-10 15:11:52 +11:00
Zuul
890d59cd5f Merge "Switch IPv4 rejects from host-prohibit to admin" 2021-11-09 20:36:01 +00:00
Zuul
4a118cf402 Merge "Retry acme.sh cloning" 2021-11-09 20:22:57 +00:00
Ian Wienand
db182ec017 gerrit: test reviewed flag add/delete/add cycle
A suggested follow-on to Ifaee5981e0977d7d1135275e7d8a0790075f670b

Change-Id: Ied549d90f9f8e336f1c6661d101480ed4d561b1b
2021-11-10 06:50:49 +11:00
James E. Blair
1a48e06b54 Purge ZK snapshots more frequently
It looks like 6 hours is too infrequent and is enough time for the
disk to fill up when we're busy.  Instead, purge old snapshots every
2 hours, which looks like it should give us plenty of headroom with
our current usage pattern.

Change-Id: Ieb92d052e633e9326c41367442f036cc333c40f2
2021-11-08 07:34:46 -08:00
Zuul
28243caa7f Merge "Adjust RefStack build for osf->openinfra rename" 2021-11-08 02:20:52 +00:00
Zuul
be2a12808e Merge "refstack: don't chown db directory" 2021-11-08 02:00:10 +00:00
Zuul
14919559c7 Merge "Add LE config for zuul01" 2021-11-08 00:51:26 +00:00
Ian Wienand
75e160180b gerrit: mark file reviewed during testing
Marking a file as "reviewed" will update the accountPatchDb database
and test the mariadb connection.

Change-Id: Ifaee5981e0977d7d1135275e7d8a0790075f670b
2021-11-08 10:39:49 +11:00
James E. Blair
1f88e74169 Add LE config for zuul01
The service-zuul playbook isn't happy without it.

Change-Id: I46bc43b2a7daa0a17dfbb6de664df1a38f344e75
2021-11-05 14:07:49 -07:00
Zuul
7ef6520aad Merge "Update zookeeper-statsd to python3.9 on bullseye" 2021-11-05 20:46:07 +00:00
Zuul
a4cf92bb56 Merge "Run zookeeper-statsd as the zookeeper user" 2021-11-05 20:46:04 +00:00
Zuul
268665dc18 Merge "Run haproxy-statsd as uid 1000" 2021-11-05 19:28:31 +00:00
Clark Boylan
7f9f1a2fad Run matrix-gerritbot with gerritbot user
This updates matrix-gerritbot to run with the same user as gerritbot.

Change-Id: Id2a473db9354871aa48ac9fd851573843cbac1b5
2021-11-05 11:24:10 -07:00
Clark Boylan
fd88087335 Run gerritbot with a user that will be shared with matrix-gerritbot
They have roughly the same level of access so lets align things.

Change-Id: Ifbe9dae7038345e20e8b498c87a37c519829a8cc
2021-11-05 11:24:05 -07:00
Zuul
2f77c9d76f Merge "Update haproxy-statsd to bullseye and python3.9" 2021-11-05 18:12:15 +00:00
Jeremy Stanley
698bb3df21 Lower UID/GID range max to make way for containers
In order to avoid unfortunate collisions with statically assigned
container account UIDs and GIDs, cap normal users at 9999. That way
we can set our containers to use IDs 10000 and above.

Make sure adduser/addgroup's adduser.conf gets adjusted to match the
values we set in the login.defs referenced by the lower-level
useradd/groupadd tools too. We're not using non-Debian-derivative
servers these days, so don't bother to try making this work on other
distributions for the time being.

Change-Id: I0068d5cea66e898c35b661cd559437dc4049e8f4
2021-11-05 18:06:55 +00:00
Clark Boylan
2828a51ef9 Run haproxy-statsd as uid 1000
This aligns it with what we have done for zookeeper-statsd.

Change-Id: Ida0e3c3e7dbcaf915119f7e2677edf95c7550eea
2021-11-05 16:45:32 +00:00
Zuul
3da6615b36 Merge "gerrit: don't chown mariadb container directory" 2021-11-05 09:25:17 +00:00
Clark Boylan
76a03f111d Cleanup users launch-node.py might have used
Cloud images bake in an ubuntu/centos/admin user then prevent root
logins. Early on in our boot process we copy authorized keys to root
then logout and back in again as root and proceed from there. This means
it should be safe to remove these "helpful" user accounts that we don't
use. Clean them up as they can only cause problems.

Change-Id: I9dc1e580cb69004f071370c21c2a5fda09e0cf5b
2021-11-04 16:57:54 -07:00
Clark Boylan
0f51ccf87f Update zookeeper-statsd to python3.9 on bullseye
We're currently on python3.9 on buster.

Change-Id: Ib8be56d44c89850cd63d700694cda174aa2efa4f
2021-11-04 16:49:04 -07:00
Clark Boylan
47cbfbf96a Run zookeeper-statsd as the zookeeper user
We may as well align it with the other processes running on this system.

Change-Id: I6de0e5463b3dc66eae46a771d70d1d741527a35e
2021-11-04 16:48:59 -07:00
Clark Boylan
d1eaa07918 Don't set lodgeit db dir perms
The mariadb container is overriding these and we can race ansible
setting them back to root and the mariadb container starting up
resulting in a sad database.

Change-Id: Ib88f6aec83e73baf95a660165d13839f7baeed3d
2021-11-04 16:06:49 -07:00
Clark Boylan
fd0aba7445 Update haproxy-statsd to bullseye and python3.9
We should generally try to keep these things up to date so do it now.

Change-Id: I59c21959094a87eb5a1e6f80e0a72be47370c072
2021-11-04 15:53:35 -07:00
Ian Wienand
88c984694e refstack: don't chown db directory
See I8d8ce5c62c660875d5c6eed54c686996576ec9df; mariadb containers
chown this to their internal user, we don't want to reset it.

Change-Id: If33a26438c6aa63d0ef0e02bdad6a643070be922
2021-11-05 09:39:29 +11:00