15647 Commits

Author SHA1 Message Date
Monty Taylor
179d1a2516 Collect production playbook output
We need to log to a file and then collect it to the log output on
zuul. Default to true to that steady-state reads nicely. When we
add new jobs we should make sure to set to false first so that we
can vett the output before publishing it.

Change-Id: Ia4f759b82a5fff6e36e4284c11281254c0d5627d
2020-03-30 15:56:59 -05:00
Monty Taylor
bde5860f57 Parameterize manage-projects logging output
Change-Id: If4c456957fdce308ccafee0dfad8b627a85ea796
2020-03-30 13:53:39 -05:00
Monty Taylor
b94a2c5b96 Update project-config in manage-projects
If we're going to trigger this from project-config, we should
make sure it updates project-config as a first step. Currently
it's counting on having run after service-review in run_all.sh.

Change-Id: I14ce9b42af533c742128ce87cda8c8fb897632e4
2020-03-30 10:00:12 -05:00
Zuul
a00499bf2f Merge "Really bindmount acls" 2020-03-29 15:38:56 +00:00
Monty Taylor
a2cd7d22c7 Really bindmount acls
There is a gerrit in the path.

Change-Id: I6b1a292e35a2de95de63bb90813cb6154573d8ce
2020-03-29 09:10:26 -05:00
Zuul
f986742ab9 Merge "Bind-mount acls dir to /home/gerrit2" 2020-03-28 21:36:59 +00:00
Zuul
7375566fd0 Merge "Use gerrit_vhost_name in projects.ini" 2020-03-28 20:30:44 +00:00
Monty Taylor
1a4e781173 Bind-mount acls dir to /home/gerrit2
Turns out our config has a bunch of hardcoded /home/gerrit2/acls
entries in it. That doesn't work if we're just pointing the
config file at /opt/project-config/gerrit/acls.

Change-Id: I387e446501e17a3bdd807807d5ef6b69b53abde5
2020-03-28 12:58:58 -05:00
Zuul
03740ae2ca Merge "Add an image pull to manage-projects playbook" 2020-03-28 17:58:39 +00:00
Monty Taylor
1be28fddf3 Use gerrit_vhost_name in projects.ini
We use this to make the .gitreview file too, so our thought that
we could just use localhost was a little misguided.

Change-Id: I501b10b2003c7e04ca1ac345d14fa33916b3e60b
2020-03-28 12:06:24 -05:00
Monty Taylor
d0d13566a0 Base run jobs needing containers on containers base
We have a new base job, system-config-run-containers, that does
what is needed to ensure images are pulled from the intermediate
registry when appropriate.

Also remove opendev-buildset-registry from jobs that neither
build nor consume images from this tenant.

Change-Id: I5de4a1ddbf336749160a3ef996b6b3f55bc46666
2020-03-27 21:32:45 +00:00
Monty Taylor
cc1929d075 Add an image pull to manage-projects playbook
When we run manage-projects, we always want the latest image.

Add a task file to the gerrit role so that it can have access
to role default variables. Then call it from the playbook
with tasks_from.

Change-Id: I08bd10539d7f08e8759f1c22d66dea18821c9d42
2020-03-27 15:58:41 -05:00
Zuul
50391bcfad Merge "Run manage-projects on gerrit servers" 2020-03-27 18:34:14 +00:00
Zuul
fed0d56b09 Merge "Add meetpad01 to inventory" 2020-03-27 17:50:50 +00:00
Zuul
66097bcfea Merge "Use our jitsi-meet image for meetpad" 2020-03-27 17:47:00 +00:00
James E. Blair
ecd3ecb4d4 Add meetpad01 to inventory
Change-Id: I3accead9f3a6f429574e03492cfbd4883a42a4bc
2020-03-27 10:02:31 -07:00
James E. Blair
6ee1cfa736 Use our jitsi-meet image for meetpad
Change-Id: I0be6adf3852c7ab475ab6b4cfc8e53e207c382d1
2020-03-27 09:43:41 -07:00
Zuul
f892f0690e Merge "jitsi-meet: open etherpad on join" 2020-03-27 14:48:18 +00:00
Zuul
bfe1af5747 Merge "Build jitsi-meet images" 2020-03-27 14:48:16 +00:00
Zuul
ce3a064133 Merge "Add meetpad server" 2020-03-27 14:44:30 +00:00
Zuul
e71a4e8ada Merge "Remove gitea doc links" 2020-03-27 13:46:57 +00:00
Zuul
7fdc05318b Merge "Add links to dev docs on gitea" 2020-03-27 13:10:56 +00:00
Zuul
33466802fe Merge "Build gerrit 2.14 as well" 2020-03-27 12:07:38 +00:00
Zuul
d73060f19a Merge "Add IRC bots to OpenInfra Labs channels" 2020-03-27 11:58:54 +00:00
Monty Taylor
6cd8b4f466 Build gerrit 2.14 as well
People keep recommending upgrading to 2.14 as a step to 2.15.
It's bazel based- let's add it to the list of builds.

Change-Id: Ic037d91bfc631e87e643dbedd231bb21298a11ee
2020-03-26 12:46:51 -05:00
David Shrewsbury
b0e2df07b4 Remove shrews from infra-root
Change-Id: I55d9670f216fb6d36be8ec080fcc02e40bf83a68
2020-03-26 13:38:02 -04:00
Clark Boylan
8bcc9bba24 Remove gitea doc links
These render as "help" links in the UI and for most of our users will
just be an attractive nuisance since we don't manage accounts and repos
and such directly in gitea.

Change-Id: Iea4bd262dd6304bc1d423f1bf23dacc4333f506b
2020-03-26 10:16:20 -07:00
Clark Boylan
e6639c52c1 Add links to dev docs on gitea
Currently if you end up at opendev.org it isn't clear how to start
contributing code. Add a "Get Started" link to the nav bar header to
will send you to the opendev developer docs.

Note we may want to consider updating the developer docs to be a better
landing page or even create a new doc for that, but this is a start.

Change-Id: Iee43e2552c1be2e4cd46f43f050e476f140530ad
2020-03-26 10:15:39 -07:00
Zuul
2bf5de8f72 Merge "Start making 3.8 python images" 2020-03-26 13:43:27 +00:00
Ian Wienand
14f39644b5 Remove old hosts from cacti
These no longer exist

Change-Id: I0c180781627264a4cff9032120e9b27edfd93306
2020-03-26 11:05:58 +11:00
James E. Blair
b478ad2acf jitsi-meet: open etherpad on join
For our meetpad service, modify jitsi-meet to open the etherpad
when a user joins.

There is an upstream PR for this, but until it lands or is rejected,
this clones from a temporary github repo with the patch.

Change-Id: Idd33a68a4fe7a90c75c5988bd1fd6136b8b7db08
2020-03-25 16:37:54 -07:00
Ian Wienand
dcc23be55b Remove static site puppet
Remove the puppet related to the static server

Story: #2006598
Task: #36758

Change-Id: I744da83d811e715ff8049eacf3013cd4831e1c49
2020-03-26 10:36:16 +11:00
Ian Wienand
f55580fbf0 Remove files02.openstack.org and related puppet
All this has moved to static.opendev.org; the server can now be
removed.

Change-Id: I8ca5d7a206e950c28bb8372a85b6a62d6b9ba00c
2020-03-26 10:36:13 +11:00
Monty Taylor
5d79086350 Run manage-projects on gerrit servers
We have a wrapper script now that works on the gerrit servers.
Run it after we run the gitea repo creation.

Remove the -it since this is not an interactive run. Add net=host
so that localhost maps. And set the server to localhost.

Don't run manage-projects in gate jobs for run-review yet, because
we don't have a functioning enough gerrit. We can follow up with
that.

Change-Id: I8c0eb5d7973815ae21d4d5bc1be8d4bdfe56d7fc
2020-03-25 17:50:52 -05:00
Monty Taylor
650392c700 Start making 3.8 python images
base and builder are currently pinned to 3.7, which makes it hard
to consider upgrading to python-3.8. To help with that, make
python-3.7 and python-3.8 images, but point latest as 3.7 for the
time being. Then add version-specific provides and FROM lines
so that we can start being deliberate and clear about our version
choice.

Change-Id: Ibf1d846d5c4a005547785124567ce2900e272a7a
2020-03-25 17:45:39 -05:00
James E. Blair
c79c11c2b7 Build jitsi-meet images
So that we can run jitsi-meet with local modifications, build our
own container images.  This builds the base, prosody, and web images
from the docker-jitsi-meet project.  That project has distinct
Dockerfiles for each image, but for simplicity, this change combines
them into a single multi-stage Dockerfile.  The minor stylistic
differences between the different sections are a result of that, and
are intentional in order to minimise the delta from the source material.

Again, for simplicity, this change does not publish the base image
since it is not anticipated that we will run this build often.  If we do,
we could split this back out.

The upstream images are based on pre-built debian packages hosted by
the jitsi project.  Since our goal is to modify the software, we will
need to rebuild the debian packages as well.  This adds a new builder
image that is used to build the debian packages initially.

The docker-jitsi-meet project also has Dockerfiles for several more
images, but since the immediate need is only for the "web" image (built
from the "jitsi-meet" project), we only build that image and the "prosody"
image (not strictly necessary, but it is also a product of the "jisti-meet"
repository, so it seems a good practice to build it as well).

Change-Id: Ib3177ebfe2b8732a3522a1fa101fe95586dd1e1b
2020-03-25 15:40:50 -07:00
Zuul
8171dc437c Merge "Added new param to IDP config" 2020-03-25 22:18:04 +00:00
Zuul
66e6c84e40 Merge "Disable recommends in python-base and python-builder" 2020-03-25 22:18:02 +00:00
James E. Blair
8b093dacd5 Add meetpad server
Depends-On: https://review.opendev.org/714189
Change-Id: I5863aaa805a18f9085ee01c3205b0f9ad602922d
2020-03-25 07:44:24 -07:00
smarcet
de04c6da67 Added new param to IDP config
Added user_spam_processor_to to dev/production

Change-Id: I36a41bdcd23df9540183da5a087d364778d60b48
Signed-off-by: smarcet <smarcet@gmail.com>
2020-03-25 11:32:17 -03:00
Zuul
033c4b771e Merge "Override RAX block storage endpoint" 2020-03-24 22:46:53 +00:00
Zuul
75cd279898 Merge "Actually write out the projects.ini config file" 2020-03-24 22:46:51 +00:00
Zuul
d2decc6cdc Merge "Note about gitea functionality on opendev.org" 2020-03-24 22:04:37 +00:00
Monty Taylor
4178296b49 Override RAX block storage endpoint
This is required because RAX have an odd /v2 that isn't listed in the
catalogue but actually exists (but isn't really full /v2/ support).
It became a problem when recent client versions dropped /v1 support,
so now we have to force them to v2 like this.

Depends-On: https://review.opendev.org/714624
Change-Id: I6f139d2b3036ef0ecaddf3a9a225faae3a2b0450
2020-03-25 08:34:46 +11:00
Zuul
5b6d2fb4e9 Merge "OpenStackID 3.0.6 production deployment" 2020-03-24 20:50:37 +00:00
Monty Taylor
2d208f0df9 Actually write out the projects.ini config file
We have a template for it in tree, but we're not, you know,
templating it.

Change-Id: Ic6b3ecc62cdfc7c486a912ba4863c7c4c7734e0a
2020-03-24 14:39:12 -05:00
Clark Boylan
d679a9e197 Note about gitea functionality on opendev.org
We seem to semi regularly get questions about why we don't use features
like Gitea's issue tracker and wiki. Add that to the opendev.org front
page FAQ.

Change-Id: Ie5c4602741dcdb9cc4e87b9286a8f6b8b7ed7934
2020-03-24 09:33:16 -07:00
Monty Taylor
643623ba8a Disable recommends in python-base and python-builder
We disable these on our VM images, so might as well make our
container images follow suit. Could make them a smidge smaller.
Also do it in the gerrit-base image.

Change-Id: Iba60cf5c7009d57c4910f9e4464aff9231598ad6
2020-03-23 16:06:43 -05:00
Zuul
f27825d44e Merge "Add system-config to required-projects for gerrit images" 2020-03-23 20:42:54 +00:00
Monty Taylor
5948b89b20 Add system-config to required-projects for gerrit images
For us to build gerrit images from other repos, we kind of need
system-config to be in the list of required-projects.

Change-Id: Id3712fae876cb1f8e8abf2bf0a93c781f2538287
2020-03-23 14:21:26 -05:00