15606 Commits

Author SHA1 Message Date
Monty Taylor
5d79086350 Run manage-projects on gerrit servers
We have a wrapper script now that works on the gerrit servers.
Run it after we run the gitea repo creation.

Remove the -it since this is not an interactive run. Add net=host
so that localhost maps. And set the server to localhost.

Don't run manage-projects in gate jobs for run-review yet, because
we don't have a functioning enough gerrit. We can follow up with
that.

Change-Id: I8c0eb5d7973815ae21d4d5bc1be8d4bdfe56d7fc
2020-03-25 17:50:52 -05:00
Zuul
033c4b771e Merge "Override RAX block storage endpoint" 2020-03-24 22:46:53 +00:00
Zuul
75cd279898 Merge "Actually write out the projects.ini config file" 2020-03-24 22:46:51 +00:00
Zuul
d2decc6cdc Merge "Note about gitea functionality on opendev.org" 2020-03-24 22:04:37 +00:00
Monty Taylor
4178296b49 Override RAX block storage endpoint
This is required because RAX have an odd /v2 that isn't listed in the
catalogue but actually exists (but isn't really full /v2/ support).
It became a problem when recent client versions dropped /v1 support,
so now we have to force them to v2 like this.

Depends-On: https://review.opendev.org/714624
Change-Id: I6f139d2b3036ef0ecaddf3a9a225faae3a2b0450
2020-03-25 08:34:46 +11:00
Zuul
5b6d2fb4e9 Merge "OpenStackID 3.0.6 production deployment" 2020-03-24 20:50:37 +00:00
Monty Taylor
2d208f0df9 Actually write out the projects.ini config file
We have a template for it in tree, but we're not, you know,
templating it.

Change-Id: Ic6b3ecc62cdfc7c486a912ba4863c7c4c7734e0a
2020-03-24 14:39:12 -05:00
Clark Boylan
d679a9e197 Note about gitea functionality on opendev.org
We seem to semi regularly get questions about why we don't use features
like Gitea's issue tracker and wiki. Add that to the opendev.org front
page FAQ.

Change-Id: Ie5c4602741dcdb9cc4e87b9286a8f6b8b7ed7934
2020-03-24 09:33:16 -07:00
Zuul
f27825d44e Merge "Add system-config to required-projects for gerrit images" 2020-03-23 20:42:54 +00:00
Monty Taylor
5948b89b20 Add system-config to required-projects for gerrit images
For us to build gerrit images from other repos, we kind of need
system-config to be in the list of required-projects.

Change-Id: Id3712fae876cb1f8e8abf2bf0a93c781f2538287
2020-03-23 14:21:26 -05:00
Jeremy Stanley
8da233817b Re-add secret decrypting docs
These are useful for the times when a secret needs to be decrypted
for debugging but seem to have been deleted when we did the zuulv3
migration removal.

Change-Id: Ib1544d9032df9bd25c50eeca032f643e40f035b0
2020-03-23 13:16:05 -05:00
Zuul
81b76694ca Merge "Remove registry mirror settings" 2020-03-23 17:23:04 +00:00
Zuul
6f89eeb688 Merge "Put gerrit image jobs into a project-template" 2020-03-23 15:22:39 +00:00
Zuul
48210eead2 Merge "Set zuul_work_dir for system-config-*-image" 2020-03-23 15:22:37 +00:00
Zuul
c8b6312430 Merge "Install utility scripts for running jeepyb commands" 2020-03-23 14:34:51 +00:00
Zuul
cbdecbd696 Merge "Use dev subdir on review-dev for project-config things" 2020-03-23 14:34:49 +00:00
Monty Taylor
964db9bbf9 Remove registry mirror settings
These are set in the job now, so we don't need them
here.

Depends-On: https://review.opendev.org/714306
Change-Id: I8ff79ffc0fc0ab3d914966d72fe7eb52865ecee5
2020-03-23 09:32:52 -05:00
Zuul
2c89ce1807 Merge "Split gitea and gerrit services from manage-projects" 2020-03-23 14:28:40 +00:00
Andreas Jaeger
62e76b5177 Docs: Update main page for OpenDev
Update conf.py and index.rst for OpenDev.

Use newer openstackdocstheme and update conf.py for this.

Change-Id: I62312ca1d3fda9221660b7bb664c8ea55dac68a4
2020-03-22 19:14:51 +01:00
Zuul
e292f95069 Merge "Add opendev-buildset-registry depends where overridden" 2020-03-22 16:24:45 +00:00
Monty Taylor
4fcf044aa1 Put gerrit image jobs into a project-template
We need to run these on jeepyb patches since we're
including jeepyb into gerrit images. We also need to
add jeepyb/* to the file matchers of the jobs.

Change-Id: I4479b5cef44d3c17d5c5d9412e6c1f127bf699e3
2020-03-22 11:19:01 -05:00
Monty Taylor
9e83225632 Set zuul_work_dir for system-config-*-image
When we use these outside of system-config (like in jeepyb)
the paths are all wrong for finding the docker context. Set
zuul_work_dir on the base jobs so that it works as expected
when we trigger from other places.

Change-Id: I986fe0d12ebfb94bd81fbe3ff1ae51b6f0dd68c7
2020-03-22 11:19:01 -05:00
Monty Taylor
e6d98f0181 Install utility scripts for running jeepyb commands
jeepyb is installed in the gerrit image because of hook scripts.
To run manage-projects and track-upstream, make wrapper scripts
in /usr/local that runs the commands from in the container image
bind-mounting the appropriate dirs and files into the container.

Change-Id: I7ef1f00e69d4c310d69d83c80ca210e8f340878d
2020-03-22 10:39:47 -05:00
Zuul
7ba932a015 Merge "Cleanup a few docker image related thigns" 2020-03-22 15:00:57 +00:00
Zuul
3af9548401 Merge "Update CLA link" 2020-03-21 18:24:50 +00:00
Zuul
06e0155cb8 Merge "Update infra-manual location" 2020-03-21 18:02:17 +00:00
Zuul
0d44715d50 Merge "Correct vars indentation error in rename playbook" 2020-03-21 17:33:23 +00:00
Zuul
1f38f7e83a Merge "Set ulimits for gerrit" 2020-03-21 17:30:49 +00:00
Andreas Jaeger
4293e228b7 Update CLA link
link to contributor guide, the OpenDev manual does not talk about CLA
anymore.

Change-Id: Ia414513fc1645e0eec462f95af0d9247eb4c0a99
2020-03-21 18:17:57 +01:00
Zuul
c0bbebb3b0 Merge "Don't run gerrit init on restart" 2020-03-21 17:06:32 +00:00
James E. Blair
f60fa8b5d1 Correct vars indentation error in rename playbook
The vars section is too indendented.

The start playbook is not needed.

Change-Id: Idc9b5a0cb203bb67bb3ff524d8da06b4d6ec626f
2020-03-21 11:48:16 -05:00
Monty Taylor
f934851ad8 Set ulimits for gerrit
We set core size to 0 and number of files to twice the setting of
core.packedGitOpenFiles. Make gerrit_packed_git_open_files a role
variable so we can jinja the 2x transformation.

Change-Id: I05dbfe1f091e7014c47b0f1ba79f99b51d1a6c30
2020-03-21 11:41:00 -05:00
Monty Taylor
906e6a72a1 Use dev subdir on review-dev for project-config things
This is in anticipation of running manage-projects, which wants to
use the dev subdir of project-config when run on dev, but we're
currently not doing anything with that. Point at root or dev as
appropriate. Then we can do a similar thing - probably just
bind-mounting the root or the dev when we docker run for
manage-projects.

Change-Id: Ia13bbb0bf8dbe1f7e7c0f378ba9b41bef3ecd5c1
2020-03-21 11:34:28 -05:00
Monty Taylor
86542eb9ba Split gitea and gerrit services from manage-projects
There are two different concerns here. One is configuring the gitea
and gerrit services. This is independent from the management of
projects running inside them.

Make a manage-projects playbook which currently runs gitea-git-repos
but will also get a gerrit-git-repos role in a bit. Make a
service-gitea playbook for deploying gitea itself and update
run_all to take all of that into account. This should make our
future world of turning these into zuul jobs easier.

Add several missing files to the files matchers for run-gitea
and run-review.

Also - nothing about this has anything to do with puppet.

Change-Id: I5eaf75129d76138c61013a3a7ed7c381d567bb8b
2020-03-21 11:34:19 -05:00
Zuul
6ceb12fe99 Merge "Base 2.13 image on gerrit-base" 2020-03-21 16:21:05 +00:00
smarcet
055796bb4e OpenStackID 3.0.6 production deployment
Change-Id: Ib4621b38d78fb61311a65dd3878a0a61e799f367
Signed-off-by: smarcet <smarcet@gmail.com>
2020-03-21 12:47:59 -03:00
Monty Taylor
7e7f1a414a Add opendev-buildset-registry depends where overridden
Job dependencies are overrides, not additions, so in the case of
several jobs that have the opendev-buildset-registry job in their
depends via parent jobs but express a dependency in the pipeline
config, the dependency on opendev-buildset-registry was not there.
Add mention in the pipeline config. Remove it from the
system-config-run-gitea job definition because we're defining it
in the pipeline and it could lead to confusion.

Change-Id: I4a115a3c547b7feb34d1552278ae25337c2ae371
2020-03-21 10:21:25 -05:00
Monty Taylor
8c7b94436b Cleanup a few docker image related thigns
We don't use the bazel image anymore, so it can go away.

Also, the bouncy castle line in the gerrit base dir is bong.

Change-Id: I58842dd9adee108893c0c953c4bb8361b9117775
2020-03-21 10:21:24 -05:00
Zuul
a31bae50a3 Merge "Add a new docs.airshipit.org vhost on static01" 2020-03-20 22:07:40 +00:00
Monty Taylor
63d8f7af48 Base 2.13 image on gerrit-base
We install jeepyb and launchpadlib in gerrit-base. Those are
important. We also need to add cgi for gitweb.

The gerrit init command does two things that we don't actually
want it to do at runtime. It extracts the plugins into the
plugins dir, and it downloads the right database library.

We can extract the plugins for it during image creation, and
then we can also download the plugin it would have downloaded.

We can also download the mysql library for it:

https://gerrit.googlesource.com/gerrit/+/refs/heads/stable-2.13/gerrit-pgm/src/main/resources/com/google/gerrit/pgm/init/libraries.config

Finally, we tell it to not download or expand anything during
init, because we're running in a container and next time we run
the process that dir isn't going to be there.

Our gerrit integration tests don't depend on our gerrit image builds.
Put in image depends between run-review and gerrit builds.

We also need to depend directly on opendev-buildset-registry.

Add java.security.egd setting to java invocation

This tells java to be secure.

https://stackoverflow.com/questions/58991966/what-java-security-egd-option-is-for

Add support for setting heap limit properly

The gerrit init script does this based on the value in
container.javaOptions. We could, but then we'd have to
run an entrypoint script. Instead, set the value via
the JAVA_OPTIONS env var setting based on a value from
ansible.

Finally, make gerrit-master image build non-voting

It looks like there might be a real issue, but debugging that
is not important for us at this moment.

Depends-On: https://review.opendev.org/714216
Change-Id: I01e94c10f470fb3c8ddfce7b0e201357e5050679
2020-03-20 16:37:18 -05:00
Andreas Jaeger
2c0b82e5e8 Update infra-manual location
The infra-manual now lives on docs.opendev.org, update links.

New location is: https://docs.opendev.org/opendev/infra-manual/latest

Change-Id: I7716c68cbff4f3a640d7161f59cfc034a7ccca52
2020-03-20 22:03:09 +01:00
smarcet
d138243bd5 OpenStackId production release 3.0.5
Change-Id: I8d2e2d96ba3543de6b47c5001f9bc2ebab115286
Signed-off-by: smarcet <smarcet@gmail.com>
2020-03-20 17:28:04 -03:00
Jeremy Stanley
abcae98b8e Add a new docs.airshipit.org vhost on static01
The Airship project is continuously publishing documentation to AFS,
so serve that volume with a corresponding vhost on the static01
server. Also add it to the list of volumes for periodic vos release.

Change-Id: I718963533d9e8596d44d451b5e930314d699fa28
Depends-On: https://review.opendev.org/706599
2020-03-20 19:09:13 +00:00
Zuul
f214917274 Merge "Add an use a utility service for gerrit commands" 2020-03-20 16:51:50 +00:00
Zuul
2a79ce4778 Merge "Add #openvswitch to meetbot channels" 2020-03-20 15:11:13 +00:00
Monty Taylor
9b999423b7 Add an use a utility service for gerrit commands
We have a need to run ad-hoc commands with the various things
mounted, such as the gerrit init, as well as our friends like
manage-projects. Make a second "service" that doesn't do anything,
but allows us to run "docker-compose run".

Change-Id: Ic9bafe85b90af413c891b969273437be9df6a79f
2020-03-20 09:51:29 -05:00
Monty Taylor
2b69ad45ba Don't run gerrit init on restart
We don't need to do this when we're restarting, only when we're
installing or starting for the first time.

Change-Id: If80daa5366c56e5f966c499afea4dc7b3421e79f
2020-03-20 08:56:26 -05:00
Monty Taylor
3205133c8a Update gerrit rename playbook for docker-compose
Starting and stopping gerrit is now done by our new docker-compose
overlord. Update the rename playbook to use it for stopping at
the beginning, and then use the start tasks of the gerrit role
to start it at the end.

Change-Id: Ibd07f9269771dfa70fbefbba69b905f165e018af
2020-03-20 07:27:59 -05:00
Zuul
0a98e2cf5f Merge "Add restTokenPrivateKey" 2020-03-20 12:18:53 +00:00
Zuul
f0f022a0c2 Merge "Copy the contents of static and etc" 2020-03-20 10:39:06 +00:00