850 Commits

Author SHA1 Message Date
Monty Taylor
96364a11d9 Stop cloning a bunch of puppet modules we don't use
We've stopped using many of these, but we never got around to
removing them from lists.

Also, we should probably retire the repos.

Depends-On: https://review.opendev.org/717620
Depends-On: https://review.opendev.org/720527
Change-Id: I8e012c5bfa48d274dbd7f5484a9e75fee080cb5e
2020-06-05 08:42:47 -05:00
Monty Taylor
83ced7f6e6 Split inventory into multiple dirs and move hostvars
Make inventory/service for service-specific things, including the
groups.yaml group definitions, and inventory/base for hostvars
related to the base system, including the list of hosts.

Move the exisitng host_vars into inventory/service, since most of
them are likely service-specific. Move group_vars/all.yaml into
base/group_vars as almost all of it is related to base things,
with the execption of the gerrit public key.

A followup patch will move host-specific values into equivilent
files in inventory/base.

This should let us override hostvars in gate jobs. It should also
allow us to do better file matchers - and to be able to organize
our playbooks move if we want to.

Depends-On: https://review.opendev.org/731583
Change-Id: Iddf57b5be47c2e9de16b83a1bc83bee25db995cf
2020-06-04 07:44:36 -05:00
Monty Taylor
f27c170d01 Rename service-letsencrypt to just letsencrypt
This isn't a service, it's a meta thing that we run for different
hosts at different times.

Change-Id: Ib65665c98afb3ddb94b15346931be88a4b1757d8
2020-06-04 07:44:36 -05:00
Dr. Jens Harbott
46b4053a0a Document the need to use sudo in order to access OSC
Change-Id: I9e80f0b57bc9758e6b0458428315b1087856ddec
2020-05-19 10:09:23 +00:00
Ian Wienand
f204337268 Add nb01/nb02 opendev servers
These are replacements for the nb01/02.openstack.org puppet servers

Change-Id: I376d70ee375289b004fb859751743c6fafa21411
2020-05-07 09:10:26 +10:00
Clark Boylan
6b1feb8ae6 Add logo file to docs
We are trying to use this file in our docs config but the file was
mistakently not added in that change. Add it now.

Change-Id: I8f5f9d62f96d8532477c42a7076c57aa6548c9cf
2020-04-30 13:37:55 -07:00
Clark Boylan
2e2ee170f8 Fix rooted path to docker-compose
In places like crontab entries we use full paths to executables because
PATH is different under cron. Unfortunately, this meant we broke
docker-compose commands using /usr/bin/docker-compose when we installed
it under /usr/local/bin/docker-compose. In particular this impacted
database backups on gitea nodes and etherpad.

Update these paths so that everything is happy again.

Change-Id: Ib001baab419325ef1a43ac8e3364e755a6655617
2020-04-22 14:09:46 -07:00
Monty Taylor
5468f49254 Remove unused gerrit puppet things
We ain't using em.

Change-Id: I4ce9188a6b6a7e6a670e61bb17ab07e890faebcf
2020-04-19 10:59:25 -05:00
Monty Taylor
711295e918 Remove old etherpad.openstack.org
Once the DNS is swapped over to point at etherpad.opendev.org
we can delete the old stuff.

Change-Id: I626dd22b22a23619fcf460533336f1ddfec615d9
2020-04-19 10:58:46 -05:00
Zuul
4a9e839dd0 Merge "Remove puppet and cron mentions from docs" 2020-04-16 21:18:08 +00:00
Zuul
e3ad9e79eb Merge "Get rid of all-clouds.yaml" 2020-04-16 15:41:55 +00:00
Monty Taylor
cba5129465 Remove puppet and cron mentions from docs
We've got some old out of date docs in some places. This isn't even
a full reworking, but at least tries to remove some of the more
egregiously wrong things.

Change-Id: I9033acb9572e1ce1b3e4426564b92706a4385dcb
2020-04-16 07:04:14 -07:00
Monty Taylor
ebae022d07 Use project-config from zuul instead of direct clones
We use project-config for gerrit, gitea and nodepool config. That's
cool, because can clone that from zuul too and make sure that each
prod run we're doing runs with the contents of the patch in question.

Introduce a flag file that can be touched in /home/zuulcd that will
block zuul from running prod playbooks. By default, if the file is
there, zuul will wait for an hour before giving up.

Rename zuulcd to zuul

To better align prod and test, name the zuul user zuul.

Change-Id: I83c38c9c430218059579f3763e02d6b9f40c7b89
2020-04-15 12:29:33 -05:00
Monty Taylor
8af7b47812 Get rid of all-clouds.yaml
We had the clouds split from back when we used the openstack
dynamic inventory plugin. We don't use that anymore, so we don't
need these to be split. Any other usage we have directly references
a cloud.

Change-Id: I5d95bf910fb8e2cbca64f92c6ad4acd3aaeed1a3
2020-04-09 16:44:20 -05:00
Clark Boylan
d07025f43f Switch documentation to alabaster theme
These are OpenDev docs now so the OpenStack theming doesn't quite fit.
Switch to Alabaster + OpenDev logo which is what we did with
infra-manual.

Change-Id: Id211e8e0b4dab7282fb5ca5fce494a028a826fba
2020-04-09 13:22:43 -07:00
Zuul
e71221ea33 Merge "Add a note about rename files to project renames doc" 2020-04-09 14:30:24 +00:00
Jeremy Stanley
8641302459 Mention new mailing lists
The OpenDev community is moving its discussions off the old
openstack-infra mailing list, so make sure to refer to the correct
new address(es).

Change-Id: I558b60ea0aa3421285d46be449f04198441cf285
2020-04-06 18:19:28 +00:00
Zuul
b474879c03 Merge "Correct launch readme link" 2020-04-04 19:46:53 +00:00
James E. Blair
06d5ce1423 Correct launch readme link
This has a .rst extension now.

Change-Id: Icafdb12f91315f5c37f95755034d216bc4a5c837
2020-03-27 09:45:42 -07:00
Jeremy Stanley
8da233817b Re-add secret decrypting docs
These are useful for the times when a secret needs to be decrypted
for debugging but seem to have been deleted when we did the zuulv3
migration removal.

Change-Id: Ib1544d9032df9bd25c50eeca032f643e40f035b0
2020-03-23 13:16:05 -05:00
Zuul
2c89ce1807 Merge "Split gitea and gerrit services from manage-projects" 2020-03-23 14:28:40 +00:00
Andreas Jaeger
62e76b5177 Docs: Update main page for OpenDev
Update conf.py and index.rst for OpenDev.

Use newer openstackdocstheme and update conf.py for this.

Change-Id: I62312ca1d3fda9221660b7bb664c8ea55dac68a4
2020-03-22 19:14:51 +01:00
Monty Taylor
86542eb9ba Split gitea and gerrit services from manage-projects
There are two different concerns here. One is configuring the gitea
and gerrit services. This is independent from the management of
projects running inside them.

Make a manage-projects playbook which currently runs gitea-git-repos
but will also get a gerrit-git-repos role in a bit. Make a
service-gitea playbook for deploying gitea itself and update
run_all to take all of that into account. This should make our
future world of turning these into zuul jobs easier.

Add several missing files to the files matchers for run-gitea
and run-review.

Also - nothing about this has anything to do with puppet.

Change-Id: I5eaf75129d76138c61013a3a7ed7c381d567bb8b
2020-03-21 11:34:19 -05:00
Andreas Jaeger
2c0b82e5e8 Update infra-manual location
The infra-manual now lives on docs.opendev.org, update links.

New location is: https://docs.opendev.org/opendev/infra-manual/latest

Change-Id: I7716c68cbff4f3a640d7161f59cfc034a7ccca52
2020-03-20 22:03:09 +01:00
James E. Blair
fc2a742b24 Add a note about rename files to project renames doc
We keep track of these files now in the opendev/project-config repo,
so make sure that they are committed there.

Change-Id: Icf4b4e32ac4f209811ba8361bbb9d8458c79251a
2020-03-20 07:09:56 -07:00
Zuul
a54baada30 Merge "Make Advisory Board a proper noun" 2020-03-19 01:02:19 +00:00
Zuul
e3f7c8cee8 Merge "Update references to IRC channels" 2020-03-18 18:55:57 +00:00
Dr. Jens Harbott
c86525ccd3 Update references to IRC channels
With the move from OpenStack governance to our own OpenDev team, we
should also move to use the #opendev IRC channel in preference to
the #openstack-infra channel which will remain in use for OpenStack
specific discussions.

Update the references in our docs accordingly.

Change-Id: I448704f5d2664fd233a69a2ad12578ca24d9878a
2020-03-18 17:33:08 +01:00
Zuul
8e45f95748 Merge "Update project doc to reflect OpenDev changes" 2020-03-17 20:22:45 +00:00
Clark Boylan
08e2418e58 Make Advisory Board a proper noun
This fixes a small nit on the prior docs change.

Change-Id: Id408cf410e7fc50d418cc701d3b195ebcffd1b85
2020-03-17 13:03:37 -07:00
Ian Wienand
288e516ace letsencrypt: add note on manual refresh of certificates
Add a note on how to manually refresh the certificates if required.

Change-Id: Ie5f494e3769b7b878c2d1b03836d436dd845e5d9
2020-03-05 21:50:29 +00:00
Sorin Sbarnea
f861cda57c Improve 3rd-party logging guidelines
Based on #openstack-infra talks from Feb 17th, I am proposing some clarifications regarding how logging should
be done by 3rd party CI.

These should help 3rd party integrators create a better
experience for developers, making logs more accessible.

Change-Id: I2ebc788505ba1319afc038d0aa1406da3823a911
2020-02-18 09:29:24 +00:00
Zuul
1f67b8ed37 Merge "Add docs for deleting an AFS volume" 2020-02-10 17:09:04 +00:00
Clark Boylan
95e8c8edde Update project doc to reflect OpenDev changes
This change effectively converts the OpenStack Infra project description
into an OpenDev project description in our documentation. Since OpenDev
is largely an evolution of the preexisting infra team much of the
content remains the same. I have added a section on governance as we'll
not be able to run off of the OpenStack governance any longer.

Note this leaves what becomes the OpenStack Infra project without a
project document. However, the remaining scope of that OpenStack project
will be small and I don't think it will need to same level of team
organization. I think we can get by with OpenStack's default governance
for its teams there. Then should we need something more explicit or
different we can write that up within openstack itself.

Depends-On: https://review.opendev.org/#/c/703134/
Change-Id: I56aab771510768211386325e6466d2f94fe298fb
2020-02-05 14:59:39 +00:00
James E. Blair
cfc1841c06 Add warning about kerberos key rotation
Change-Id: I9e4caf8feeb775c02208a5e5f1627f03a90e4211
2020-01-31 16:22:52 -08:00
James E. Blair
255f996916 Add docs for deleting an AFS volume
Change-Id: I1763eb2bf580591b68bf4e2853378331b8261293
2020-01-20 09:43:34 -08:00
Zuul
44935bca39 Merge "Add notes on manual host configuration runs" 2020-01-16 22:53:05 +00:00
Ian Wienand
4bb7746347 Update gitea docs
Give the location of the database backups, and update the replication
section.

Change-Id: Ic687ab3bab1a1534cdd26d357f729db054e8b60e
2019-11-15 10:21:51 +11:00
James E. Blair
87fccc8e9b Add docs for recovering an OpenAFS fileserver
This should be a smooth recovery process.

Change-Id: I3c68b077e38a88160286d94e71676c0c4dbb6a51
2019-09-13 10:42:17 -07:00
Zuul
1b14855a45 Merge "AFS server restart and audit logging : helper script" 2019-08-29 21:03:09 +00:00
Andreas Jaeger
13ce6ffd69 Zuul docs: Remove obsolete note
This note is not needed anymore, remove it.

Change-Id: I708fc3653833f794a448d40e3df72626f282b747
2019-08-28 06:51:58 +02:00
Andreas Jaeger
a6aaaed6a3 Docs: Zuul v2 is dead
Update the Zuul v3 page with correct links and description of promote
pipeline and remove the now obsolete note - and follow it with renaming
the document to zuul.

Change-Id: I9c89cb56d4a318f3a234e7f2f08dabb46d0dfab6
2019-08-27 08:39:57 +02:00
Ian Wienand
814e4be128 Ansible roles for backup
This introduces two new roles for managing the backup-server and hosts
that we wish to back up.

Firstly the "backup" role runs on hosts we wish to backup.  This
generates and configures a separate ssh key for running bup and
installs the appropriate cron job to run the backup daily.

The "backup-server" job runs on the backup server (or, indeed
servers).  It creates users for each backup host, accepts the remote
keys mentioned above and initalises bup.  It is then ready to receive
backups from the remote hosts.

This eliminates a fairly long-standing requirement for manual setup of
the backup server users and keys; this section is removed from the
documentation.

testinfra coverage is added.

Change-Id: I9bf74df351e056791ed817180436617048224d2c
2019-08-05 16:59:57 +10:00
Ian Wienand
35f1321e14 AFS server restart and audit logging : helper script
This script helps restart the AFS servers, which is useful when
updating parameters.  It can also enable audit logging.

It can also stop and start the servers, although it's unlikely we'd
want all the servers offline at the same time so stopping has a
warning included.

Documentation is updated to refer to the helper script

Change-Id: Idcb3e43a3f6e614cdb787d4334e692a98bffdd15
2019-08-02 16:37:00 +10:00
Zuul
b0ea150b89 Merge "Correct emergency file reference in launch script" 2019-07-31 23:22:38 +00:00
James E. Blair
48cafd19f8 Add LE cert for logs.opendev.org to static
This can be used in an apache vhost later, but should be fine to
merge now.

Depends-On: https://review.opendev.org/673902
Change-Id: Ic2cb7585433351ec1bdabd88915fa1ca07da44e7
2019-07-31 13:00:50 -07:00
Jeremy Stanley
4c04ad5436 Correct emergency file reference in launch script
The launch script is referring to the wrong path for the emergency
inventory. Also correct the references in the sysadmin guide and
update the example for using it.

Change-Id: I80bdbd440ec451bcd6fb1a3eb552ffda32407c44
2019-07-26 14:55:32 +00:00
Ian Wienand
667e0dffa0 Add some pointers on the OpenDev PPA
The OpenStack/OpenDev PPA repositories are currently undocumented.
Add some information on where to find things.

Change-Id: Iea03c5d558b3dd6af9f7c860dfcc75a71dc59d9f
2019-07-22 10:58:54 +10:00
Zuul
40c53a796a Merge "mirror-update: update docs for mirror-update.opendev.org" 2019-07-18 20:54:03 +00:00
Zuul
876e7b0dbd Merge "Streamline documented bup setup process" 2019-07-18 13:33:08 +00:00