80 Commits

Author SHA1 Message Date
Clark Boylan
de4c369c27 Replace all the zuul mergers with new focal nodes
These servers are all up and running and should be ready to go after the
zm01 canary. Note there will be a followup change to remove
zm02-zm08.openstack.org from the inventory. We split this up so that we
can keep those servers around until we're happy with the replacements.

Change-Id: Ic2671da104df2b01986d1b65c8d13507d6792c40
2021-02-23 11:09:16 -08:00
Clark Boylan
1e18cd0163 Add new zm01.opendev.org server
This is a Focal server that will replace zm01.openstack.org. Once this
is deployed and happy we can also move forward and do the remainder of
the mergers.

Change-Id: I139c52e26d17ac8d9b604366a3333556d23c5536
2021-02-22 10:58:56 -08:00
Ian Wienand
39ffc685d6 backups: remove all bup
All hosts are now running thier backups via borg to servers in
vexxhost and rax.ord.

For reference, the servers being backed up at this time are:

 borg-ask01
 borg-ethercalc02
 borg-etherpad01
 borg-gitea01
 borg-lists
 borg-review-dev01
 borg-review01
 borg-storyboard01
 borg-translate01
 borg-wiki-update-test
 borg-zuul01

This removes the old bup backup hosts, the no-longer used ansible
roles for the bup backup server and client roles, and any remaining
bup related configuration.

For simplicity, we will remove any remaining bup cron jobs on the
above servers manually after this merges.

Change-Id: I32554ca857a81ae8a250ce082421a7ede460ea3c
2021-02-16 16:00:28 +11:00
Ian Wienand
cf36af34c1 Add refstack01.openstack.org
See Icade6c713fa9bf6ab508fd4d8d65debada2ddb30

Change-Id: I96ba37a1c872d9f5c20224bbad48bc1d17bdc438
2021-02-09 14:39:12 +11:00
Ian Wienand
16d26586cf Update airship mirror address
The floating IP of this host was changed during a network issue;
matches I898dbf7417fb01f608eded85faaae5a417ad2e98

Change-Id: Icf1daa4a761403a3927bcadab08656cd1f42f1aa
2021-02-04 11:11:37 +11:00
Clark Boylan
44a076998b Cleanup openstackid02 and openstackid03
This servers were spun up to handle extra load to the openstackid
service during the virtual summit. The load is no longer present and we
have been asked to dial back to the normal setup for this service.

Clean these servers up to stop using unneeded resources. We will start
by removing them from inventory, then dns, and then shut them down. If
everything continues to look happy after that we will delete them.

Change-Id: I469d16f80dcc6c20891556272a94b1f7404b3620
2021-01-11 10:20:20 -08:00
Ian Wienand
4ce223d83a Add codesearch.opendev.org server
Change-Id: I1e75ca551871999a654000f103aaf833679e804e
Depends-On: https://review.opendev.org/763297
2020-11-20 07:41:43 +11:00
Ian Wienand
368466730c Migrate codesearch site to container
The hound project has undergone a small re-birth and moved to

 https://github.com/hound-search/hound

which has broken our deployment.  We've talked about leaving
codesearch up to gitea, but it's not quite there yet.  There seems to
be no point working on the puppet now.

This builds a container than runs houndd.  It's an opendev specific
container; the config is pulled from project-config directly.

There's some custom scripts that drive things.  Some points for
reviewers:

 - update-hound-config.sh uses "create-hound-config" (which is in
   jeepyb for historical reasons) to generate the config file.  It
   grabs the latest projects.yaml from project-config and exits with a
   return code to indicate if things changed.

 - when the container starts, it runs update-hound-config.sh to
   populate the initial config.  There is a testing environment flag
   and small config so it doesn't have to clone the entire opendev for
   functional testing.

 - it runs under supervisord so we can restart the daemon when
   projects are updated.  Unlike earlier versions that didn't start
   listening till indexing was done, this version now puts up a "Hound
   is not ready yet" message when while it is working; so we can drop
   all the magic we were doing to probe if hound is listening via
   netstat and making Apache redirect to a status page.

 - resync-hound.sh is run from an external cron job daily, and does
   this update and restart check.  Since it only reloads if changes
   are made, this should be relatively rare anyway.

 - There is a PR to monitor the config file
   (https://github.com/hound-search/hound/pull/357) which would mean
   the restart is unnecessary.  This would be good in the near and we
   could remove the cron job.

 - playbooks/roles/codesearch is unexciting and deploys the container,
   certificates and an apache proxy back to localhost:6080 where hound
   is listening.

I've combined removal of the old puppet bits here as the "-codesearch"
namespace was already being used.

Change-Id: I8c773b5ea6b87e8f7dfd8db2556626f7b2500473
2020-11-20 07:41:12 +11:00
Zuul
d3a53e8ec0 Merge "Remove mirror-update server and related puppet" 2020-11-09 21:07:11 +00:00
Ian Wienand
676c5dad44 Add borg backup server in RAX ORD
This is our second backup server for borg, hosted in RAX/ORD.

Change-Id: I2c896345e497067ce12863bdb1dda8ce467e2243
2020-10-30 16:39:25 +11:00
Ian Wienand
c49ece9204 Cleanup grafana.openstack.org
The opendev.org server is in production, cleanup the old puppet-based
host.

Change-Id: I6db3ce929226a23b96234b52ece8b17f4c6a326a
2020-10-29 07:59:42 +11:00
Ian Wienand
f8852b76fb Remove mirror-update server and related puppet
This has all transitioned to Ansible and the mirror-update.opendev.org
server now.

Change-Id: I5f82139c981c2716f568b15b118690e943b02d52
2020-10-28 11:39:54 +11:00
Clark Boylan
bec0127970 Add jvb02 prior to the PTG
This will scale up our meetpad install by 50% giving us more capacity
for PTG sessions.

We also increase the tox linters job timeout as it is slow pip
installing then slow running ansible-lint. Do this until we can sort out
why it is slow.

Change-Id: Ieceafefa27266f0bc0f427af790f920a8c44326c
2020-10-23 15:28:03 -07:00
Clark Boylan
fa0753668d Add two more openstackid servers so that we can load balnace them
Virtual summit fun! We need more capacity for openstackid. smarcet says
there isn't really any shared state so this hsould be safe then we can
sort out a load balancer.

Change-Id: I2a7d62bc980a797f7c45d119a5398925f5607df0
2020-10-19 09:56:34 -07:00
Ian Wienand
0d0f8ffe14 Add initial borg backup server
To catch up -- because this work is moving slowly ... the two backup
servers are currently the vexxhost and RAX ORD hosts.  The vexxhost
node is deployed with Ansible on Bionic, but the old ORD host still
needs to be upgraded and moved out of puppet.  Instead of dealing with
the unmaintained bup and getting it to work on the current LTS Focal,
we are doing an initial borg deployment with plans to switch to it
globally.

This adds the backup02.ca-ymq-1.vexxhost.opendev.org to the inventory
and borg-backup-server group, so it will be deployed as a borg backup
server (note, no hosts are backing up to it, yet).

To avoid the original bup roles matching, we restrict the
backup-server group to backup01.ca-ymq-1.vexxhost.opendev.org
explicitly.

Change-Id: Id30a2ffad75236fc23ed51b2c67d0028da988de5
2020-10-08 11:54:27 +11:00
Ian Wienand
1b4006757a Cleanup graphite01
Server is replaced with graphite02.opendev.org

Change-Id: Ie6099e935a6a7e10c818d1d3003e44bca11dd13a
2020-09-30 11:55:24 +10:00
Clark Boylan
9fdbd56d16 Remove nb04
This was a host used to transition to docker run nodepool builders. That
transition has been completed for nb01.opendev.org and nb02.opendev.org
and we don't need the third x86 builder.

Change-Id: I93c7fc9b24476527b451415e7c138cd17f3fdf9f
2020-09-18 11:12:04 -07:00
Zuul
98370830a3 Merge "Remove mirror01.regionone.linaro-us.opendev.org" 2020-09-18 04:46:09 +00:00
Clark Boylan
1ea83138ef Remove nodepool builder puppetry and nb03.openstack.org
This should only land after we've launched a new nb03.opendev.org
running with the new nodepool arm64 docker image. Once that happens and
we are happy with how it is running we  can safely stop managing the
existing nb03.openstack.org server with puppet.

Change-Id: I8d224f9775bd461b43a2631897babd9e351ab6ae
2020-09-09 15:09:43 -07:00
Clark Boylan
ebd9c4c59e Add nb03.opendev.org
This server is going to be our new arm64 nodepool-builder running on the
new arm64 docker images for nodepool.

Depends-On: https://review.opendev.org/750037
Change-Id: I3b46ff901eb92c7f09b79c22441c3f80bc6f9d15
2020-09-04 13:22:32 -07:00
Ian Wienand
600c9e78d4 Remove mirror01.regionone.linaro-us.opendev.org
Replaced with 02 mirror

Change-Id: I63114be35836f5ddb204e8c0ca5a1e10b056a4b0
2020-08-25 14:43:07 +10:00
Ian Wienand
60522f90a2 Add linaro Focal mirror
This is an updated mirror we wish to switch to.

Change-Id: Id9eb82abf720e7c4ffa32337690d0d06a25750a6
2020-08-24 14:59:54 +10:00
Ian Wienand
6494ed0275 Add OE mirror to inventory
This has been restarted.  While we're here, fix the path to the
inventory in the launch output.

Change-Id: I4d78d9eb2ee365e47850c68c36d475a468dc6064
2020-08-06 09:42:39 +10:00
Ian Wienand
4092ef34e5 openedge mirror: remove for replacement
We are rebuilding this mirror.  Remove the old host from the
inventory.

Change-Id: Ibbc59a7ec4eae79fe4f7ae5e1b795d952d0611ea
2020-08-05 06:36:29 +10:00
Ian Wienand
7ddbc3b54f Add new graphite and grafana servers
These are to be deployed with containers

Depends-On: https://review.opendev.org/739162
Change-Id: I595f203db86d74bdc31e09a04dbcac0eb906b080
2020-07-03 15:37:45 +10:00
Zuul
e5b5a800ba Merge "Make a review-test that we run ansible on" 2020-06-19 00:19:33 +00:00
Ian Wienand
ceb711e6d9 Swap mirror-update01 for mirror-update02
This is a new Focal based host, which we want for it's more recent
rsync which hopefully causes less issues resyncing things to AFS
volumes.

See 4918594aa472010a8a112f5f4ed0a471a3351a91 for discussion of the
original issues; we have found that without "-t" all new data seems to
be copied continuously.  Empirical testing shows later rsync doesn't
have this issue.

Depends-On: https://review.opendev.org/736859
Change-Id: Iebfffdf8aea6f123e36f264c87d6775771ce2dd8
2020-06-19 08:41:44 +10:00
Monty Taylor
2574113870 Make a review-test that we run ansible on
Private host_vars exist on bridge separate from review01.openstack.org
with their own mysql database, rest key and email key. Add in a
conditional on accepting our own hostkey since we're not actually
going to run manage-projects on this host so we don't need to do that.

Change-Id: If7f45250e7ead62f2117f3e6c0fcfc0b4e7f71aa
2020-06-15 13:32:05 -05:00
Jeremy Stanley
7dabbf8809 Revert "Add three more JVB servers"
The Virtual Project Teams Gathering has concluded, so scale back the
JVB pool for now to free up quota.

This reverts commit 3bfaf0212aa30d0ccb28f909f8f2ae0640449a33.

Change-Id: I72bb58e6719520cd355f7c4e30c01e81210efb2d
2020-06-05 20:47:17 +00:00
Monty Taylor
83ced7f6e6 Split inventory into multiple dirs and move hostvars
Make inventory/service for service-specific things, including the
groups.yaml group definitions, and inventory/base for hostvars
related to the base system, including the list of hosts.

Move the exisitng host_vars into inventory/service, since most of
them are likely service-specific. Move group_vars/all.yaml into
base/group_vars as almost all of it is related to base things,
with the execption of the gerrit public key.

A followup patch will move host-specific values into equivilent
files in inventory/base.

This should let us override hostvars in gate jobs. It should also
allow us to do better file matchers - and to be able to organize
our playbooks move if we want to.

Depends-On: https://review.opendev.org/731583
Change-Id: Iddf57b5be47c2e9de16b83a1bc83bee25db995cf
2020-06-04 07:44:36 -05:00