Commit Graph

1095 Commits

Author SHA1 Message Date
James E. Blair
e79dbbe6bb Add a keycloak server
This adds a keycloak server so we can start experimenting with it.

It's based on the docker-compose file Matthieu made for Zuul
(see https://review.opendev.org/819745 )

We should be able to configure a realm and federate with openstackid
and other providers as described in the opendev auth spec.  However,
I am unable to test federation with openstackid due its inability to
configure an oauth app at "localhost".  Therefore, we will need an
actual deployed system to test it.  This should allow us to do so.

It will also allow use to connect realms to the newly available
Zuul admin api on opendev.

It should be possible to configure the realm the way we want, then
export its configuration into a JSON file and then have our playbooks
or the docker-compose file import it.  That would allow us to drive
change to the configuration of the system through code review.  Because
of the above limitation with openstackid, I think we should regard the
current implementation as experimental.  Once we have a realm
configuration that we like (which we will create using the GUI), we
can chose to either continue to maintain the config with the GUI and
appropriate file backups, or switch to a gitops model based on an
export.

My understanding is that all the data (realms configuration and session)
are kept in an H2 database.  This is probably sufficient for now and even
production use with Zuul, but we should probably switch to mariadb before
any heavy (eg gerrit, etc) production use.

This is a partial implementation of https://docs.opendev.org/opendev/infra-specs/latest/specs/central-auth.html

We can re-deploy with a new domain when it exists.

Change-Id: I2e069b1b220dbd3e0a5754ac094c2b296c141753
Co-Authored-By: Matthieu Huin <mhuin@redhat.com>
2021-12-03 14:17:23 -08:00
Jeremy Stanley
a96bbca946 Add zuul01 to cacti
It would be nice to get some idea of how its resource utilization
compares to 02, especially as it runs on a smaller flavor.

Change-Id: If00a949a575949cb3b1a2d8268ae29e4c4965a0b
2021-11-23 22:43:54 +00:00
Jeremy Stanley
2fbf6d9e7a Stop managing OpenStackID servers
The Open Infrastructure Foundation's developers who maintain the
OpenStackID software are taking over management of the site itself,
and have deployed it on new servers. DNS records have already been
updated to the new IP address, so it's time to clean up our end in
preparation for deleting the old servers we've been running.

OpenStackID is still used by some services we run, like RefStack and
Zanata, and we're still hosting the OpenStackID Git repository and
documentation, so this does not get rid of all references to it.

Change-Id: I1d625d5204f1e9e3a85ba9605465f6ebb9433021
2021-08-31 19:53:13 +00:00
Ian Wienand
b12ff039e4 Point cacti at review02 explicitly
Point this at review02 explicitly to get stats on the new server

Change-Id: I711c613456a2ca4909756d695695472d9b965266
2021-07-20 09:12:36 +10:00
Ian Wienand
868a42a85a Move statusbot channels out of hiera
This makes I246b2723372594e65bcd1ba90215d6831d4c0c72 active

Change-Id: I5a9efa2edc2fe6fb70e21d4b58fd4283d2d5972d
2021-06-11 18:15:48 +10:00
Zuul
fe6581f89f Merge "Cleanup eavesdrop puppet references" 2021-06-11 07:45:46 +00:00
Zuul
f80ab86043 Merge "Move meetbot config to eavesdrop01.opendev.org" 2021-06-11 00:10:56 +00:00
Ian Wienand
8a1f6d9764 Cleanup eavesdrop puppet references
Cleanup documenation, puppet references and the eavesdrop_opendev
group.

Change-Id: I67096d8eced0be54db9b1ee277b24602d8c20f00
2021-06-10 09:02:23 +10:00
Ian Wienand
ccda6d08a1 Move meetbot config to eavesdrop01.opendev.org
This enables the new eavesdrop01.opendev.org server in all current
channels.  Puppet has been disabled on the old server and we will
manually stop supybot/meetbot and mirgrate logs before this applies.

Change-Id: I4a422bb9589c8a8761191313a656f8377e93422f
2021-06-10 09:02:23 +10:00
Ian Wienand
7de885b5ee Cleanup ask.openstack.org
This was retired with I8a31f8fcf9b3064c0ae58e463a6014dc14b518a7

Change-Id: Ieafac856b0feb91f41f05084aa669e2ccb92569d
2021-06-08 14:35:28 +10:00
Ian Wienand
fb94b79e82 Add eavesdrop01.opendev.org server
This adds a new server to take over from eavesdrop01.openstack.org.

We limit the puppet installs, etc. to the openstack.org server.  The
new server is in the group eavesdrop_opendev as we cut over services.
A stub for basic installation is added to the service playbook.

Depends-On: https://review.opendev.org/c/opendev/zone-opendev.org/+/795004
Change-Id: I88c3059532e4d6ab267fdec5b390daefa5b0c4a1
2021-06-07 12:59:02 +10:00
Zuul
481b9cae76 Merge "Drop #edeploy channel from statusbot config" 2021-06-01 20:39:44 +00:00
Zuul
c9f377ebf7 Merge "Update our documentation to reflect the move to OFTC" 2021-05-31 23:26:47 +00:00
Ghanshyam Mann
3bf2c26ff6 Remove placement channel from statusbot
As placement repo is now under Nova governance, placement
channel is agreed to be merged to nova channel
- http://lists.openstack.org/pipermail/openstack-discuss/2020-November/019092.html

After this we should redirect placement channel to nova.

Change-Id: Ibd9fb49ac06ff70358aca62346c47e8a5c398bbe
2021-05-31 12:22:23 -05:00
Jeremy Stanley
1c2679af91 Drop #edeploy channel from statusbot config
I've confirmed with EmilienM in #tripleo that the edeploy project is
defunct and the #edeploy IRC channel is no longer in use. It was
registered on OFTC by a lone project contributor many years ago and
is not under our control, so we should not be running bots in it
anyway.

Change-Id: I47613e4d88f358db5c51f9cb21c1eb1c2ebd32ed
2021-05-31 15:27:10 +00:00
Jens Harbott
5edb7debd6 Update our documentation to reflect the move to OFTC
Change-Id: Ibc90d1b988d65fe370fd46c0e5f7b457cb84152c
2021-05-31 15:26:58 +02:00
Jeremy Stanley
0adf9dee0c Temporarily drop non-admins from statusbot
In order to be able to correctly bootstrap statusbot notification
volunteers on OFTC, temporarily remove everyone whose OFTC nicks we
haven't already confirmed (our active infra-root sysadmins).
Volunteers can re-propose additions to this list via code review as
a means of directly confirming their registered nicks on OFTC.

Change-Id: Id37cdc0940f5139a4eca17c5998fff37ae9d6d0d
2021-05-27 16:51:06 +00:00
Zuul
aa7bf9dff6 Merge "Remove AJaeger from statusbot" 2021-05-26 18:34:34 +00:00
Andreas Jaeger
1c58a68430 Remove AJaeger from statusbot
I'm so seldom now on IRC that I don't use statusbot anymore, remove
myself.

Change-Id: I2a1f2e3e52549c5e152bd14d4bd4c5c5a36a1db7
2021-05-26 19:42:25 +02:00
Jeremy Stanley
5bb5d1b44f Drop meetbot/statusbot from inactive IRC channels
Stop reporting service info and logging in channels which have had
no human comments (only bots) in all of 2021.

Change-Id: Iaa062c48c70c546bfc8489154534b28637c5d003
Depends-On: https://review.opendev.org/792301
2021-05-19 23:07:28 +00:00
Zuul
6aab5d7013 Merge "Clean up zuul01 from inventory" 2021-05-13 23:09:53 +00:00
Zuul
f75cf08a5a Merge "Add zuul02 to inventory" 2021-05-13 15:52:01 +00:00
Clark Boylan
c743b7e484 Clean up zuul01 from inventory
This cleans up zuul01 as it should no longer be used at this point. We
also make the inventory groups a bit more clear that all zuul servers
are under the opendev.org domain now.

Depends-On: https://review.opendev.org/c/opendev/zone-opendev.org/+/790483
Change-Id: I7885fe60028fbd87688f3ae920a24bce4d1a3acd
2021-05-13 06:58:36 -07:00
Clark Boylan
533594d959 Add zuul02 to inventory
This zuul02 instance will replace zuul01. There are a few items to
coordinate when doing an actual switch so we haven't removed zuul01 from
inventory here. In particular we need to update gearman server config
values in the zuul cluster and we need to save queues, shutdown zuul01,
then start zuul02's scheduler and restore queues there.

I believe landing this change is safe as we don't appear to start zuul
on new instances by default. Reviewers should double check this.

Depends-On: https://review.opendev.org/c/opendev/zone-opendev.org/+/791039
Change-Id: I524b456e494124d8293fbe8e1468de40f3800772
2021-05-13 06:58:30 -07:00
Ian Wienand
e0acf4a68d Retire Asterisk service
As announced in [1], retire the Asterisk PBX service

[1] http://lists.opendev.org/pipermail/service-discuss/2021-March/000198.html

Change-Id: I527eb3423831c6a155228b6d79428681f60a3273
2021-05-07 09:53:17 +10:00
Clark Boylan
8346b9ac6f Add zk06.opendev.org to the zk cluster
This new zk06 instance will replace zk01 in the cluster.

Change-Id: Idb5ef47c80d6639744be361f0763b78f83327caf
2021-04-27 12:49:08 -07:00
Clark Boylan
30c1523f4c Add zk05.opendev.org to the zk cluster
This new zk05 instance will replace zk02 in the cluster.

Change-Id: I425708d6a241ad7a90266e5ba5b6ed544bfd5ff0
2021-04-27 10:38:08 -07:00
Zuul
82435b279a Merge "Add zk04.opendev.org" 2021-04-27 16:33:02 +00:00
Jeremy Stanley
e2bdcc867a Remove IRC bots from #ara
The #ara channel no longer grants founder access to the
openstackinfra bot account, so we should not continue to operate our
bots in it.

Change-Id: I09e5e7001b5eb1bdd08a73cd05ee7c1bbc7fe355
2021-04-25 15:39:02 +00:00
Clark Boylan
82a5445ae0 Cleanup mirror01.iad3.inmotion
This server has been replaced with a mirror02 host with a slightly
different network config. Clean this server up.

Depends-On: https://review.opendev.org/c/opendev/zone-opendev.org/+/787630
Change-Id: I6eaa51db47d8b4d4596928f6a7ef105bebe0e8f1
2021-04-22 12:20:33 -07:00
Clark Boylan
ac2b661cf2 Add mirror02 to inmotion
We are doing this so that we can cleanup the private network + floating
IP setup that the existing mirror does. Once this new mirror is up and
happy we can cname to it and then clean up the old mirror and its
networking config. We do this in order to save an IP that the current
private network router is consuming.

Depends-On: https://review.opendev.org/c/opendev/zone-opendev.org/+/787628
Change-Id: I50c311087c6c28726e36913c7e081f3b3d0ee049
2021-04-22 12:15:28 -07:00
Clark Boylan
dbc316ba49 Add iad3.inmotion mirror node
This updates out inventory to add the new inmotion mirror. This is a
necessary step in bootstrapping this cloud for nodepool usage.

Change-Id: Ie66cdb010c0772310f1cfa8187ca0a2d7f1de1b8
2021-04-21 16:37:19 -07:00
Clark Boylan
7502b87837 Add zk04.opendev.org
We will be rotating zk01-03.openstack.org out and replacing them with
zk04-06.opendev.org. This is the first change in that process which puts
zk04 into the rotation. This should only be landed when operators are
ready to manually stop zookeeper on zk03 (which is being replaced by
zk04 in this change).

Change-Id: Iea69130f6b3b2c8e54e3938c60e4a3295601c46f
2021-04-15 13:20:29 -07:00
Zuul
cb5898ae0a Merge "Remove firehose.openstack.org" 2021-04-14 18:50:16 +00:00
Zuul
410ee03d82 Merge "Stop managing planet01.openstack.org" 2021-04-14 04:13:46 +00:00
Clark Boylan
2eebb858af Remove firehose.openstack.org
Once we are satisfied that we have disabled the inputs to firehose we
can land this change to stop managing it in config management. Once that
is complete the server can be removed.

Change-Id: I7ebd54f566f8d6f940a921b38139b54a9c4569d8
2021-04-13 13:51:48 -07:00
Ian Wienand
db76061c71 Stop managing planet01.openstack.org
This server has been retired.
If141aca5efbdbe60c91ceefaa4e05c98cd0ba5bb has redirected this.

Change-Id: I8d3c089e6e845d98a46ae39c0b32b1c845436add
2021-04-13 16:17:14 +10:00
Ian Wienand
8e9d250293 Add OSUOSL mirror
Change-Id: Ia065fb30cfd69c5ab3fe96541d168b5722ff59ce
Depends-On: https://review.opendev.org/c/opendev/zone-opendev.org/+/786003
2021-04-13 14:19:10 +10:00
Jeremy Stanley
fd98a1750d Clean up OpenEdge configuration
The OpenEdge cloud has been offline for five months, initially
disabled in I4e46c782a63279d9c18ff4ba2944c15b3027114b, so go ahead
and clean up lingering references. If it is restored later, this can
be reverted fairly easily.

Depends-On: https://review.opendev.org/783989
Depends-On: https://review.opendev.org/783990
Change-Id: I544895003344bc8202363993b52f978e1c07d061
2021-03-31 01:42:36 +00:00
Ian Wienand
9f11fc5c75 Remove references to review-dev
With our increased ability to test in the gate, there's not much use
for review-dev any more.  Remove references.

Change-Id: I97e9865e0b655cd157acf9ffa7d067b150e6fc72
2021-03-24 11:40:31 +11:00
Clark Boylan
be1325fe2c Clean up the old openstack.org nodepool launchers.
These have been replaced with new focal .opendev.org hosts. Note we
don't want to land this until we successfully transitioned from one set
of hosts to another.

Change-Id: I385a74c8a093f5baebb0d4858127c7595be191c0
2021-03-17 15:53:42 -07:00
Zuul
b2b1a9062d Merge "Add new opendev.org nodepool launchers" 2021-03-17 18:13:07 +00:00
Zuul
941d7e7eab Merge "Cleanup nl01.openstack.org" 2021-03-17 15:28:47 +00:00
Clark Boylan
680ed17ecd Add new opendev.org nodepool launchers
This adds the new focal nodepool launchers replacements for nl02-04 to
our inventory. This will configure them with an idle configuration. We
then confirm they are happy running in an idle state then switch over
the config from the old to new servers.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/780982
Change-Id: Iea645925caaeee6f498aa690c4f2c848f6899317
2021-03-16 15:21:58 -07:00
Zuul
b133afedfd Merge "refstack: cleanup old puppet" 2021-03-16 22:21:03 +00:00
Clark Boylan
893ec329b4 Cleanup nl01.openstack.org
This server is no longer running a nodepool launcher and can be removed
from the inventory so that we can delete it. Next up we'll replace
02-04.

Change-Id: Ia71b9b616bde1018cd4ce3b8c882fba02677165d
2021-03-16 14:36:12 -07:00
Ian Wienand
018a14e34f refstack: cleanup old puppet
Remove old puppet configuration for the restack service, which is now
managed by Ansible.

Change-Id: I6b6dfd0f8ef89a5362f64cfbc8016ba5b1a346b3
2021-03-17 07:06:53 +11:00
Clark Boylan
ed61423b6b Add nl01.opendev.org to our inventory
This is a new focal replacement for nl01.openstack.org. We keep
nl01.openstack.org in our inventory for now because we want ansible to
update the nodepool.yaml configs for these two hosts to coordinate a
hand off of responsibilities once we are happy with the new deployment.

We also switch the testing hostname to nl04.openstack.org as this will
be the last nodepool launcher to be removed. When we swap it out the
testing will be updated to use focal hosts.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/779863
Change-Id: Ib3ea6586fe0567c1edf6255ee9be50164d35db62
2021-03-15 09:48:22 -07:00
Clark Boylan
a2fd912511 Replace ze09-12.openstack.org with ze09-12.opendev.org
These are new focal replacement servers. Because this is the last set of
replacements for the executors we also cleanup the testing of the old
servers in the system-config-run-zuul job and the inventory group
checker job.

Change-Id: I111d42c9dfd6488ef69ff1a7f76062a73d1f37bf
2021-03-08 10:13:29 -08:00
Clark Boylan
382e525fcd Replace ze05-08.openstack.org with ze05-08.opendev.org
These are new replacement servers. Once the new servers have been
ansibled and zuul-executor is started on them the old servers will be
asked to gracefully stop. Once gracefully stopped the old servers will
be removed.

Change-Id: Iedba31b213cf341a83560e0b928082e1604533e3
2021-03-05 12:07:59 -08:00