14133 Commits

Author SHA1 Message Date
Xing Zhang
2d049f4524 Fix enumerated list in gerrit.rst
Remove incorrect whitespace

Change-Id: I45203210da5288c14f1f273513b20160add73227
Ref: docs.o.o/infra/system-config/gerrit.html#troubleshooting
2018-12-10 11:23:27 +11:00
François Magimel
46260a79ee Fix spelling mistakes and reST typos in the doc
Change-Id: I61d9780f3f1937c6e8d326a670c40fb6a931dbce
2018-12-08 19:13:53 +01:00
Jeremy Stanley
a547a75dd9 Run a local MySQL service on StoryBoard servers
In preparation to move the SB data out of Trove instances to a local
database, make sure the database is created via configuration
management. Make the mysql_backup resource require
storyboard::database instead of storyboard::application to work
around a package resource conflict.

A separate maintenance window will be used to move the data, coupled
with a change of database hostname in private Hiera. Following that,
a followup change will switch the database backups from remote to
local.

Change-Id: I912130ad8a5a139147727e49800e36e2afd815f7
2018-12-06 20:30:40 +00:00
James E. Blair
7f3963efca Add ze12.openstack.org
We believe the relative_priority change has altered our workload
such that we have smaller jobs starting more frequently.  Since
job starts are limited by the executors, we have developed a backlog
and need another executor to relieve the pressure.

Change-Id: I98052e0135c7ee615f1f187b9d0a250cdd1ff178
2018-12-05 14:08:17 -08:00
Clark Boylan
c44d47db43 Configure packages on ubuntu arm servers
We have an arm specific task here to install the HWE kernel. We use
first found to select these tasks which means the default Debian package
setup (unattended upgrades and cleanup) is not installed on our arm
servers.

Fix this by having the arm specific tasks include the generic Debian
tasks.

Change-Id: Ibb57e8b095a4cbd27cc14ef0c5ad45c61edc0679
2018-12-05 10:29:52 -08:00
Clark Boylan
5f6a1c33c0 Don't install lxd on our servers
We don't intend on using lxd on our servers and lxd is causing problems
for unattended upgrades. Lets just make sure these packages aren't
installed and avoid the problems entirely.

Change-Id: I9c6fcf8b0072c23ee0127245fa3bb6c3477dcaf5
2018-12-05 10:26:01 -08:00
Zuul
8c984dead9 Merge "Retire the interop-wg mailing list" 2018-12-05 15:10:39 +00:00
Ian Wienand
3bed6e0fd3
Enable ARA reports for system-config bridge CI jobs
This change takes the ARA report from the "inner" run of the base
playbooks on our bridge.o.o node and publishes it into the final log
output.  This is then displayed by the middleware.

Create a new log hierarchy with a "bridge.o.o" to make it clear the
logs here are related to the test running on that node.  Move the
ansible config under there too.

Change-Id: I74122db09f0f712836a0ee820c6fac87c3c9c734
2018-12-04 17:46:47 -05:00
David Moreau Simard
35e87d6879
Add support for enabling the ARA callback plugin in install-ansible
This change enables the installation of the ARA callback plugin in
the install-ansible role. It does not take care of any web reporting
capabilities.

ARA will not be installed and set up by default.
It can be installed and configured by setting
"install_ansible_enable_ara" to "true".

Co-Authored-By: David Moreau-Simard <dmsimard@redhat.com>
Co-Authored-By: Ian Wienand <iwienand@redhat.com>
Change-Id: Iea84ec8e23ca2e3f021aafae4e89c764f2e05bd2
2018-12-04 17:46:47 -05:00
David Moreau Simard
dd554dbd02
Prefix install_openstacksdk variable
Rename install_openstacksdk to install_ansible_opensatcksdk to make it
clear this is part of the install-ansible role, and it's the
openstacksdk version used with ansible (might be important if we
switch to virtualenvs). This also clears up inconsistency when we add
ARA install options too.

Change-Id: Ie8cb3d5651322b3f6d2de9d6d80964b0d2822dce
2018-12-04 17:46:47 -05:00
Zuul
56ee3a67ba Merge "bridge.o.o : install ansible 2.7.3" 2018-12-04 20:37:49 +00:00
Zuul
bb4fa8335f Merge "Shut down openstack general, dev, ops and sigs mls" 2018-12-04 00:51:27 +00:00
Zuul
727cdf1fed Merge "Make system-config-run-base-ansible-devel non-voting" 2018-12-03 23:38:09 +00:00
Zuul
41fb4a9248 Merge "Tighten permissions on zone keys" 2018-12-03 23:38:07 +00:00
Zuul
60393c746c Merge "Turn on future parser for lists.katacontainers.io" 2018-12-03 22:19:23 +00:00
James E. Blair
3706754b6b Don't import tasks in iptables reload and use listen
This syntax doesn't work in Ansible 2.8.0.  Futher, we can use
"listen" to collapse the notify to a single item (at the
expense of duplicating the when clause in the handlers).

Change-Id: I05e2d32f4e1e692ac528a7254c6e3be2858ebacf
2018-12-03 08:59:30 -08:00
Jens Harbott
7833dcd12d Make system-config-run-base-ansible-devel non-voting
Due to an issue with the current ansible branch, this check is failing
currently, make it non-voting to unblock other changes.

[0] https://github.com/ansible/ansible/issues/49430

Change-Id: I2fcf3abd69103a3e0b8eb56528650481a865a1cc
2018-12-03 13:48:34 +00:00
Monty Taylor
330ffb394b
Update the current-context to valid context
The current-context field needs to reference a defined context. The file
otherwise defines only one "vexxhost-sjc1". Set current-context to that
context.

Change-Id: I1d8991efb5d546f007146fd2fa86ce2b2aeed286
2018-11-30 15:00:08 -06:00
Jeremy Stanley
8017415779 Retire the interop-wg mailing list
This list's owners have asked for it to be shut down, as they will
be using an [interop-wg] tag on the new openstack-discuss ML for
future communication. Once this merges (so that Puppet won't
recreate it), the list can be removed with the `rmlist` utility
(this will still leave the archives available but will remove it
from the list index and no longer accept subscriptions/posts).

Set the old list address as an alias for the new openstack-discuss
ML so that replies to previous messages from the list will be routed
there for the foreseeable future.

Change-Id: Ib5fd5aece2465d569e0e7c180ee14ba94882f2b7
2018-11-30 18:39:16 +00:00
Zuul
bec9e766eb Merge "Serve opendev.org website from files.o.o" 2018-11-30 18:38:47 +00:00
Jeremy Stanley
e9d49b4839 Shut down openstack general, dev, ops and sigs mls
The general openstack, openstack-dev, openstack-operators and
openstack-sigs mailing lists have been deprecated since November 19
and are slated to be removed on December 3. Merging this on that
date will ensure any further replies to messages from those lists
are rerouted to the new openstack-discuss mailing list for the
foreseeable future.

The openstack-tc list is included in this batch as it has already
been closed down with a recommendation to send further such
communications to the openstack-discuss ML.

Additionally remove the Puppet mailman resource for the
openstack-sigs ML so it won't be automatically recreated after it
gets deleted (the other lists predate our use of Puppet for this
purpose).

Clean up the corresponding -owner spam rejection aliases since these
addresses will no longer be accepting E-mail anyway.

Change-Id: I9a7fae465c3f6bdcf3ebbadb8926eb4feb8fad79
2018-11-30 18:22:00 +00:00
Zuul
a80a8e67fd Merge "Disable openstack inventory plugin" 2018-11-30 18:11:44 +00:00
Zuul
cd9484cedf Merge "Switch to a static inventory" 2018-11-30 17:56:26 +00:00
Zuul
b8c878755e Merge "Bump amount of mod_wsgi processes for static vhosts to 16" 2018-11-30 17:42:04 +00:00
James E. Blair
2bc9bc8925 Disable openstack inventory plugin
We don't use this anymore, remove it from our config.

Change-Id: I561a6942978fca67d8f83059a957f45540ea52d7
2018-11-30 09:25:09 -08:00
Tobias Urdin
6703341337 Mirror Stein on Ubuntu from Cloud Archive
Change-Id: Ibe2ddd269be064d2bf1196111e1a23b3de887fe7
2018-11-30 17:45:02 +01:00
James E. Blair
5645c0da86 Enable relative_priority in zuul
Change-Id: I23f413e13955977fac66018ef6492d7cf0475751
2018-11-30 08:42:35 -08:00
Ian Wienand
77acd56dc7 bridge.o.o : install ansible 2.7.3
This installs Ansible 2.7.3 on bridge.o.o to incorporate fixes for [1]
which is currently stopping the cloud-launcher from running.

Currently every run it hits citycloud Lon1 and tries to delete it's
router

 TASK [cloud-launcher : Processing router openstackci-router1 for openstackci-citycloud Lon1] ***
 Monday 12 November 2018  04:07:48 +0000 (0:00:00.430)       0:07:45.811 *******
 fatal: [localhost]: FAILED! => {"changed": false, "msg": "Error
 detaching interface from router c7197a8f-096a-4488-a3ae-16fdce0ea580
 ...  cannot be deleted, as it is required by one or more floating
 IPs."}

Although it doesn't succeed, it's probably better that it isn't even
trying...

A prior version of this installed the unreleased stable branch to
bring this in, but didn't end up with enough reviews.  I've left
behind how to do that as a breadcrumb should we need to do similar in
the future (we do seem to have a nack of tickling Ansible bugs :)

[1] 951572bec1

Change-Id: I8f112ba994040c52c7b3c7ee6fd6f5a69fd22919
2018-11-30 20:38:05 +11:00
Monty Taylor
1a7dedd13f
Switch to a static inventory
Rather than be beholden to a dynamic multi-cloud process for data that
is mostly static, just pre-generated it and check it in to git. This
will remove the need to run the openstack dynamic inventory at all.

Change-Id: Ib5c38e9addc55201fd68cbe5f09684391686904e
2018-11-29 15:44:06 -06:00
James E. Blair
a14ba7c9a5 Serve opendev.org website from files.o.o
Change-Id: I8e4bd3a66fbafdef2644da0719d7bcbe6ae92666
2018-11-29 10:13:45 -08:00
Zuul
e5a4407ac7 Merge "docs: add info on generating DS records" 2018-11-29 18:00:54 +00:00
Zuul
e4f569e7c3 Merge "Blackhole messages to openstack-ko-owner@l.o.o" 2018-11-29 16:13:07 +00:00
Clark Boylan
15b19ace2c Nodepool group no longer hosts zookeeper
Remove the zookeeper tcp firewall rules from the nodepool group vars
file as we have dedicated zookeeper servers now. These rules are not
helpful.

Change-Id: I08c2596b8f459fe59d45b0f01e002b9e4b4186d4
2018-11-28 16:47:19 -08:00
James E. Blair
6368113ec9 Add kube config to nodepool servers
This adds connection information for an experimental kubernetes
cluster hosted in vexxhost-sjc1 to the nodepool servers.

Change-Id: Ie7aad841df1779ddba69315ddd9e0ae96a1c8c53
2018-11-28 16:24:53 -08:00
Ian Y. Choi
72781811aa Blackhole messages to openstack-ko-owner@l.o.o
The OpenStack Korean mailing list's owner address have
become overrun by the same mass spam we've seen hitting our other ML
owner addresses. Add a blackhole alias for it.

Change-Id: Ia6c7e6701a69ee56076062aa85f8699121648501
2018-11-29 02:23:35 +09:00
Zuul
0626de0b59 Merge "Retire bandersnatch mirroring" 2018-11-28 07:22:27 +00:00
Zuul
b3a275d022 Merge "Remove Fedora 27 mirroring" 2018-11-28 01:12:35 +00:00
Zuul
a2f10ec522 Merge "Turn on the future parser for eavesdrop.o.o" 2018-11-27 21:47:28 +00:00
Zuul
28689f45fc Merge "Remove pypi symlink" 2018-11-26 22:57:28 +00:00
Ian Wienand
5acef2c004 Remove pypi symlink
Remove the pypi symlink from the mirrors in preparation for volume
removal

Change-Id: I0f1265857e204616e5e342afe764ff3a0215c4fe
Needed-By: https://review.openstack.org/618326
2018-11-22 16:14:12 +11:00
James E. Blair
d9b6be5bad docs: add info on generating DS records
Change-Id: Ie826e2c7b099d4dec5b778b1267f7b5c5a0a6bba
2018-11-21 09:51:20 -08:00
Zuul
ec9d3b0834 Merge "fedora mirror : drop -p from rsync" 2018-11-21 16:47:43 +00:00
Jeremy Stanley
33ec337b42 Blackhole messages to openstack-sigs-owner@l.o.o
The OpenStack SIGS mailing list's owner address is starting to
become overrun by the same mass spam we've seen hitting our other ML
owner addresses. Add a blackhole alias for it.

Change-Id: Iefc5b5fa600c5d1de75d3302c8ddf0e1a03301e5
2018-11-19 16:16:33 +00:00
Ian Wienand
24cbf521df fedora mirror : drop -p from rsync
As described in [1], upstream mirrors have started putting setgid bits
on some directories starting with Fedora 29.  As you need admin
permissions on AFS to set this, we need to disable -p and just take
our own umask for the mirroring to work.

[1] https://pagure.io/releng/issue/7921

Change-Id: Id24196791f80cd99fe8a330fb2c7c6d893fc9995
2018-11-16 21:32:46 +11:00
Ian Wienand
2e1c6076b6 Remove Fedora 27 mirroring
Fedora 27 builds were removed with
I6634317838bce4f5bbffe756d96e7dc4588b46fa.  There are no more users,
so we can remove the mirror now.

Change-Id: I01c6fc15b332ecb4f17b7256b1c12fbe6be36227
Depends-On: https://review.openstack.org/614375
2018-11-16 14:29:01 +11:00
Ian Wienand
85297878f5 Retire bandersnatch mirroring
Bandersnatch mirroring has been disabled since
I88a838cb28fee3bd16b2b0a26e614ac5c2f23241 which is currently almost 6
months ago.  Since then we have been running a reverse caching proxy.

Although bandersnatch served us well, it seems pypi has become
impractical to mirror locally.  This is partially due to 2TB volume
limitations of OpenAFS and partially due to us not having a sane way
to filter large, frequently updating packages.  With the reverse proxy
working there are no plans to restore our local mirror.

Retire the references to it before we clean up the AFS volumes.

Change-Id: Ia23828328dd859bbf26f95735c1c2e99c573d10e
2018-11-16 10:28:11 +11:00
Ian Wienand
ddb92b8b20 Add Fedora 29 directories to mirror
Add the Fedora 29 directories to the Fedora mirror

Change-Id: I1d8cef615c7a6fd05b5409cb95606f534e812bcf
2018-11-16 10:15:39 +11:00
Jeremy Stanley
6c406f825b Tighten permissions on zone keys
Remove world-readable/traversable bits from permissions on the BIND
DNSSEC keys directory and the keys themselves (not actually
necessary for the public key files, but added for consistency as
they share a directory with the private keys). Note that this
matches the permissions and ownership of the existing
adns1.openstack.org server.

Change-Id: I015777ee346fefcaa92e64ad2ee88a41c7ea9bde
2018-11-14 12:44:09 +00:00
James E. Blair
3bb6841b33 Fix key filename on master ns
The keys should have a 'K' at the start.

Change-Id: I873aed771448005877eb1fdf5dc739521bf39889
2018-11-14 10:39:57 +01:00
Jeremy Stanley
4fb2143f3c Blackhole messages to edge-computing-owner@l.o.o
The OpenStack edge-computing mailing list's owner address is
starting to become overrun by the same mass spam we've seen hitting
our other ML owner addresses. Add a blackhole alias for it.

Change-Id: I97a2db5d0565cc166604352e397f580ea2d9e767
2018-11-12 10:15:02 +00:00