14133 Commits

Author SHA1 Message Date
Ian Wienand
4fa823414c Add puppet6 to apt-updates
Follow-on to I30385fcf59627bf6345f8c651941ddf31bec32e2

Change-Id: I5b91c9139f9871ac0e4b3db697eb0e69bb58c089
2018-10-30 12:27:29 +11:00
Zuul
f8e198bce1 Merge "Mirror puppet6 for bionic and stretch" 2018-10-30 00:03:23 +00:00
Zuul
27a882007e Merge "Adding openstack-browbeat" 2018-10-26 19:36:28 +00:00
Zuul
6ae47aebd9 Merge "Switch zuul scheduler to new zk cluster" 2018-10-25 14:36:05 +00:00
James E. Blair
4712bdf3f7 Add opendev nameservers (2/2)
This uses IP addresses to bootstrap serving opendev.org on these
servers.

Change-Id: I769097192583c4507b19b914e4c75c60948de1bf
2018-10-25 06:27:21 -07:00
Joe Talerico
b0f04db381 Adding openstack-browbeat
Adding the meetbot and statusbot to the openstack-browbeat channel.

Change-Id: Ibb2438438cf7508bfc4e70680446ed65f3cb69e6
2018-10-24 09:33:54 -04:00
Zuul
13f6d5f9ff Merge "Update clouds.yaml for citycloud with new auth info" 2018-10-23 13:10:55 +00:00
Monty Taylor
449158138e
Update clouds.yaml for citycloud with new auth info
citycloud is rolling out per-region keystone. There is a change with an
error in it in the latest openstacksdk, so put the right auth_url into
the files directly while we update it and release it again.

Additionally, Sto2 and Lon1 each have different domain ids. The domain
names are the same though - and that's good, because logical names are
nicer in config files anyway.

Restore the config for those clouds.

Change-Id: If55d27defc164bd38af2ffd1e7739120389422af
2018-10-22 18:57:55 -05:00
Clark Boylan
2c077aa2d3 Fix zk cluster members listing
First we convert from a hash to an array to list the zk cluster members.
Do this because the older puppet-zookeeper module we use doesn't support
hashes like newer releases do.

Second we convert from hostnames to IP addresses because the hostnames
were looked up in /etc/hosts to resolve to 127.0.1.1 which caused zk to
listen on 127.0.1.1 and the cluster members could not talk to each
other.

Change-Id: Id590eb535301b27ff0dcb27cf65ba85d61ed19a5
2018-10-22 16:22:03 -07:00
Clark Boylan
709e7c09cd Cleanup Citycloud Sto2
This region does not show up in catalog listings anymore and is causing
inventory generation for ansible to fail. This change removes Sto2 from
the management side of things so that we can get ansible and puppet
running again.

This does not cleanup nodepool which we can do in a followup once
ansible and puppet are running again.

Change-Id: Ifeea238592b897aa4cea47b723513d7f38d6374b
2018-10-22 13:47:01 -07:00
Clark Boylan
c8e0df2dc2 Configure zk\d to act as a cluster
You have to tell the zk servers what servers belong to the cluster to
have them act as a cluster. Currently all our servers are in mode
standalone as they do not know about the other servers.

Fix this by configuring the three servers as servers 1, 2, and 3 in the
zk config.

Change-Id: I985ac7387744498058f99859eb8445f885b8bbcc
2018-10-22 09:50:55 -07:00
Clark Boylan
0d502ae724 Switch zuul scheduler to new zk cluster
Switch the zuul scheduler to use our new zk cluster. Note this should
happen after the builders have switched and populated image data on the
new database cluster and at the same time as the launchers update.

This gets us off the old single node zk server running on trusty to
newer xenial based zk cluster with HA.

This change does update the config for mergers and executors for
consistency, but I believe that only the scheduler makes use of this
config today.

Change-Id: I132c176af188787cec3a5a562ffdc81f818c26b0
Depends-On: https://review.openstack.org/612441
2018-10-22 09:33:28 -07:00
Tobias Urdin
860983e97d Mirror puppet6 for bionic and stretch
Puppet 6.0 is now released and we want to start
testing this on bionic and stretch.

Change-Id: I30385fcf59627bf6345f8c651941ddf31bec32e2
2018-10-21 18:41:41 +02:00
Zuul
84123c60c8 Merge "Add a workflow overview for adding a cloud" 2018-10-20 15:19:45 +00:00
Clark Boylan
7e777a63b5 Don't install testinfra 1.17.0
testinfra 1.17.0 has a broken wheel on pypi that attempts to install
importlib regardless of the python version. Unfortunately this breaks
under python3 (and possibly under python2.7) as this is a python2.6 only
dependency. Avoid this trouble by not installing that package version.

I've filed https://github.com/philpep/testinfra/issues/380 upstream to
see if they can fix this.

Change-Id: I5cdfb8467cbc62cf729a9070589f5dcf5c794234
2018-10-19 14:00:07 -07:00
Ian Wienand
8a95c976e9 Add a workflow overview for adding a cloud
Add some details about how we integrate a new cloud into the
ecosystem.  I feel like this is an appropriate level of detail given
we're dealing with clueful admins who just need a rough guide on what
to do and can fill in the gaps.

Fix up the formatting a bit while we're here.

Change-Id: Iba3440e67ab798d5018b9dffb835601bb5c0c6c7
2018-10-19 16:38:00 +00:00
Zuul
e3a4d67e97 Merge "Run standalone geard for log processing" 2018-10-18 17:30:05 +00:00
Zuul
015e82e1eb Merge "Add opendev nameservers (1/2)" 2018-10-17 17:41:58 +00:00
Zuul
c7b7801b3b Merge "Add afs client docs for non Debuntu" 2018-10-17 00:22:26 +00:00
Clark Boylan
9a16571f0d Add afs client docs for non Debuntu
Add info on how to kinit and aklog if not using Debuntu deb.conf to set
the correct realm and cell settings.

Change-Id: I80a698649f03863b73399873cf190fda4fa41776
2018-10-16 15:46:44 -07:00
James E. Blair
f5d3ee4b79 Add opendev nameservers (1/2)
This will allow us to create new nameservers in the opendev.org
domain.  We will replace the existing servers once these are
bootstrapped.

Some lines are commented pending server creation.

Change-Id: If71e3f87a9d7a83d80cff053874c84411b248515
2018-10-16 14:40:10 -07:00
James E. Blair
46a643f823 lists: run mailman verp router before dnslookup
The mailman verp router handles remote addresses like dnslookup.
It needs to run before dnslookup in order to be effective, so run
it first.  It's only for outgoing messages, not incoming, so won't
affect the blackhole aliases we have for incoming fake bounce
messages.

Note that the verp router hasn't been used in about a year due to
this oversight, so we should merge this change with caution.

Change-Id: I7d2a0f05f82485a54c1e7048f09b4edf6e0f0612
2018-10-16 13:04:13 -07:00
Zuul
e637ee5e2e Merge "Cleanup Citycloud Lon1" 2018-10-15 19:00:50 +00:00
Clark Boylan
133a94361a Cleanup Citycloud Lon1
This region does not show up in catalog listings anymore and is causing
inventory generation for ansible to fail. This change removes Lon1 from
the management side of things so that we can get ansible and puppet
running again.

This does not cleanup nodepool which we can do in a followup once
ansible and puppet are running again.

Change-Id: Icf3b19381ebba3498dfc204a48dc1ea52ae9d951
2018-10-15 10:27:44 -07:00
Zuul
abece6272a Merge "Turn on the future parser for survey.o.o" 2018-10-15 17:07:31 +00:00
Zuul
d86c021fa1 Merge "Turn on the future parser for status.o.o" 2018-10-15 17:02:02 +00:00
Zuul
a7f9a784f8 Merge "Turn on the future parser for static.o.o" 2018-10-15 17:00:43 +00:00
Zuul
ef8f275532 Merge "Hyperlink task footers on review-dev" 2018-10-11 21:01:07 +00:00
James E. Blair
55b3c0374a Install current ansible
2.7.0 has been released so we can remove our pre-release installation
version pin.

Change-Id: I9cf4baf1b15893f0c677567f5afede0d0234f0b2
2018-10-10 15:27:31 -07:00
Nicolas Bock
484e2e1ef3
Increase sync frequency for OpenSUSE repo
The OpenStack Ansible project relies on Infra's OpenSUSE repo mirror
for their OpenSUSE gate checks. It is therefore important that the
mirror is somewhat up to date and reflects a recent state of the
official repository.

In order to make "recent" more recent this change drops the sync
frequency for the OpenSUSE repositories to every 2 hours down from
every 6 hours.

Change-Id: I94012c7981cc8fd8c8da6e5fb4af3d8e402c9758
2018-10-10 06:43:20 -06:00
Zuul
cab657cf65 Merge "Add digit support to etherpad servers" 2018-10-08 16:52:28 +00:00
Zuul
38b9e983c5 Merge "Run puppet apply test serially on centos" 2018-10-08 16:38:39 +00:00
Zuul
e9d4430fa5 Merge "modules: mirror: opensuse: Ensure that old distros are wiped from mirrors" 2018-10-08 16:38:38 +00:00
Jeremy Stanley
d97ac5e50a Add note about mounting one AFS volume in another
This ate a good chunk of my day before a more AFS-savvy colleague
pointed out that a mountpoint within a volume is just a special kind
of file record and so needed the parent volume released before it
would appear in the read-only path.

Change-Id: Ic3d717d70c8bf2548447550472a52849dd85ffd3
2018-10-05 14:03:30 +00:00
Jeremy Stanley
509d3d1fd7 Hyperlink task footers
Add a commentlink entry which matches task footers in commit
messages and links them to the corresponding task URL on storyboard.
This has already been tested on review-dev, and seems to work
without breaking the separate its-storyboard entry which handles
task updating automation.

Change-Id: I8e69fa7e5dfdef5ea9c05fa457c4ee08c624d005
2018-10-03 20:00:34 +00:00
Jeremy Stanley
04c3294893 Hyperlink task footers on review-dev
Add a commentlink entry which matches task footers in commit
messages and links them to the corresponding task URL on
storyboard-dev. This has already been tested manually on review-dev,
and seems to work without breaking the separate its-storyboard entry
which handles task updating automation.

Change-Id: Iea9bde67432249e7314917ff63d6ee5e16a80f25
2018-10-03 19:56:15 +00:00
Clark Boylan
109f20e444 Retain fewer etherpad database backups
These backups were kept locally for convenience of operation. Bup stores
blobs in git so it should be effectively deduping these over time so
wasn't a stress on remote backups. However now we are filling the local
disk with the db backup files.

Address this by reducing the number of local backups to 5 (from 10).

Change-Id: I1765836784752dba2a6f2582801b860fcce4843c
2018-10-03 06:44:58 -07:00
Zuul
0027336f45 Merge "Add docs.starlingx.io vhost" 2018-10-02 20:05:23 +00:00
Zuul
408e19744f Merge "OpenStackId production release 1.0.25" 2018-09-29 12:39:32 +00:00
Zuul
921d0aae91 Merge "Only replicate openstack namespaces to github" 2018-09-28 14:52:57 +00:00
Zuul
984a587582 Merge "Creates 'embargo-notice' list" 2018-09-27 21:54:01 +00:00
Zuul
1067ff24e8 Merge "Remove snapd from servers" 2018-09-27 19:30:42 +00:00
Zuul
8338ee4a58 Merge "Redefine $listdomain for kata lists" 2018-09-27 19:23:56 +00:00
Zuul
423ade7d43 Merge "Double the gerrit regex backslashes" 2018-09-27 18:31:15 +00:00
Sebastian Marcet
08254a85b9 OpenStackId production release 1.0.25
https://github.com/openstack-infra/openstackid/releases/tag/1.0.25

Change-Id: I2aa81be1a127498f7ed492834e4e47f21de7207a
2018-09-27 12:06:08 -03:00
Monty Taylor
dfe891af3e
Double the gerrit regex backslashes
The current amount of backslashes is not good enough for gerrit, and it
rejects the config file. Probably related to futureparser? In any case,
we need doubled-backslashes in the generated file, so 4 backslashes does
the right thing in the puppet.

Change-Id: I950b8efbcb876b2d1309f1117626a41ef22025b0
2018-09-27 08:17:53 -05:00
Monty Taylor
71bf869225
Remove snapd from servers
We don't use snappy to install software on our servers, but it started
being installed by default. We don't need it, so remove it.

Change-Id: I043d4335916276476350d9ac605fed1e67362e15
2018-09-27 07:45:31 -05:00
Monty Taylor
0e985c2d63
Only replicate openstack namespaces to github
As we start doing things like opendev, we should be able to add
additional prefixes in gerrit without replicating them to github - or
causing gerrit to just spawn errors.

Change-Id: I9bca81df9d9600c4ccb1550039f488c6eb552abd
2018-09-26 12:11:02 -05:00
Monty Taylor
19712f93e7
Only replicate gtest-org and kdc
Test replication constraints on review-dev.

Change-Id: Icce6be35bc0e14b1d75c4967b0cd4972075c8762
2018-09-26 12:10:29 -05:00
Anne Bertucio
5caca6da6a Creates 'embargo-notice' list
Creates the 'embargo-notice' list for Kata
Containers.

Change-Id: Ica6d795999b98819d40fec9529031f96395ecffc
2018-09-25 12:58:56 -07:00