4347 Commits

Author SHA1 Message Date
Clark Boylan
255d8091e1 Set the debian ceph key id to proper value
Turns out we got the wrong hash before :( but thankfully reprepro didn't
funciton in that state. Get the ids correct so reprepro can do its job.

Change-Id: Ic8e5f3ebfea681b289e1f5381134df4e0485af3d
2016-04-14 16:30:01 -07:00
Clark Boylan
3878c06e1b Apt mirror for ceph hammer release
Mirror the trusty packages for the ceph hammer release to aid in process
of making ceph testing more robust. Use reprepro which is already in use
to mirror the main ubuntu trusty repos.

Change-Id: Ifd09272c7b1e07de9135be5a96be06153a3f611e
2016-04-14 14:01:27 -07:00
Matthew Treinish
6b74d687a4
Update subunit2sql conf path
The puppet-subunit2sql module updated where it puts config file to
be in /etc/subunit2sql instead of /etc/logstash. But we missed updating
the worker yaml config file. This patch corrects the oversight.

Change-Id: Ibb4d2eee7deb7876fc17c49dade8d4ae1236ca3e
2016-04-08 14:49:31 -04:00
Jeremy Stanley
3f8493eb25 Disable openstackid.org by UUID before rebuilding
Due to various puppet changes which were required to support running
OpenStackId on Trusty, I7f1434a6218d3300d1315a2e3c0a446f05124353
disabled Puppet updates on the production openstackid.org server
temporarily. Given that the current plan is to replace
openstackid.org with a new server running Trusty now, switch the
disablement from its name to its UUID so we can successfully puppet
the replacement server.

Change-Id: I37fe3763c1e27ff7dfea2e2012f5df071224d30a
2016-04-04 20:16:49 +00:00
Jeremy Stanley
0e4036ddd4 Temporarily disable Puppet runs on openstackid.org
A refactor for the puppet-openstackid module in
I66c6ad413a6b0c31a19cc663058a53edc3bec5cc (switch to Puppetlabs
apache module, apache2-mpm-event, php5-fpm proxy handler) for
improved performance needs to be vetted on
openstackid-dev.openstack.org without adversely impacting production
openstackid.org.

This temporary disablement will be reverted once the updates are
confirmed to have the intended effect on the dev server and not
subtly break it in ways manual testing and CI jobs have not exposed.

Change-Id: I7f1434a6218d3300d1315a2e3c0a446f05124353
2016-03-30 15:11:17 +00:00
Jenkins
8fab4a50bd Merge "Replace Wait(1) with Playback(silence/1)" 2016-03-25 13:43:43 +00:00
Jenkins
69f5e27ad0 Merge "Revert "Temporarily disable Puppet for openstackid.org"" 2016-03-23 16:39:07 +00:00
Jenkins
8de6f923c1 Merge "Also protected against OS env vars in expand-groups" 2016-03-23 15:44:45 +00:00
Jeremy Stanley
e264c08f2f Revert "Temporarily disable Puppet for openstackid.org"
This reverts commit 47721e81bbd26dbacf66f703aa8003a5ccb648f2.

Change-Id: I7b6b4d578a700a566d14ebb13e6acb238c8838ac
Depends-On: I41ddb3cd12fa564d19cedc18ca5585d2ca7481da
2016-03-23 14:07:49 +00:00
Jeremy Stanley
47721e81bb Temporarily disable Puppet for openstackid.org
Stop running Puppet on openstackid.org so that we can manually apply
a hostname fix in concert with the puppet-openstackid change
I41ddb3cd12fa564d19cedc18ca5585d2ca7481da .

Change-Id: If67783a2cbaf77e89a3d2aae80a9206b547dbac6
2016-03-23 14:02:38 +00:00
Monty Taylor
4b8b02bc7a Also protected against OS env vars in expand-groups
If we unset these in the script, it will protect us further.

Change-Id: Ic7370411df3742d1d76be08fda68cf701458e87c
2016-03-22 19:34:17 -05:00
Clark Boylan
c929e3fb66 Make reprepro useable on multiple mirrors
Ubuntu isn't the only thing we want to mirror, we may also want to
mirror debian or ceph packages and so on. Refactor the puppet so that it
is easier to do this in a reconsumable way.

Change-Id: I0a12bc4cb67339a7566fb113bbbc897d4f112f50
2016-03-16 09:34:18 -07:00
James E. Blair
11ee9578ad Remove pypi ansible group
These servers don't exist anymore.

Change-Id: I90df6649c7360c4a1459c841ee05efbf8c92f20c
2016-03-11 15:24:35 -08:00
Jenkins
bea895cd62 Merge "login.defs/redhat: set SYS_UID_MIN and SYS_GID_MIN" 2016-03-11 12:49:28 +00:00
Jenkins
c4d1de7b73 Merge "Cacti: add hosts to alternate graph trees" 2016-03-10 17:05:49 +00:00
Jenkins
d105f52f13 Merge "Allow the review history panel to resize" 2016-03-08 10:16:41 +00:00
Emilien Macchi
6abde2074e login.defs/redhat: set SYS_UID_MIN and SYS_GID_MIN
According to [1], UIDs and GIDs between 0 and 200 are reserved for some
services, including OpenStack services.

Puppet OpenStack is deploying OpenStack using RDO packaging and there is
currently a race condition where sometimes RabbitMQ is installed
*before* Keystone and steals its UID, Keystone fails to be installed,
and CI job is failing.

This patch prevents this situation by setting both SYS_UID_MIN and
SYS_GID_MIN ti 201, so packages using dynamic UID/GID won't steal
reserved ones.

[1] https://git.fedorahosted.org/cgit/setup.git/tree/uidgid

Change-Id: I7cc41adc7e6070c32d9a56940a67640ab4419e7e
2016-03-03 23:33:32 -05:00
Jenkins
909b8af2e9 Merge "Add a job filter for old side subunit files" 2016-03-01 22:06:23 +00:00
Colleen Murphy
de13c349ce Disable puppet for infracloud
These servers are shutting down for a while.

Change-Id: Iaa06ce43b3e12cbcc7c908e2f86a2d72878b1b0b
2016-02-26 09:31:14 -08:00
Yolanda Robla
442037003d Add east servers to infracloud group
All need to be on infracloud group. Also adding
missing servers.

Change-Id: I3584fbdf265b8b59cbe856ef83168c7b71280a60
2016-02-25 20:55:27 +01:00
Yolanda Robla
53c9ce26ec Add infracloud east servers to puppetmaster
As they come from an static inventory, we need to
add all the servers into the list. At the moment, adding
them as disabled, because they will need that all pending
changes are merged until puppet can safely run on it.

Change-Id: I665b12912d38562230e2bb8d53a35dbc37dd9c06
2016-02-25 15:05:21 +01:00
Spencer Krum
0f4323352c Delete double compute038 host from inventory
Change-Id: Ib7eb6db92779fd1f00db9625c718f4c12529ba18
2016-02-24 15:05:06 -08:00
James E. Blair
653df410d8 Cacti: add hosts to alternate graph trees
This adds support for several graph trees and adds hosts to those
trees based on their hostnames.

Change-Id: Ifdacc400d864bf320fc35367de47d0be7c72163d
2016-02-24 15:03:58 -08:00
Colleen Murphy
83c10f104d Add baremetal00 to static inventory
We added the playbook but forgot to add the static host.

Change-Id: I0b0b06ea0924d9bc34d9d83b5b81baf70cfdac48
2016-02-24 10:17:49 -08:00
Matthew Treinish
4ed867508a
Add a job filter for old side subunit files
This commit adds back the job filter on the old side subunit stream
from grenade runs. The subunit stream will only end up under logs/old
if it's a grenade run. So to be more efficient lets filter looking
for a subunit stream there only to grenade jobs.

Change-Id: I5a6c9b17f923526745507a131658f581a9d94e0a
2016-02-17 11:40:07 -05:00
Jenkins
d78e3d66f5 Merge "Remove retry-get param from subunit file collection" 2016-02-17 16:28:11 +00:00
Jenkins
c25d45fb8c Merge "Remove job filters and add missing paths to subunit collection" 2016-02-17 16:27:32 +00:00
Matthew Treinish
eb44d78d57
Remove retry-get param from subunit file collection
This commit removes the retry-get parameters from the subunit file
collection in the logstash gearman client. These were cargo-culted
from elsewhere in the yaml file and doesn't add anything useful in
this case. The param is only there to workaround jenkins limitations
with the console log uploading.

Change-Id: Ic751d5e295e605b20386ad9cde6500bae44f34d8
2016-02-16 15:54:13 -05:00
Matthew Treinish
30ad231a19
Remove job filters and add missing paths to subunit collection
This commit will enable collection of subunit results from all subunit
emitting jobs in the gate and periodic pipelines. Now that we prune
the database to only 6 months of history we should have plenty of
headroom for the extra data generated by non-tempest-dsvm jobs.
(hopefully)

Depends-On: I58a640f804313e1e4b80680f0e39b86d76cb29da
Change-Id: If5691af792409f02352f25b1498dd78294a7cd74
2016-02-11 17:57:29 -05:00
Spencer Krum
7b2e533c7a Disable nonfunctional infracloud hosts
Some infracloud machines do not respond to ssh. Comment them out here
so they don't fill up our logs with errors that aren't actionable.

Change-Id: If56e773e3fe8beb0aad42e079eb8cb8492cde652
2016-02-10 14:30:08 -08:00
Jenkins
e9fce31aa2 Merge "Add infracloud playbook" 2016-02-10 19:58:04 +00:00
Jenkins
91b5d1f01c Merge "Show toggle CI button for Gerrit URLs with patch set ranges" 2016-02-10 14:52:43 +00:00
Yolanda Robla
e1009a290b Update mirror to use in easy_install
It is pointing to deprecated mirror, causing tests to
fail when installing pbr.

Change-Id: Ic7723a2afba2c650c5233794a35683bc9f980ec0
2016-02-10 13:07:55 +01:00
Jenkins
26bb470549 Merge "Don't write k5start banner to file list" 2016-02-09 02:51:47 +00:00
Colleen Murphy
32f956f268 Add infracloud playbook
Add separate playbook for infacloud nodes to ensure they run in the
correct order - baremetal -> controller -> compute.

Baremetal is intentionally left out, it is not ready yet.

All 'disabled' flags on infracloud hosts are turned off. This patch
landing turns on management of the infracloud.

Co-Authored-By: Yolanda Robla <info@ysoft.biz>
Co-Authored-By: Spencer Krum <nibz@spencerkrum.com>
Change-Id: Ieeda072d45f7454d6412295c2c6a0cf7ce61d952
2016-02-08 18:03:02 -08:00
Spencer Krum
c4aace64ad Collapse groups into one group
We only need one infracloud right now. Technically the controller
doesn't need to be in 'infracloud' because its secrets are duplicated.
This aligns the groups at any rate.

Change-Id: Ibc056505a4ef397c2adeae6a3b4afb21db9b4a02
2016-02-08 15:27:48 -08:00
Monty Taylor
bb953ce7fc Don't write k5start banner to file list
k5start prints:

  "Kerberos initialization for service/reprepro@OPENSTACK.ORG"

This then gets redirected into the list of files to remove on the next
run - which is an error, since that's not a filename. Put the
redirection inside of a bash command so that only the data gets
redirected.

Change-Id: Icae10763b4bce78c7b674715826547c228980dd6
2016-02-08 16:33:29 -06:00
Monty Taylor
7ec1b3d7e3 Split reprepro config to allow for debian and ubuntu
We can't colocation debian and ubuntu - so allow for each having their
own pool independent pool structure.

Change-Id: I9fe0fa9769a5c0f6a852844b2db0dfb620e91375
2016-02-08 14:16:53 -06:00
Monty Taylor
857b22519a Remove restricted and multiverse
The packages in restricted and multiverse are either non-free or
unsupported. While they're usually useful for desktop, they aren't
something that OpenStack should grow a dependency on.

Also remove non-free and contrib from debian. We don't do anything with
debian yet - but if we did, I'm pretty sure we would not want these.

Note: The existing restricted and multiverse dirs should be purged,
although it's not urgent to do so. 'reprepro --delete clearvanished'

Change-Id: I1d98ab1dea52598d01e3ce3d9a24306280a190fe
2016-02-08 12:29:16 -06:00
Jenkins
75abc5bc4b Merge "Removed pypi.<region> mirror manifests" 2016-02-08 17:53:04 +00:00
Jenkins
178c136a66 Merge "Use k5start even for the readonly reprepro actions" 2016-02-08 17:46:03 +00:00
Jenkins
f058f3234e Merge "Import gpg keys for mirroring into local keyring" 2016-02-08 17:18:33 +00:00
Monty Taylor
8e7c013953 Use k5start even for the readonly reprepro actions
Now that the db files are in AFS, we need k5start because we need to be
able to write lockfiles for them.

Change-Id: I5c9554ca505ed56e84b601e40476527ef4af98fb
2016-02-08 10:40:25 -06:00
Monty Taylor
5bb629505d Import gpg keys for mirroring into local keyring
We need the gpg signing keys for the upstream repos in root's keyring.
Fuel uses golja-gnupg for importing keys - so seems like a good thing
for us to use too.

Change-Id: I343be9397ba53f494485d1ff0f1e1e4c96c0273f
2016-02-08 09:36:25 -06:00
Jenkins
918c185761 Merge "Update paths for AFS mirror" 2016-02-08 15:14:22 +00:00
Monty Taylor
d00e7c0e5d Update paths for AFS mirror
In the current setup, the reprepro db and lists dirs are being written
into /root. Move them into AFS so that we store all the data in the same
place.

Also, update the script to point to the confdir for reprepro commands.

Note: This will require a manual move of the current db and lists dirs
from /root to /afs/.openstack.org/mirror/apt before this is run.

Change-Id: I2638621e6af98296704e680227fae174d8a0e541
2016-02-07 09:53:14 -06:00
Jenkins
ad466beb7d Merge "Run puppet apply on infracloud hosts" 2016-02-07 08:04:42 +00:00
Jenkins
16fccb52b7 Merge "Revert "Temporarily stop releasing after bandersnatch"" 2016-02-05 23:23:40 +00:00
Spencer Krum
0d3f4b62ba Run puppet apply on infracloud hosts
Since these are baremetal hosts, they need to come from a static
inventory not the openstack inventory. Fortunately, thats pretty easy.

Also setting infracloud groups to be children of disabled to keep them
disabled until we are ready.

Change-Id: I87ed4008ed9c4867f79bbb5fbb6be53707b42625
2016-02-05 14:53:34 -08:00
Jenkins
6b15593b6b Merge "Add AFS apt mirror" 2016-02-05 19:22:42 +00:00