160 Commits

Author SHA1 Message Date
Ricardo Carrillo Cruz
6553b4f6da Add compute011.vanilla to static ansible inventory
Change-Id: Ie0d9c42393e19faca18d996774375cb3c2ec2951
2016-08-27 14:46:18 +02:00
Jenkins
55fcc94580 Merge "Add compute010.vanilla to static Ansible inventory" 2016-08-26 16:04:23 +00:00
Ricardo Carrillo Cruz
9b577dabb2 Add compute010.vanilla to static Ansible inventory
The server provisions fine and can be accessed over the network
without problems.

Change-Id: I0a3f80886238dae099d6a4573cef82688bc72d92
2016-08-26 17:06:45 +02:00
Ricardo Carrillo Cruz
97c0f54491 Add compute003.vanilla to static Ansible inventory
The server has DNS now.

Change-Id: I5ed8f0051a3fdfe910f3d830dfd08f5222d53896
2016-08-26 13:49:08 +02:00
Ricardo Carrillo Cruz
bd58194437 Add compute004 to compute007 vanilla machines to static infracloud inventory
Change-Id: Ib47fc957c39fdb9244ec4c6e960e5ffb44744063
2016-08-25 16:51:53 +02:00
Ricardo Carrillo Cruz
4c8d90e053 Add controller00 and compute00[1-2] vanilla to puppetmaster ansible inventory
Change-Id: I4af53932d92a370afef8a00db6269cd774f1a0f4
2016-08-22 16:36:00 +02:00
Khai Do
d1fd1d8928 Re-enable puppet on review-dev.o.o
Change I3d0962b975ffaf disabled puppet on review-dev.o.o to allow
testing it-storyboard plugin.  Testing is complete so now renable
puppet again.

Change-Id: Ieb6279d96331d4c793aaf62e8d5ef11abb420e98
2016-07-25 14:30:58 -07:00
Jeremy Stanley
2b1bde86d7 Temporarily disable wiki configuration management
We're test-driving a newer recaptcha configuration which may or may
not be viable, so easier to temporarily disable configuration
management until we know what config change to prose next.

Change-Id: I5571fe8dedab266521364911ce193c435adfb165
2016-07-21 18:20:26 +00:00
Jeremy Stanley
98a33eceb3 Revert "Disable puppet on wiki.openstack.org"
The configuration adjustments for recaptcha support have been tested
and are now ready, so we can reenable this.

This reverts commit 7dc243b594ceb14b0a28cfbf7e9c76268d03758f.

Change-Id: Id1692788390dfb08310ddd2d9bf97b8dabe7ffb4
2016-07-19 00:09:59 +00:00
Monty Taylor
5101e0fd0c
Remove now empty jenkins group from groups.txt
We don't have any jenkins servers anymore, so there's no need to have an
ansible group for them.

Change-Id: I0ab499ba4316e81b440dd0d1b7ffb228118eccea
2016-07-07 10:22:00 -05:00
Jeremy Stanley
a44bf0cb0c Add a node for artifact signing jobs
Create the signing01.ci.openstack.org job node and puppet the
signing subkey onto it via pubring.gpg and secring.gpg files stored
in private hiera. Also set up some basic configuration and packages
on the management bastion to aid in key management/rotation, and add
the beginnings of administrative documentation for this.

Change-Id: Iecddb778994a38f7898e0c20e7f3f8e93f0a7f60
Depends-On: I70c3b82185681ee64791cda653360c26a93bd466
Story: #2000336
Signed-off-by: Jeremy Stanley <fungi@yuggoth.org>
2016-06-23 18:30:09 +00:00
Khai Do
85201e3b08 disable puppet to install its-storyboard plugin
This is a redo of change 9c717d9c108b32.  That change was incorrect,
the server needs to be placed on the disable list.

Change-Id: I3d0962b975ffaf4560bace88abddb2f661763d55
2016-06-21 19:42:44 -07:00
Khai Do
dcced9d07c disable puppet to install its-storyboard plugin
Change-Id: I9c717d9c108b32971238ef6a621e80ef0d5ed1da
2016-06-21 16:50:27 -07:00
Monty Taylor
7dc243b594
Disable puppet on wiki.openstack.org
A set of manual investigation and remediation is under way. While that
is going on, we don't want puppet to step on things.

Change-Id: I7ebc54b222f72ca90475420499ca568b4dcb40d8
2016-06-21 17:34:09 -05:00
James E. Blair
5690f9971b Decomission jenkins-dev.openstack.org
Change-Id: I9c2c3d96b6442241ef5fe6fb5afc3fdf18834a76
2016-06-15 13:20:47 -07:00
Paul Belanger
32af2d64dc
Bring baremetal00.vanilla.ic.openstack.org online
Now that we have access again to baremetal00.vanilla.ic.openstack.org
we can enroll it again into puppet.

Change-Id: Id15c8694fe5e23896dd5778997d12dd13169183e
Depends-On: I9dfdd617fba45c0947bd3d4e853d85b83923018b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-06-12 22:31:48 -04:00
James E. Blair
0091739002 Add static zuul launcher
To handle the jenkins slaves attached to jenkins.o.o.

Change-Id: I070cbb546af848b3417dfce194f4b81e8340e419
Depends-On: I4d51a9367d1c0547daec242d5b03a19aa7b9969b
2016-05-26 11:47:11 -07:00
James E. Blair
c9bc949554 Add zuul launcher to zuul merger group
Change-Id: I86c7667b47b329afc8614343780e2b9989a402c8
2016-05-16 10:56:50 -07:00
Spencer Krum
4f768fb10e Remove infracloud from ansible inventory
We can readd them when they return
Running ansible in ad-hoc mode against 'all' hosts causes many errors
because these hosts don't exist any more.

Change-Id: If095df0811ca6d2fc04542044958055b9b835170
2016-05-03 09:52:01 -07:00
Jeremy Stanley
3f8493eb25 Disable openstackid.org by UUID before rebuilding
Due to various puppet changes which were required to support running
OpenStackId on Trusty, I7f1434a6218d3300d1315a2e3c0a446f05124353
disabled Puppet updates on the production openstackid.org server
temporarily. Given that the current plan is to replace
openstackid.org with a new server running Trusty now, switch the
disablement from its name to its UUID so we can successfully puppet
the replacement server.

Change-Id: I37fe3763c1e27ff7dfea2e2012f5df071224d30a
2016-04-04 20:16:49 +00:00
Jeremy Stanley
0e4036ddd4 Temporarily disable Puppet runs on openstackid.org
A refactor for the puppet-openstackid module in
I66c6ad413a6b0c31a19cc663058a53edc3bec5cc (switch to Puppetlabs
apache module, apache2-mpm-event, php5-fpm proxy handler) for
improved performance needs to be vetted on
openstackid-dev.openstack.org without adversely impacting production
openstackid.org.

This temporary disablement will be reverted once the updates are
confirmed to have the intended effect on the dev server and not
subtly break it in ways manual testing and CI jobs have not exposed.

Change-Id: I7f1434a6218d3300d1315a2e3c0a446f05124353
2016-03-30 15:11:17 +00:00
Jenkins
69f5e27ad0 Merge "Revert "Temporarily disable Puppet for openstackid.org"" 2016-03-23 16:39:07 +00:00
Jenkins
8de6f923c1 Merge "Also protected against OS env vars in expand-groups" 2016-03-23 15:44:45 +00:00
Jeremy Stanley
e264c08f2f Revert "Temporarily disable Puppet for openstackid.org"
This reverts commit 47721e81bbd26dbacf66f703aa8003a5ccb648f2.

Change-Id: I7b6b4d578a700a566d14ebb13e6acb238c8838ac
Depends-On: I41ddb3cd12fa564d19cedc18ca5585d2ca7481da
2016-03-23 14:07:49 +00:00
Jeremy Stanley
47721e81bb Temporarily disable Puppet for openstackid.org
Stop running Puppet on openstackid.org so that we can manually apply
a hostname fix in concert with the puppet-openstackid change
I41ddb3cd12fa564d19cedc18ca5585d2ca7481da .

Change-Id: If67783a2cbaf77e89a3d2aae80a9206b547dbac6
2016-03-23 14:02:38 +00:00
Monty Taylor
4b8b02bc7a Also protected against OS env vars in expand-groups
If we unset these in the script, it will protect us further.

Change-Id: Ic7370411df3742d1d76be08fda68cf701458e87c
2016-03-22 19:34:17 -05:00
James E. Blair
11ee9578ad Remove pypi ansible group
These servers don't exist anymore.

Change-Id: I90df6649c7360c4a1459c841ee05efbf8c92f20c
2016-03-11 15:24:35 -08:00
Colleen Murphy
de13c349ce Disable puppet for infracloud
These servers are shutting down for a while.

Change-Id: Iaa06ce43b3e12cbcc7c908e2f86a2d72878b1b0b
2016-02-26 09:31:14 -08:00
Yolanda Robla
442037003d Add east servers to infracloud group
All need to be on infracloud group. Also adding
missing servers.

Change-Id: I3584fbdf265b8b59cbe856ef83168c7b71280a60
2016-02-25 20:55:27 +01:00
Yolanda Robla
53c9ce26ec Add infracloud east servers to puppetmaster
As they come from an static inventory, we need to
add all the servers into the list. At the moment, adding
them as disabled, because they will need that all pending
changes are merged until puppet can safely run on it.

Change-Id: I665b12912d38562230e2bb8d53a35dbc37dd9c06
2016-02-25 15:05:21 +01:00
Spencer Krum
0f4323352c Delete double compute038 host from inventory
Change-Id: Ib7eb6db92779fd1f00db9625c718f4c12529ba18
2016-02-24 15:05:06 -08:00
Colleen Murphy
83c10f104d Add baremetal00 to static inventory
We added the playbook but forgot to add the static host.

Change-Id: I0b0b06ea0924d9bc34d9d83b5b81baf70cfdac48
2016-02-24 10:17:49 -08:00
Spencer Krum
7b2e533c7a Disable nonfunctional infracloud hosts
Some infracloud machines do not respond to ssh. Comment them out here
so they don't fill up our logs with errors that aren't actionable.

Change-Id: If56e773e3fe8beb0aad42e079eb8cb8492cde652
2016-02-10 14:30:08 -08:00
Colleen Murphy
32f956f268 Add infracloud playbook
Add separate playbook for infacloud nodes to ensure they run in the
correct order - baremetal -> controller -> compute.

Baremetal is intentionally left out, it is not ready yet.

All 'disabled' flags on infracloud hosts are turned off. This patch
landing turns on management of the infracloud.

Co-Authored-By: Yolanda Robla <info@ysoft.biz>
Co-Authored-By: Spencer Krum <nibz@spencerkrum.com>
Change-Id: Ieeda072d45f7454d6412295c2c6a0cf7ce61d952
2016-02-08 18:03:02 -08:00
Spencer Krum
c4aace64ad Collapse groups into one group
We only need one infracloud right now. Technically the controller
doesn't need to be in 'infracloud' because its secrets are duplicated.
This aligns the groups at any rate.

Change-Id: Ibc056505a4ef397c2adeae6a3b4afb21db9b4a02
2016-02-08 15:27:48 -08:00
Spencer Krum
0d3f4b62ba Run puppet apply on infracloud hosts
Since these are baremetal hosts, they need to come from a static
inventory not the openstack inventory. Fortunately, thats pretty easy.

Also setting infracloud groups to be children of disabled to keep them
disabled until we are ready.

Change-Id: I87ed4008ed9c4867f79bbb5fbb6be53707b42625
2016-02-05 14:53:34 -08:00
James E. Blair
bd5cf3ebe9 Fix typo in afs admin group
Change-Id: I643c4c7cf42a2350db2ca39b12e77b7e882c2cbe
2016-02-04 15:17:10 -08:00
James E. Blair
e40954a97f Create afs-admin hiera group
For mirror-update and release.slave, both of which need the
afsadmin keytab.

Change-Id: I1aade3d383ccdbe244ae523838a93bf24410495e
2016-02-04 12:05:32 -08:00
Marton Kiss
825d2f287c Disable ask-staging.openstack.org puppet run
We need temporarily stop services and disable puppet run to
restore the production database on askbot staging server.

Change-Id: Iec7852ebdb8d3cce9f6339e538bb906d0a8006b3
2016-02-04 15:59:43 +01:00
Jeremy Stanley
031400567f Put wheel-mirror workers in a common group
The wheel-mirror workers share a common set of hiera keys, and so
keeping them in a group together reduces significant duplication in
our hiera files.

Change-Id: I67b717943eb19404c87b2a3b571f681a0a15b7b4
2016-01-21 16:48:58 +00:00
Monty Taylor
765c1474b7 Use groups.txt for disabling hosts for puppet
We already have a dynamic system for managing static group management.
Use it for the disabled group so that the rules for managing the members
are not different.

Also, update the disabled list to match reality.

Also, Update docs because hosts are no longer groups

The upstream OpenStack Inventory in Ansible was fixed to no longer
return each cloud host as its own group unless there are duplicates for
the host in question. This  means it's no longer the right thing to do
to put hosts into disabled:children - disabled is just fine.

Change-Id: I95c83ed64801db15ad99a14547895f3520356f99
2016-01-20 11:38:20 -05:00
Monty Taylor
4a7c37a051 Stop listing hosts as groups in the disabled file
We have ansible inventory reporting hosts as proper hosts not as groups
now, so we no longer need to list them as children. In fact, this does
not work.

Change-Id: Idd72824023ecaef41bb98fb3a3092122d4397895
2016-01-20 10:45:06 -05:00
Monty Taylor
45efc4afc9 You have to use egrep to get real regexes
How is this still the case in 2016?

Change-Id: I3de8832bb1b86fd822f10ce35b695f10f4f8a652
2016-01-18 18:29:56 -05:00
Monty Taylor
9367e61fd9 Exclude hosts header line in expand-groups
Ansible --list-hosts output looks like this:

  root@puppetmaster:~# ansible logstash-worker --list-hosts
    hosts (20):
      loggstash-worker01.openstack.org

Which means we need to strip out the hosts (20): line.

Change-Id: Id2ab90baadcf13836f9d605bab1cf13ebf3c1a70
2016-01-18 17:42:26 -05:00
Monty Taylor
7699226007 Add script to make ansible groups from patterns
We have a set of hostname patterns which is not a thing that ansible
supports in inventory files. While we can put hostname patterns into
playbooks directly, that does not help us with copying hiera group files
since ansible doesn't know about the groups in site.pp and puppet
doesn't know about the ansible groups.

Instead, do a quick expansion any time the groups.txt file changes and
at the end of launch-node. It will be left to admins to run
expand-groups.sh whenever they delete a node.

Change-Id: I00c60748ddb2d35a3b98f78d828dabebcf065118
2016-01-15 12:13:00 -05:00
Monty Taylor
f2c45887a8 Add missing host to empty group definitions
Missed adding one when we updated the file.

Change-Id: Ifb1d51572aa57c635b3a2a0bd219fbb9fcb5cafe
2015-12-01 09:42:04 -06:00
Monty Taylor
714c934d0c Use OpenStack for inventory instead of puppet
With the puppetmaster not there anymore, we should consume inventory
from OpenStack rather than from puppet.

It turns out that because of the way static and dynamic inventories get
merged, the static file needs to stand alone. SO - if you need to
disable a dynamic host from OpenStack (pretty much all of our hosts) you
need to not only add it to dynamic:children, you need to add an emtpy
group into the static file too, otherwise you'll get an error like:

 root@puppetmaster:~# ansible -i newinv '!disabled' --list-hosts
 ERROR: newinv/static:4: child group is not defined: (jenkins-dev.openstack.org)

Change-Id: Ic6809ed0b7014d7aebd414bf3a342e3a37eb10b6
2015-11-30 22:02:41 -06:00
Monty Taylor
7cee605a77 Add shade and openstack inventory to system
We're not ready to move from puppet inventory to openstack inventory
just yet, so don't actually swap the dynamic inventory plugin. But, add
it to the system so that running manual tests of all of the pieces is
possible.

Add the currently administratively disabled hosts to the disabled group
so that we can verify this works.

Change-Id: I73931332b2917b71a008f9213365f7594f69c41e
2015-11-28 15:59:10 -05:00
Spencer Krum
c9dd65779f Add puppet apply settings to puppet.conf
We need to exist for a period of time with both agent and apply being
operational so that we can test things appropriately.

This moves agent specific settings to the [agent] section and adds a
[user] section which is used to control puppet apply.

As part of this, we need to add a production environment to all of our
nodes. Doing this in this way will also cover the current puppetmaster,
since puppetmaster is a puppet client.

Change-Id: I550c474d1c51c5795f745630fb91ee8cc1a55e36
2015-11-19 13:25:37 -05:00
Spencer Krum
4251332e97 Manage hiera.yaml on all hosts
When puppet apply runs on a host, it will need a hiera.yaml to inform
lookups with. Manage that in base.pp.

Change-Id: I61603bf2f8e1c11640c744a20377790cd217356d
2015-10-27 20:13:24 -07:00