235 Commits

Author SHA1 Message Date
Spencer Krum
8cdaf92609 Treat openstack_health normally
This is a partial revert of 05c16e2e that removes special casing around
the openstack-health/openstack_health repo.

Change-Id: I832f1b764a34c128d737a467fa568cc064226c5a
2015-11-06 10:00:14 -08:00
Craige McWhirter
8df9be2332 Re-home migrate-to-phab.sql
This used to live in puppet-phabricator but as it has nothing to
do with the puppet module, it is being moved here.

Change-Id: I17d7cbcd3f7bb0147305bcd1d2976dd7c409fec8
Implements: spec maniphest migration
2015-11-01 07:41:30 +10:00
Monty Taylor
5e64f03f52 Add script to downgrade gerrit from 2.10
A while back we had an emergency downgrade of gerrit and developed
this script to do it.

Change-Id: I95c121b5c7c6f3f8946919e712c09af47762b11a
2015-10-29 10:05:43 +09:00
Jenkins
ddcb60ac19 Merge "Remove common.yaml default for hieredit" 2015-10-28 07:49:16 +00:00
James E. Blair
6a8e2e8881 Remove common.yaml default for hieredit
We have split the hiera file, so there is no sensible default for
this command now.

Change-Id: I9befdff8aabb8c8e84653dbd57b1b5d339623ddc
2015-10-28 15:27:08 +10:00
Monty Taylor
b381b6e9bd Dump hiera values properly in remap
These changes were made live before the file split.

Change-Id: If7ac51fa2ffda5190ff2e04a3dc18161c3d30633
2015-10-28 12:31:11 +09:00
Jenkins
36ac4f52ed Merge "Make hiera default values optional" 2015-10-23 22:35:56 +00:00
Matthew Treinish
05c16e2e35
Add openstack-health api server
This commit adds the puppet config for running an openstack-health
api instance. It'll use the subunit2sql trove db node as a data
source. The puppet-openstack-health module is incorrectly named which
is causing issues, a workaround to rename the repo is added to
install_modules.sh. This is a temporary measure until the gerrit
rename is completed. There is also a workaround in the apply test.

Change-Id: I7e6d9664d087e7bdc21d92624991d0d5f86c0c99
2015-10-19 15:27:00 -04:00
K Jonathan Harker
cd00179976 Make hiera default values optional
Currently, all hiera calls need to have default values in order for the
apply test to work. This is done by using sed to replace the hiera call
with the default value in the call, i.e. 'hiera("foo", "bar")' is
replaced with '"bar"'.

This adds another sed command that replaces a hiera call that has no
default value specified with the name of the key appended with
NoDefault, i.e. 'hiera("foo")' will become '"fooNoDefault"'.

By making the hiera default values optional, we no longer need to pass
in a default value to every hiera call, and so we can remove the
placeholder XXX that were previously needed by the apply tests but not
by puppet itself.

Change-Id: Ibdeb0c2e49245ea05116e8043936d5b012f46666
2015-10-16 14:03:35 -07:00
Jenkins
bd44a946cc Merge "Turn image logging level up to DEBUG" 2015-10-13 21:05:34 +00:00
Jenkins
5a7c74c6d4 Merge "Test that modules.env is complete" 2015-10-07 07:10:31 +00:00
Ian Wienand
4de87db276 Turn image logging level up to DEBUG
In I54db78b028017500b58693ec717c23eaf6a220b6 I added some handy values
that are intendend to go into public log files to help you establish
when an image-build has started or stopped (for example, [1] is
currently ~300MiB of looping build log data and it's really hard to
pick out where things are going wrong).

The problem is, I put them in at DEBUG level and the image loggers are
only set to INFO level.  So the messages aren't making it into the
public logfiles as hoped, and thus not available to help people
diagnose issues with their builds.

I think the best idea is to turn these up to DEBUG level to capture
these, and any other low-level messages from this logger, in the
public output.

[1] http://nodepool.openstack.org/image.log

Change-Id: Ib9ac5fc81ccef73f1b1e20b8381bdd1afac4bcae
2015-10-01 13:14:45 +10:00
Colleen Murphy
324e5c4f57 Make apply test more configurable
The Infra Cloud project uses a different set of puppet modules than the
standard infra ones in order to avoid possible dependency conflicts[1].
Currently the puppet-apply test hard-codes the entry-point puppet
manifest and module list. This patch makes the manifest, currently
manifests/site.pp, and the module file, currently modules.env,
configurable, so that we can add a new job to test just these nodes
with the correct modules installed.

[1] https://review.openstack.org/#/c/209617/

Change-Id: I744123befef0bf27a1eb2a79f5d814e0cefe81f5
2015-09-24 15:52:03 -07:00
Jenkins
764326fdec Merge "Update groups maint script" 2015-09-22 01:17:48 +00:00
Jenkins
7b6766aeeb Merge "Remap repo names in ATC query script" 2015-09-18 02:29:43 +00:00
Jenkins
2f99e02e5f Merge "Update ATC and approvers scripts for deliverables" 2015-09-18 02:21:30 +00:00
James E. Blair
4cafe31b17 Update groups maint script
Update the infra group maintenance script for the most recent
governance projects.yaml changes.

Change-Id: I7dffbcd4467572b2e99ed41cbee000baae2d332d
2015-09-15 07:49:17 -07:00
K Jonathan Harker
a359cea46c Test that modules.env is complete
The test slaves that the apply tests run on have puppet modules
installed from the initial slave configuration. Delete the previously
installed modules before re-installing to ensure that the apply test
only uses the modules listed in the current change's modules.env.

Change-Id: Ie62b64133c480c05968ab554185527ac5e432858
2015-08-19 15:43:31 -07:00
Jenkins
8db7cb45b9 Merge "Optionally check for diskimages on nodepool log generation tool" 2015-08-16 12:17:40 +00:00
Jenkins
10e519e566 Merge "Add utility for inspecting puppet module versions" 2015-08-14 10:40:06 +00:00
Yolanda Robla
b47e0c76ec Optionally check for diskimages on nodepool log generation tool
This tool assumes that diskimages option is always present on
nodepool configuration. For downstream consumption, it may not
be the case, so checking if setting is present.

Change-Id: I901e044ae9ec37eb64bc662e4182d317cf4a7647
2015-08-13 13:06:29 +02:00
Jeremy Stanley
554664d977 Remap repo names in ATC query script
Our repo shortnames are unique across all namespaces, so remap
governance repo names to Gerrit repo names by matching them in any
namespace. This works around asynchronous namespace moves which may
take effect independently in project-config and governance repos at
different times.

Change-Id: Ia70202bb874b6671950f4033d974087a2ee531d5
2015-08-08 02:57:05 +00:00
Jeremy Stanley
ec26e2b988 Update ATC and approvers scripts for deliverables
In I2aa729d1b4278743a5e99b41178dc2d11b3e1348 the projects.yaml file
of the governance repo was reorganized to support a new
"deliverables" concept which provides a subgrouping of related repos
under each project team. This requires adjustments in the scripts
consuming that file, specifically email_stats.py and
who-approves.py.

Change-Id: I041a62fd86a776279536f003724cb8c289922080
2015-08-06 18:18:04 +00:00
Jenkins
065fde589b Merge "Don't clone project-config for puppet-apply jobs" 2015-08-05 19:26:06 +00:00
Paul Belanger
037351ee19 Add fedora support for apply-test.sh
Change-Id: Id9d6e2977ff13c58f7fc6a31957a250bbe728c2e
Depends-On: Ia1a72f7b7e58a4e9861c6d5916521d0c0ad7f8ec
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-08-05 11:25:53 -04:00
Paul Belanger
55f6e468a1 Add centos7 support for apply-test.sh
Change-Id: I10da00d7e4e8dcbad5c095cbeee2bc8f4c389bb6
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-08-04 16:09:13 -04:00
Ian Wienand
f660901160 Don't clone project-config for puppet-apply jobs
It does not appear these jobs actually require the project-config repo
for anything.  It was added in
I3a772e84a1bc6028caeabcc8e09a0942f44b8612 without a lot of
explaination of why, but as it stands I don't see the project-config
affects the outcome of these jobs?

Change-Id: I85111afbbce497c86f4f6d8dfe74944c32a77b80
2015-07-28 15:58:36 +10:00
Jenkins
a2760f8743 Merge "Note to escape literal $ in invite2summit template" 2015-07-17 00:09:13 +00:00
Jenkins
8da6435ef2 Merge "Rename invite2summit README to README.rst" 2015-07-16 23:52:14 +00:00
Jenkins
bed14bd5bd Merge "Make invite2summit README into reStructuredText" 2015-07-16 23:52:02 +00:00
Jenkins
1d9f5f5e40 Merge "Add infra-puppet-core and release groups" 2015-07-16 23:27:01 +00:00
Jenkins
67edef3ed8 Merge "Add a script to configure the infra group structure" 2015-07-16 23:02:33 +00:00
Jenkins
11f62e3a76 Merge "Add a tool to update gerrit groups" 2015-07-16 23:02:03 +00:00
Jenkins
05484a4a5b Merge "Add SQL file for emergency rollback" 2015-07-16 21:51:27 +00:00
Jenkins
be3dfb3887 Merge "Add script to split the secret hieradata file" 2015-07-16 21:46:19 +00:00
Jeremy Stanley
e6ef4cb6dd Note to escape literal $ in invite2summit template
Literal $ characters in the template which are not part of a
substitution variable should be doubled to to avoid raising a
ValueError exception.

Change-Id: I14fd33571d63d50fc65e8c87fb10577e691b6c8e
2015-07-10 13:04:57 +00:00
Jeremy Stanley
62a81967e9 Rename invite2summit README to README.rst
This is done as a separate step from the content formatting change
for ease of review.

Change-Id: I50111f5bedba2ce4e3793d5071d10567fa71e3b6
2015-07-10 13:02:50 +00:00
Jeremy Stanley
1b76f693b4 Make invite2summit README into reStructuredText
Basic formatting changes for better reStructuredText rendering.

Change-Id: If6cc02dedacf8a74cab8772776c3c39ddf971fd8
2015-07-10 13:02:28 +00:00
James E. Blair
ade79eb3f2 Remove -e from apply test applier
The script that is run by find on each apply test file has -e set,
yet, it attempts to save the exit code from puppet apply and keep
running even in error.  Remove -e so that it does not immediately
exit and can continue as designed.

Change-Id: I1a24e80f42be8d028ecc3eb02df54b49f811fff4
2015-07-08 16:30:59 -07:00
Jenkins
c980672d9c Merge "Display puppet apply results right after running" 2015-07-08 21:10:51 +00:00
Jenkins
f995c0ea00 Merge "Script to install modules during integration" 2015-07-08 20:37:27 +00:00
Paul Belanger
be7adfa7f2 Display puppet apply results right after running
Otherwise, there is a case where the results are not rendered properly
because the shell exits.

Change-Id: Ica05615cad4fcc15c9d941d16f74cb4f68bc5a99
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-07-08 16:36:36 -04:00
Spencer Krum
eaeec6f2fd Script to install modules during integration
This script closely follows the script in
openstack/puppet-openstack-integration to provide installation of
modules in both testing contexts: zuul and local development.

Change-Id: I517954d26409f2fbe96588f40f6f07316d85843d
Co-Authored-By: Colleen Murphy <colleen@gazlene.net>
2015-07-03 14:11:58 -07:00
Jenkins
77b74d85d3 Merge "Alpha-sort modules.env" 2015-07-03 01:35:03 +00:00
Jenkins
1e3c065182 Merge "Print the node definition before apply test" 2015-07-03 00:50:56 +00:00
Spencer Krum
1f0704e462 Alpha-sort modules.env
Also adds a test to ensure that they stay that way.

Change-Id: Ib34a81885f1eda28e85d04b727e8b810b274cb44
2015-07-02 12:25:24 -07:00
James E. Blair
4143675444 Add infra-puppet-core and release groups
Add these groups to all infra puppet-* repositories.

Change-Id: Ib125de1197e77f4cbba3a4b04faf096c08a73dc6
2015-06-23 15:10:34 -07:00
James E. Blair
ebcf675c92 Add a script to configure the infra group structure
Every repo should have a core group that includes infra-core, and
each of those core groups should be members of the infra-council.

Change-Id: Ibc02900cf2d885fa513a78b83b902dd0c4273e72
2015-06-23 14:41:20 -07:00
James E. Blair
c48666082a Add a tool to update gerrit groups
This tool will create or modify groups as specified on the command
line.  It is useful for mass-updating a large number of groups.
In particular, setting the owner of an existing group is only
available in the REST API, rather than SSH.

Change-Id: I56762b16701ca96b45c8a626edca4cbc26e2859f
2015-06-23 14:41:19 -07:00
Jenkins
af38519fdc Merge "Simplify nodepool diskimage logging" 2015-06-17 01:33:59 +00:00