107 Commits

Author SHA1 Message Date
Jenkins
a2760f8743 Merge "Note to escape literal $ in invite2summit template" 2015-07-17 00:09:13 +00:00
Jenkins
8da6435ef2 Merge "Rename invite2summit README to README.rst" 2015-07-16 23:52:14 +00:00
Jenkins
bed14bd5bd Merge "Make invite2summit README into reStructuredText" 2015-07-16 23:52:02 +00:00
Jenkins
1d9f5f5e40 Merge "Add infra-puppet-core and release groups" 2015-07-16 23:27:01 +00:00
Jenkins
67edef3ed8 Merge "Add a script to configure the infra group structure" 2015-07-16 23:02:33 +00:00
Jenkins
11f62e3a76 Merge "Add a tool to update gerrit groups" 2015-07-16 23:02:03 +00:00
Jenkins
05484a4a5b Merge "Add SQL file for emergency rollback" 2015-07-16 21:51:27 +00:00
Jenkins
be3dfb3887 Merge "Add script to split the secret hieradata file" 2015-07-16 21:46:19 +00:00
Jeremy Stanley
e6ef4cb6dd Note to escape literal $ in invite2summit template
Literal $ characters in the template which are not part of a
substitution variable should be doubled to to avoid raising a
ValueError exception.

Change-Id: I14fd33571d63d50fc65e8c87fb10577e691b6c8e
2015-07-10 13:04:57 +00:00
Jeremy Stanley
62a81967e9 Rename invite2summit README to README.rst
This is done as a separate step from the content formatting change
for ease of review.

Change-Id: I50111f5bedba2ce4e3793d5071d10567fa71e3b6
2015-07-10 13:02:50 +00:00
Jeremy Stanley
1b76f693b4 Make invite2summit README into reStructuredText
Basic formatting changes for better reStructuredText rendering.

Change-Id: If6cc02dedacf8a74cab8772776c3c39ddf971fd8
2015-07-10 13:02:28 +00:00
James E. Blair
ade79eb3f2 Remove -e from apply test applier
The script that is run by find on each apply test file has -e set,
yet, it attempts to save the exit code from puppet apply and keep
running even in error.  Remove -e so that it does not immediately
exit and can continue as designed.

Change-Id: I1a24e80f42be8d028ecc3eb02df54b49f811fff4
2015-07-08 16:30:59 -07:00
Jenkins
c980672d9c Merge "Display puppet apply results right after running" 2015-07-08 21:10:51 +00:00
Jenkins
f995c0ea00 Merge "Script to install modules during integration" 2015-07-08 20:37:27 +00:00
Paul Belanger
be7adfa7f2 Display puppet apply results right after running
Otherwise, there is a case where the results are not rendered properly
because the shell exits.

Change-Id: Ica05615cad4fcc15c9d941d16f74cb4f68bc5a99
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-07-08 16:36:36 -04:00
Spencer Krum
eaeec6f2fd Script to install modules during integration
This script closely follows the script in
openstack/puppet-openstack-integration to provide installation of
modules in both testing contexts: zuul and local development.

Change-Id: I517954d26409f2fbe96588f40f6f07316d85843d
Co-Authored-By: Colleen Murphy <colleen@gazlene.net>
2015-07-03 14:11:58 -07:00
Jenkins
77b74d85d3 Merge "Alpha-sort modules.env" 2015-07-03 01:35:03 +00:00
Jenkins
1e3c065182 Merge "Print the node definition before apply test" 2015-07-03 00:50:56 +00:00
Spencer Krum
1f0704e462 Alpha-sort modules.env
Also adds a test to ensure that they stay that way.

Change-Id: Ib34a81885f1eda28e85d04b727e8b810b274cb44
2015-07-02 12:25:24 -07:00
James E. Blair
4143675444 Add infra-puppet-core and release groups
Add these groups to all infra puppet-* repositories.

Change-Id: Ib125de1197e77f4cbba3a4b04faf096c08a73dc6
2015-06-23 15:10:34 -07:00
James E. Blair
ebcf675c92 Add a script to configure the infra group structure
Every repo should have a core group that includes infra-core, and
each of those core groups should be members of the infra-council.

Change-Id: Ibc02900cf2d885fa513a78b83b902dd0c4273e72
2015-06-23 14:41:20 -07:00
James E. Blair
c48666082a Add a tool to update gerrit groups
This tool will create or modify groups as specified on the command
line.  It is useful for mass-updating a large number of groups.
In particular, setting the owner of an existing group is only
available in the REST API, rather than SSH.

Change-Id: I56762b16701ca96b45c8a626edca4cbc26e2859f
2015-06-23 14:41:19 -07:00
Jenkins
af38519fdc Merge "Simplify nodepool diskimage logging" 2015-06-17 01:33:59 +00:00
Spencer Krum
284749fb4d Print the node definition before apply test
This makes it easier to tell which node definition is being evaluated
Because xargs -P doesn't do bash functions, some of the apply_test has
been moved into test_puppet_apply.sh. All the test snippets and test
output is being recorded in files in tools/opt, then catted for the
user.

Change-Id: I4fb77f93f9e9a7216b62634438a11d8d297bdefe
2015-06-12 17:11:25 -07:00
Jenkins
447e75fa84 Merge "Generate machine-readable tree of change approvers" 2015-05-31 22:02:26 +00:00
Jeremy Stanley
7d2ceb6e79 Simplify nodepool diskimage logging
There's no need to create per-provider image update logs for
providers which only use diskimages of the same.

Change-Id: I06e5413ac9357587cd4aa7afa34414b0cc01c124
2015-05-27 00:07:33 +00:00
Jeremy Stanley
a3456782d4 Generate machine-readable tree of change approvers
* tools/who-approves.py: New script which, when run using
OpenStack's Gerrit server, builds JSON and YAML representations of
repos with information on the official owning project if any,
integration status, and groups with approve rights listing the
members of each along with their Gerrit preferred E-mail addresses
and usernames when available.

It was done as a demonstration to a representative of a foundation
member company who requested a list of the "core reviewers" for
official projects, optionally broken down by integrated vs. other.
I'm attempting to show that this data is already publicly available
and can be extracted/analyzed by anyone without needing to request
it.

Change-Id: I017d98e2a45d5082fce8f4eecb5e6f8633c02ac8
2015-05-16 11:15:19 +00:00
Monty Taylor
dc611ac010 Add SQL file for emergency rollback
It's a generated SQL file - but golly let's have some eyes on it for
real.

Change-Id: I887bc9117d82917be9ab10f121cc1c2d8411f433
2015-05-11 19:37:37 -04:00
Monty Taylor
3815c906d4 Add script to split the secret hieradata file
Although this only needs to be done once, it's ugly enough of a task
that it should have a script, and that script should be reviewed.

The script can be run locally on a machine without a hieradata and it
will create a local directory with all of the keys and none of the data.

It will also print out the total mapping and a report on which keys are
duplicated across hosts after group de-duplication is taken in to
account.

Change-Id: Id0af46abb8f4167bd91e95cd7a6cd2e35e5b0a94
2015-05-07 15:20:08 -04:00
Ian Wienand
11b08498da Split diskimage-builder built images out
This is the second part of splitting out log files for image builds;
putting diskimage-builder logs into separate files.  They are added
with a special "dib" provider to keep them grouped.

Change-Id: I6406f63df2f625beee57d7ff9707bd3b4f3fc060
2015-05-04 01:40:18 +00:00
Clark Boylan
797feda87a Allow blank lines in node{} with apply test
The apply test does some really simple string manipulation to generate
puppet manifests based on our site.pp on the fly. Unfortunately the old
code assumed there would be no blank lines within a node{} definition.
This assumption is breaking as we work to decouple the
openstack_project::server contents from within openstack_project
manifests and move that into site.pp.

This is a relatively simple fix where we csplit nodes based on the
previous /^}$/ which ends the last node{} definition instead of
splitting on blank lines. Added some comments to make what the parsing
does a bit more clear.

Change-Id: I2cc7317ed90423d6f923c4303a76e091a0bc2ebb
2015-04-23 11:34:10 -07:00
Ian Wienand
3bafd2c691 Generate nodepool logging configuration
Generate a logging configuration template for nodepool that splits
image-build logs out into separate files.

A tool to generate and maintain this file based on the nodepool
configuration is added.

The logging configuration template this tool creates is added
alongside the main configuration.  This is passed to the deployment
puppet module via a parameter.

Change-Id: I4723c68e5c83b536560e0a8bd7b73e312b46fc02
Depends-on: Iec77fb62c353d09186140b23912caf02225a643b
2015-03-19 10:32:24 +11:00
Jenkins
9b0090e431 Merge "Update email_stats.py for the big tent" 2015-02-12 18:10:41 +00:00
Jenkins
ca37048c3f Merge "Revert "Puppet apply test creates puppet directory env"" 2015-02-11 00:45:08 +00:00
Jeremy Stanley
85f6bb9db8 Update email_stats.py for the big tent
Changes to the projects.yaml (nee programs.yaml) in the
openstack/governance repo to accommodate big tent terminology have
resulted in a need to similarly adjust the script interpreting it.
While at it, update the variable names within the script for
clarity.

Change-Id: Ie001901c33749aa41181a09e43576bf9d516b4e5
2015-02-11 00:05:12 +00:00
Jenkins
cef96469f1 Merge "Making the apply test easier to read" 2015-01-25 14:13:06 +00:00
Jeremy Stanley
35f642b68a Revert "Puppet apply test creates puppet directory env"
This reverts commit 3b563fb59e7dfb233d4d0a07117499ac04f4a6ce.

Do not approve until Ief6c8e9bf7d71ddc63dba484390124546f14b93a is
applied to new nodepool images.

Change-Id: Ia7422d4f8fe316cc37c1310def0e7a9e2f232d35
2014-12-12 19:09:31 +00:00
Jeremy Stanley
3b563fb59e Puppet apply test creates puppet directory env
Make /etc/puppet/environments/production/environment.conf so that
the apply test will find a default directory environment.

Change-Id: I062949d6c23545c40690edc39302095b0dec3c84
2014-12-12 16:08:02 +00:00
Spencer Krum
ed46e9303f Source modules.env from apply-test.sh
This causes apply-test.sh to get the list of puppet modules to do
integration test with from modules.env. Modules.env has been
refactored to have three lists of modules: Package modules(MODULES),
SOURCE_MODULES, and INTEGRATION_MODULES.

When PUPPET_INTEGRATION_TEST is not set, INTEGRATION_MODULES is
folded into SOURCE_MODULES.

In apply-test.sh, INTEGRATION_MODULES is sourced from modules.env
and some string/array manipulation is performed to pass each entry
to zuul-cloner.

Change-Id: I47302c5c7e8c41b985f16a05c4e9b8078ea867a3
2014-11-18 21:23:43 +00:00
Spencer Krum
ca76e0c8dd Making the apply test easier to read
--color=false remove ansi escapes
cping /etc/hiera.yaml /etc/puppet/hiera.yaml shuts up puppet
complaining that it doesn't have  hiera.yaml to read

Change-Id: Iea7222c66f2fcc1338bc7baffb572d1a1ab2ecd6
2014-11-17 07:49:52 +00:00
Ramy Asselin
1bf253f91b Split out jenkins module
Part of an effort to split most of puppet modules out of system-config:
http://specs.openstack.org/openstack-infra/infra-specs/specs/puppet-modules.html

Depends-On: https://review.openstack.org/#/c/131302/

Change-Id: I1f6588c46a53d83249de68be6c2b36ddb3c805cb
2014-11-13 13:26:44 -08:00
Mikhail S Medvedev
f27dc5fcd1 Split out kibana module
Part of an effort to split most of puppet modules out of system-config.

https://review.openstack.org/#/c/130619/ should land before this
commit can be merged.

Change-Id: I7720ad7d2b25816c63e971112a7a733bde52b7f3
2014-10-27 14:39:32 -05:00
Jenkins
5dba0f5637 Merge "Clean up bashate failures" 2014-10-20 18:35:44 +00:00
Anita Kuno
d616e1de6c Rename config => system-config in tools/
We are renaming openstack-infra/config to
openstack-infra/system-config. This patch addresses the one file
in the tools directory that needed editing.

Change-Id: Id078dc7031f833c6d1a58cddbcecf0666244c6a1
2014-10-17 15:04:52 -04:00
Jenkins
bb941b2026 Merge "Specify ATC contribution start/end in seconds" 2014-10-16 16:38:23 +00:00
Jenkins
2783a56a16 Merge "Allow a git ref to pin the governance repo" 2014-10-16 16:33:36 +00:00
Jenkins
4fbab1cd8c Merge "Ignore extra-atcs lines which look like comments" 2014-10-16 16:32:51 +00:00
Jenkins
6152ae07c6 Merge "Remove d-i-b tools" 2014-10-16 16:04:48 +00:00
Jenkins
f26d2847a8 Merge "Remove projects_alphabetized from tox.ini" 2014-10-07 23:23:32 +00:00
Jeremy Stanley
981ba7290d Specify ATC contribution start/end in seconds
Change-Id: Ic62b00782f1ef709ce6f7b14217d36f02e230d79
2014-10-05 19:10:05 +00:00