12 Commits

Author SHA1 Message Date
Jeremy Stanley
3d8b647a70 Run most non-sensitive jobs on single-use workers
* doc/source/jjb.rst
* doc/source/stackforge.rst: Update examples to recommend
bare-precise nodes in new job configuration.

* modules/openstack_project/files/jenkins_job_builder/config/*.yaml:
Change the node label for all jobs opreviously using precise to use
bare-precise instead.

* modules/openstack_project/files/zuul/layout.yaml: Get rid of the
transitional matches for setting the single use parameter function
on specific job names and just set it on everything as a default.
Add patterns for jobs which need long-running slaves to apply a
reusable node parameter function instead.

* modules/openstack_project/files/zuul/openstack_functions.py: Add a
parameter function for reusable nodes which refrains from enabling
auto-offline behavior.

* modules/openstack_project/templates/nodepool/nodepool.yaml.erb:
Double the minimum ready bare-precise nodes to accommodate
additional load.

Change-Id: I2a90c5b120a50bb8033c891702185f054ee84d35
2014-02-18 17:50:49 +00:00
Monty Taylor
38f8d43ffc Fix pep8 errors in modules dir
There weren't that many of them - just fix them.

Change-Id: I6aa6d056746c4a6804146b89c12e6313f9d22d9a
2013-11-12 11:30:34 -05:00
James E. Blair
7d899af6b7 Revert "Use rackspace for tempest check tests"
This reverts commit 92b938735a281d3755fa472c9a5afd01b4e8191b
2013-09-27 16:42:02 +00:00
Monty Taylor
92b938735a Use rackspace for tempest check tests
* modules/openstack_project/files/zuul/openstack_functions.py: Update
single use function to select rackspace for tempest check tests.

Change-Id: I9f930dbddb2284e6c5a9672f454456b98953967a
2013-09-27 08:15:56 -07:00
James E. Blair
545f7f8572 Make all devstack-vm jobs single-use
Use the new gearman-plugin single-use feature with all 'devstack-vm'
jobs.  This is compatible with the current devstack-gate scripts,
though once this is in place, they can be updated so that they no
longer perform relabel operations.

This is also compatible with future devstack-gate nodepool operations.

Change-Id: I6fcadb47ba5eeead3d11926019b3c041305c95f7
2013-08-13 09:44:28 -07:00
James E. Blair
246df358a2 Support periodic jobs in log custom function
Change-Id: Ice4db15fd16e0eea886ddc5f793d49693a0a9986
2013-08-01 15:57:06 -07:00
James E. Blair
0ccf564937 Switch Zuul/JJB to use LOG_PATH
This calculates the full LOG_PATH in the Zuul config and pases it
to Jenkins.  The new path is similar to the old but with the
substitution of a short ZUUL_UUID at the end instead of the Jenkins
build number in order to avoid collisions from multiple Jenkins
masters.

Periodic jobs add a node name to their log path to avoid collisions
from multiple masters.  Unfortunately, that value is not accessible
to the logstash worker.  This can be solved by having Zuul trigger
periodic jobs.

Add the ZUUL_REF to logstash as "build_ref".

Requires https://review.openstack.org/#/c/39130/

Change-Id: I40bad59e3ad8ed6b4706762ed8b833fd15c13b0d
2013-07-29 17:47:08 -07:00
James E. Blair
f7f2760fe0 Set the Zuul/Jenkins base log URL in a function
And use that when constructing log paths and URLs.  Use a substr
of the change id or commit sha when constructing URLs so the log
directories are deeper.

Make copying the test results a macro (it's used in several places).

Update the gearman log client to take advantage of the new parameter.

Requires https://review.openstack.org/#/c/36304/

Change-Id: I64faa35eddc4105271efa3de4f83b608b77655c2
2013-07-19 10:36:31 -07:00
James E. Blair
feb4714b0c Remove diablo/essex branches.
Those branches are closed, so remove all special configuration:

 * ACLs
 * Bitrot jobs
 * Manuals jobs (which weren't actually being triggered anyway)
 * Zuul branch configuration
 * Zuul job functions.

But leave the now-unused openstack_functions.py file in place
so that it is easy to add in a custom Zuul parameter function
in the future.

Change-Id: Ib0732753543aff0b1de5880fbe8aadc4f8616835
Reviewed-on: https://review.openstack.org/28323
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-06 21:47:16 +00:00
James E. Blair
7306065d3c Fix mirror build jobs.
The job name matched the python27 functions regex, but as a post job,
it has no change/branch object.  Make the function safe for post jobs.

Configure them to also be triggerable by zuul (the timer still works
because all zuul variables are ignored).

Configure them to not run concurrently (there's only one matching
executor so it shouldn't be a problem, but be explicit) since they
share an output location.

Change-Id: I210da46bac1a8fa5ac9a931f07f189b3734b2ab0
Reviewed-on: https://review.openstack.org/25646
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-03-28 19:57:52 +00:00
James E. Blair
856ca2b2e8 Use oneiric for stable/diablo.
For all python27 jobs, use oneiric slaves if the branch is
stable/diablo.  Python26 jobs are already on oneiric due to
lack of python 2.6 on anything later.

Change-Id: Id440e14721ccdd4225c5e5b170510c3c000a36b3
2012-08-02 13:04:00 -07:00
Monty Taylor
3776f952dc Move OpenStack classes to openstack_project module
Change-Id: Iafcd2e06c5b62e4cde5eccaab3173a20bb08a78d
2012-07-23 10:31:58 -05:00