113 Commits

Author SHA1 Message Date
Paul Belanger
bbcbabf534
Add opensuse-422 non-voting job for bindep
Now that opensuse DIBs are online, add bindep coverage.

Change-Id: Ia5be0c2e2fc73516b5cb95b10dfc72052d184bda
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-05-24 18:50:49 -04:00
Paul Belanger
3af437c708
Add empty .npmignore file for periodic-package-stackviz-element
We actually want to publish the build folder in our tarball, this
allows jobs to use the final compiled output.

Change-Id: Ia39b9a03619ce8d8cc40fb852f99fb32e3c9a27c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-04-16 19:15:58 -04:00
Paul Belanger
584e613492
Add missing npm run build for stackviz periodic job
Now that tarballs are uploading properly, also include the build
folder. This is the last step before moving this job to the periodic
pipeline.

Change-Id: Ieed33195678d3ffaf30582a47aa5d27b9fee203f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-04-16 13:05:01 -04:00
Paul Belanger
b634523c63
Create periodic-package-stackviz-element job
This is an update to our existing experimental job. Naming based on
existing afs build job we have for centos-7 dibs.

Change-Id: Ic1e0607e87a9b9ccf9abdad77012bc29f758b9bd
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-04-16 10:33:33 -04:00
Jenkins
58bf568c73 Merge "Remove branch-git-prep" 2017-04-07 19:43:42 +00:00
Paul Belanger
04638105ae Remove ubuntu-precise jobs
Ubuntu Precise has served use well! However, it is now EOL. We only
used it for infra jobs so this will not affect any openstack projects.

Change-Id: I20d751bd6528d5c9a9d80f3418f93a1c30e83c68
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-04-07 13:41:07 -04:00
Andreas Jaeger
bb75639300 Remove branch-git-prep
Remove branch-git-prep, we can use zuul-cloner everywhere.

Rework zuul-git-branch-prep to follow the logic of
zuul-git-branch-prep-upper-constraints. Note that zuul-git-branch-prep was not
used prior to this patch.

Change occurences of branch-git-prep to zuul-git-branch-prep.

Change-Id: Id938a858a0ff1967b97293405ef41b9b281f407f
2017-04-07 07:45:11 +02:00
Andreas Jaeger
acf7572d10 s/gerrit-git-prep/zuul-git-prep/g
We do not need gerrit-git-prep anymore, zuul-git-prep works on all our
slaves and has the advantage of using zuul-cloner so that the local
cache is used and Depends-On works.

Remove gerrit-git-prep and use zuul-git-prep instead everywhere.

Change-Id: I2f106af58f78fceaf3c497fe43e6f5a002695645
2017-04-03 19:36:51 +02:00
Paul Belanger
2469a6595e Fix experimental gate-zuul-nodepool job
We incorrectly assumed zuul-cloner was creating a sub-directory of the
project. It actually clones into the working directory, as a result we
can use the bindep macro from JJB.

Change-Id: I383a2e91c9ee168111a5e63bf61744e55fbcf35c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-02-04 09:53:33 -05:00
Paul Belanger
f3d0cb38d0 Run bindep on zuul integration job
We currently don't run install-distro-packages.sh for our experimental
integration job for zuul. As a result, things added to bindep.txt are
not installed.

Change-Id: I19df83a5cabf8bd2c90a1dd54c8ff0e246b6c60b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-02-03 15:05:39 -05:00
James E. Blair
72ee112fcb Fix log path in gate-zuul-nodepool
We can't escape the workspace root.

Change-Id: I6699131212b5f94a8a1bf9362138c524bc8cba96
2017-01-25 13:42:44 -08:00
James E. Blair
1a258f41d5 Clone zuul into workspace in gate-zuul-nodepool
In order to use the run-tox macro, we need zuul to be in the
job workspace.

Change-Id: I59881626625b36d5f93a38277e8aa07cf2e27800
2017-01-24 16:37:10 -08:00
James E. Blair
e6c7bc63ed Update gate-zuul-nodepool
This runs the integration tests using the tox macro.  It renames
the test script to a setup script since we no longer expect it to
actually run the tests.

It also collects and publishes the nodepool logs.

Change-Id: I12143ac0841e5fc646448eae4171594579fa0086
2017-01-24 13:44:48 -08:00
Jenkins
45d26f75d1 Merge "Replace fedora-24 jobs with fedora-25" 2017-01-19 08:18:21 +00:00
James E. Blair
f4040774ce Add Zuul/Nodepool integration test job
This is an experimental job to test interaction between Nodepool
and Zuulv3.

Change-Id: I59ed8ba44b214c04fb410cbd3ad4648e6cb24425
2017-01-18 13:15:48 -08:00
Paul Belanger
6db5cd3c4f Replace fedora-24 jobs with fedora-25
The majority of these fedora jobs are non-voting. There is no issue
moving the ansible roles and windmill to fedora-25, as I can clean up
issues as they are found.

Change-Id: Ifc2a000858808438b394a1959d7e89700fb41f00
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-01-14 11:49:30 -05:00
Paul Belanger
b5fc544b21 Add fedora-25 to bindep / puppet apply jobs
Now that we have launched a fedora-25 node, we need to start gating on
it. Add fedora-25 to bindep and puppet apply to ensure things work as
expected for infra services.

Change-Id: I8142c3b4e5517f197b6fb47c8cc98f3759516a02
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-01-13 14:10:32 -05:00
Ian Wienand
0f6413ed08 Fedora 23 omnibus removal
Remove Fedora 23

 - scalpels appears to be abandonded, remove the experimental job

 - barbican-dogtag job is non-voting and unstable.  Switch it to F24
   (as an intermin, F25 should be online soon).  Fedora is our
   super-unstable cow-catcher job, I will try to get in contact and
   see if we can switch this to CentOS.  This was added with
   I77fa548e4bc96682808d3721bc5528e091871b6a

 - move infra jobs to f24

Change-Id: I6993bb070f9bccb5ccc2c1c065d3da8b7996f1bd
2016-12-16 09:52:16 +01:00
Emilien Macchi
870b6c2ef5 Implement Experimental Infra jobs for Puppet 4 testing
This is a first iteration of creating Puppet 4 jobs in experimental
pipeline for all openstack-infra/puppet-* and
openstack-infra/system-config projects.

The jobs will test syntax and puppet-apply.
Note, the logic to deploy puppet4 on puppet-apply jobs needs to be done.

Change-Id: I576a1e42a4bca78815418a385972fe805a660879
2016-12-14 08:42:39 -05:00
Andreas Jaeger
4a61bc67f5 Change job-suffix to suffix
We have now some rather long job-template names, shorten them with
replacing job-suffix with suffix.

Before this change we had 1500 usages of job-suffix and 700 of just
suffix. This change therefore unifies to one setting.

Note that this does not change any job names at all, they are unchanged,
it changes and shortens only the names of job-templates.

Change-Id: I514df039a848d9f6619bca3adc05dfb84a761fc9
2016-12-08 22:05:01 +01:00
Khai Do
d679cf6e01 rename 'tox' macro to 'run-tox'
JJB already has a tox module[1].  Defining a macro with the same name is
confusing and may cause problems when attempting to use this macro
elsewhere. Renaming it to something else should clear things up.

This is the warning from JJB:

$ jenkins-jobs test -o out ../project-config/jenkins/jobs
WARNING:jenkins_jobs.registry:You have a macro ('tox') defined for
'builder' component type that is masking an inbuilt definition

[1] http://docs.openstack.org/infra/jenkins-job-builder/builders.html#builders.tox

Change-Id: I6946229f6e94a5f4c10d6a5fc3b7049adeacacb1
2016-11-15 11:54:16 +01:00
Paul Belanger
b108893570 Switch experimental pep8 job to job-template
This gives other projects to ability to add their own experimental job
to test the upcoming pep8 changes.

Change-Id: Ie73fb8f05aeb8947f513b9b58ded00b520caee5e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-11-08 11:15:53 -05:00
Paul Belanger
ff90f78e07 Add experimental-zuul-pep8-ubuntu-xenial job
In an effort to make our bindep dependencies better, we want to
experiment having the pep8 jobs not use our wheel mirrors.  This
ensures that projects are able to be build properly if our wheel
mirror is down or a new python dependency is released by has not been
build by our wheel-build job.

This is patch will be reverted once we confirmed the job works as
expected.

Change-Id: I03be650963e8f0e5630ad658882b0ce6692c4b45
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-10-30 17:13:04 -04:00
James E. Blair
4bf14ffdf5 Stop running compare-xml jobs
This removes the compare-xml jobs from both the project-config
and the jenkins-job-builder projects.  The JJB configuration in
project-config is beginning to include custom JJB components
which are supported only in Zuul v2.5.

For the project-config directory, we install a custom JJB module
to support these extensions and run JJB to validate that we have
a good configuration.

It would be possible to do the same for changes to JJB, but
considering that we are beginning to use custom components while
pinning to a released version of JJB (rather than master), it
seems like the project-config corpus of jobs may be less relevant
now, so perhaps now is a good time to stop.

Change-Id: I7c96b866663ce497b566a20f55c4c715b13c3723
2016-09-27 14:49:13 -07:00
Paul Belanger
09defed4ad
Run bindep for gate-infra-puppet-apply-{node}
This give the ability to install missing OS packages that are needed
to run puppet apply.

Change-Id: I3958cf64080beedcdb5cb7a5b9851e58b52676c6
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-09-16 17:55:16 -04:00
K Jonathan Harker
6976d995d0 Fix puppet-apply and logstash-filter jobs
The cd at the end of the shared builder doesn't affect the following
builder steps. Instead the cd command should occur just before running
the test scripts.

Change-Id: I7ec116e717ee0816cd458d1cdf57cc09509a7531
2016-09-12 17:26:42 -07:00
K Jonathan Harker
01abc0d454 Add integration tests between system-config and logstash-filters
Since this test is very similar to the apply test, refactor some of the
apply test out into reusable steps and consume them in the new job
template.

Change-Id: Iec615e03a7c644b13fa8425e38a70ad12c473879
2016-09-12 14:50:42 -07:00
Paul Belanger
8d693d99dd
Add net-info to openstack-infra jobs
The net-info include extra details about the node that is running,
specifically is the age of our DIB image being launched.  At this info
to openstack-infra jobs so we don't have to look for it in outside
projects.

Change-Id: Ifc0d09f57bb9a10b0d4bb7f18febbc10678f9d60
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-08-07 17:08:47 -04:00
Paul Belanger
1d7399fea4
gate-project-config-layout should use ubuntu-trusty
This was incorrectly upgraded to ubuntu-xenial. We still need to run
this on ubuntu-trusty since zuul.o.o is running on ubuntu-trusty.

Change-Id: I3776d8e89b8394a6c862973d29b6efcd4c08a28c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-07-29 11:57:41 -04:00
Paul Belanger
6f7839ae38
Migrate infra jobs to ubuntu-xenial
This is part of our effort to replace ubuntu-trusty with
ubuntu-xenial.

Change-Id: I1ee7d507dca9879921af825c79d7224ea8859639
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-07-28 11:15:51 -04:00
Paul Belanger
862707dd78
Move gate-project-config-layout to ubuntu-trusty
Now that zuul.o.o is running trusty we should test the layout on
trusty.

Change-Id: Ifa1f8294c5a3fc8088129c4e6bc5d23ccbbdf284
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-07-28 11:12:45 -04:00
Paul Belanger
a18de5392a
Add test-results publisher to infra projects
We're currently trying to debug some job failures and need access to
the .tox/*/logs files.  To fix this, we now add test-results publisher
to all tox based infra jobs.

Change-Id: Id2ab952a7b1d34e659916bc38b41be48dd4e34f5
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-07-27 10:39:14 -04:00
Tony Breeds
3afb7a4d20 Remove the check tox env from irc-meetings
Initially we added 'check' as a second venv to run during the ical job.
The motivation here was to avoid using a second node to keep the impact low.

This was problematic as while the check was fine, some of the tools assume
that 'envlist' was in fact a single venv.

Also recently we started running pep8 as a second job with an additional
node.

With that in mind remove the check tox env from the job definition and
in irc-meetings we'll treat pep8 as a more generic linter environment

Change-Id: I7ddfa03606aa750308e2e8c6b9c77e9f226bead1
2016-07-26 13:23:22 -05:00
Joshua Hesketh
7a0b9e406d Update eavesdrop site name
More accurately these publishers are interested in pushing yaml2ical
information and specifically publish to /srv/yaml2ical on eavesdrop.o.o
rather than the wwwroot.

Change-Id: Ic87de4f3c39e19769144095eb809ee7561c117a5
Depends-On: I6262bb839449402c65c7f48a07d8776c1b44a295
2016-07-01 23:03:53 +10:00
Andreas Jaeger
e66ce9d5cd Merge gerrit jobs for project-config
Both gate-project-config-projects-yaml and gate-project-config-gerrit
test files in gerrit directory, both check ACLs a swell. Let's merge
those into one job since in most cases both need to be run anyway and
the name projects-yaml might be confused with
jenkins/jobs/projects.yaml.

Note that this one leaves the projects tox environment in so that
testing of this change passes.

Change-Id: I34324643c26d0bcf2d24ce1dc51250ad53f2d48f
2016-06-22 08:18:06 +02:00
Spencer Krum
ae7cb06b34 More typos in infra_spec_helper job definition
I shouldn't be allowed near a keyboard.

Change-Id: I8b9e320721da26eda59ced1eea0fe1560926c2a0
2016-06-21 14:45:50 -07:00
Spencer Krum
d558864ff4 Infra spec helper is in openstack-infra
Fixes a small error from cargo culting

Change-Id: I7a3529823fa39bd155c5905aa977c20b256b280d
2016-06-21 11:26:09 -07:00
Spencer Krum
70208f19e4 Add infra puppet gem dependency holder repo
This repo (actually a ruby gem) serves as one place to list puppet gem
dependencies. This avoids us having to make 60+ one line changes when we
need to bump or pin a gem.

No repo to import.

Change-Id: I2eaa81a06d061d4ef65a8b717961de446dce9c8a
Needed-By: I2dc35841b13b886753314a31adf0254590279451
2016-06-20 16:39:12 -07:00
Paul Belanger
322d7e5dfb
Ensure console-log is our last publisher
This is related to zuulv25, we make sure console-log is the last
publisher to ensure zuul-launcher logs are also uploaded.

Change-Id: I1616b97fad2b97fb9e977ec14543aab4bc673b58
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-06-16 18:32:16 -05:00
Paul Belanger
4b2fbeb1b1
Convert gate-project-config-layout to ubuntu-precise
We've successfully tested ubuntu-precise in the experimental queue,
lets update gate-project-config-layout to use it.

Change-Id: Ia0e7a6da07cde89f89f6ccca39312e73693c01a1
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-05-06 12:29:39 -04:00
Paul Belanger
f03b83352e
Add experimental-project-config-layout for ubuntu-precise
This is part of our effort to remove bare-precise from the gate.

Change-Id: Ib762bf4aed5d6f027bbef3a873c6a4ca8786ad58
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-05-05 18:48:50 -04:00
Paul Belanger
97f228f83d
Add experimental ubuntu-precise infra jobs
In an effort to replace bare-precise, lets add some experimental jobs
to bindep and system-config to test ubuntu-precise.

Change-Id: I45b8b194f73a832363d9f2310683de7f4fde5d79
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-05-05 13:03:10 -04:00
Jenkins
835c9f901c Merge "Migrate infra off devstack-centos7" 2016-04-22 21:22:42 +00:00
Clark Boylan
6da143d2cd Stop uploading to job logs to swift
We have some headroom on the logs filesystem and this allows us to go
back to more reliable methods of grabbing logs. Specifically we are not
required to have http access back to the jenkins master from every job
that runs into order to get the console logs then upload them to swift.

Change-Id: Ie8479c224b2fd3c3efca4e1bf4157656540eccff
2016-04-15 10:20:25 -07:00
Paul Belanger
5636304f23 Migrate infra off devstack-centos7
This should be the last patch to land in our effort to migrate from
devstack-centos7 to centos-7 dibs.

Change-Id: I1eec9a868ec967b464f9c8d2b99e49d7767944d9
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-04-08 10:52:39 -04:00
Jenkins
25ace381db Merge "Add experimental bindep-fallback job for ubuntu-xenial" 2016-04-01 14:20:18 +00:00
Paul Belanger
b717a3d31e Add experimental bindep-fallback job for ubuntu-xenial
Change-Id: I3056d987815fd7bbe3c9b15d70ca1e01873ddd1d
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-03-31 20:18:26 -04:00
Paul Belanger
3cd8383a5f Move periodic-package-afs-centos7 to centos-7
This is part of the effort to migration from devstack-centos7 to
centos-7 dibs.

Change-Id: Iac7d3fd2f7f33289605b9520b49b517d3e87383c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-03-31 23:15:42 +00:00
Paul Belanger
3ebb0a4e6d Add centos-7 to bindep-fallback
Prepare for the removal of devstack-centos7. We are also using
bindep-fallback.txt in dibs[1].

[1] http://nodepool.openstack.org/dib.centos-7.log

Change-Id: I0c30547a63d02fe34b1d3a3a1aa54fde7c2d143c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-03-31 10:17:14 -04:00
Andreas Jaeger
c95546523a Run bindep on project-config only if needed
Run the bindep fallback jobs on project-config only if the bindep
fallback list has changed.

We first have to duplicate the job so that we can limit the
project-config version of it.

Change-Id: I3a15946994b21850fd491b21190a50b7da415896
2016-03-29 10:16:05 +02:00