Commit Graph

51 Commits

Author SHA1 Message Date
James E. Blair
ab4651936a Use serial manager for deploy pipeline
This will ensure that every item in a shared pipeline is run in
strict order.

Change-Id: I83a010e1549476ae29df67a1e914f6d9e74d9bc6
2020-05-15 10:37:59 -07:00
Monty Taylor
7f878e6dbf Add and use a deploy pipeline
This is independent + change-merged. With files matchers, promote
is actually problematic because we'd elide sets of different
changes potentially missing triggers.

Use deploy pipeline for project-config deployments

These all have files matchers which makes using them in promote
problematic due to deduplication.

Change-Id: Ic77cdb2aab359b20b9c8b3a66ee031d24f7c95a0
2020-04-03 12:25:10 -05:00
Thierry Carrez
eef574707e release-approval pipeline: fix zuul-excluding regexp
The release-approval pipeline uses a username filter in the
comment-added trigger so that comments from 'zuul' username would
not trigger it. Unfortunately, the regexp also matched usernames
which contained a dot, like 'rico.lin'.

Fix the regexp so that it matches 'ttx', 'rico.lin', 'zuulfoo' and
'zuul.bar', but not 'zuul'.

See tests for the old and new regexp at:
http://paste.openstack.org/show/791583/

Change-Id: I6834f71b52570310735f202984af8f7f6ce701a1
2020-04-03 12:04:48 +02:00
Monty Taylor
f860d5bde0 Add hourly periodic pipeline
Until we can trigger jobs when zuul publishes new images, we should
run a few of our infra-prod playbooks on an hourly cron to keep up
with changes.

Change-Id: I08525729ec30b5f565f1858a357591503dd2a215
2020-04-02 17:32:26 -05:00
James E. Blair
2d41f5376c Revert "Revert "Revert "Disable github reporting and re-add devel ansible job"""
We really are done (as I write this) with debugging this.  We were
unable to reproduce the error.

This reverts commit 4b53515189.

Change-Id: I0c210a830dba710c71e364834a98c098d78ae595
2020-03-25 15:02:38 -07:00
James E. Blair
4b53515189 Revert "Revert "Disable github reporting and re-add devel ansible job""
This reverts commit 9e9aeff0fc.

We were not done debugging.  In fact, we hadn't even started debugging,
so revert the revert of the job removal.  Here's the justification for
the original revert:

We had a job trigger that shouldn't have. Re-add the job so
we can debug why that happened. Because we're debugging, turn of
all github reporting.

Change-Id: Idb16bcf5b581e7dd411506eb69c2324e206f0511
2020-03-24 08:54:12 -07:00
Monty Taylor
9e9aeff0fc Revert "Disable github reporting and re-add devel ansible job"
We're done debugging now, re-revert the ansible job and
re-add reporting to github.

This reverts commit 5d674d3b4f.

Change-Id: I95edc2c0ae2a523dda59894c4a033ea1ee08845e
2020-03-24 09:31:51 -05:00
Monty Taylor
5d674d3b4f Disable github reporting and re-add devel ansible job
We had a job trigger that shouldn't have. Re-add the job so
we can debug why that happened. Because we're debugging, turn off
all github reporting.

Revert "Stop running against devel of ansible/ansible"

This reverts commit 594efcf712087db8a55c553bcb48e89fa638154.

Change-Id: I52ee1533fea0fcbf68eaee3a73c0e666a284f3c3
2020-03-24 09:25:00 -05:00
Andreas Jaeger
af3bcbebf8 Update third-party-check pipeline description
The pipeline is not OpenStack specific, update description.

Change-Id: I11844b2a926f38f8daec83b1bf6bd01485c0b2df
2020-03-21 16:48:53 +01:00
Andreas Jaeger
a494d238b0 Update infra-manual links
The infra-manual publishes now to docs.opendev.org, change links to it.

New location is: https://docs.opendev.org/opendev/infra-manual/latest/

Link specs.o.o contributors link to OpenStack Contributor Guide.

Change http to https for docs.o.o and specs.o.o everywhere.

Depends-On: https://review.opendev.org/713929
Needed-By: https://review.opendev.org/713930
Change-Id: I46bf9e9527941f2120de59fdbc355337f4c019c1
2020-03-21 09:29:14 +01:00
Sorin Sbarnea
de2d9be5e2 Add periodic-weekly pipeline
Adds a periodic pipeline which runs weekly in addition to the current
one that runs daily, which is too often for some jobs.

Change-Id: Ib1bd96a3ace6920479137f99cb0c581dccb13e3c
2020-03-11 18:24:59 +00:00
Thierry Carrez
d11e9ce9aa Do not post comments in release-approval pipeline
Since it rus on every (human) comment, the release-approval pipeline
can get pretty noisy. It's also not that critical to read (failure
generally meaning that you don't have the required +1s yet).

This change disables comment posting on success/failure in the pipeline.

Change-Id: I4808a84cd39a5a19ddad86b548ec18d8cadf7430
2020-02-07 10:39:49 +01:00
Thierry Carrez
7d6c978e70 Fix triggers for release-approval pipeline
The release-approval pipeline implemented a nice infinite loop as
it was triggered by all comment-added events, and Zuul is posting one
every time the job runs.

Add a regexp to exclude comment-added events from the 'zuul' user.

Also since patchset-created actually does not trigger comment-added,
it needs to be specified separately (in order to approve releases
proposed by the PTL themselves).

Change-Id: I0f8b8526adaa83876ff92a98500d35c70cc23174
2020-02-06 13:41:38 +01:00
Thierry Carrez
7e896b57eb Add release-approval pipeline
Define a release-approval pipeline to run the check-release-approval
job on every comment added to a release request, and set a
PTL-Approved label accordingly.

This may be considered a bit resource-intensive, however the
check-release-approval job is a fast python script that runs on
the executor, and only release requests shall go in this pipeline.
If this generates too much load, we could configure it to only run
when the comment posted contains a magic "signoff" keyword.

Another concern is that jobs other than check-release-approval would
be added to this pipeline. There does not seem to be a way in Zuul to
limit a pipeline to a specific job name or project.

Change-Id: Ieab04a4d6c02b216a59c12ec8599e7d91f4fffb1
2020-02-05 16:46:24 +01:00
Ian Wienand
6a874f6293 zuul: arm64 pipeline
ARM64 testing is of interest to a number of projects.  For example:

 https://review.opendev.org/662456 : kolla
 https://review.opendev.org/676111 : diskimage-builder
 https://review.opendev.org/690798 : system-config (mirror tests)

However, we have been hesitant to put these tests into the main check
queue because with only a small number of nodes available (8
currently) it may lead to long delays merging code.

While jobs could go in the on-demand experimental pipeline, this
doesn't quite reflect the status of the jobs and nodes which are
operational.

I think that a separate queue to allow these jobs to run
automatically, but asynchronously to the regular check queue is a good
option here.  This will be a step to build a strong track-record for
the jobs without affecting the main gate, which should hopefully lead
to more interest and potentially more resources.

Change-Id: I77aac13521049496d43758121788aa44f0ecc990
2019-12-12 10:23:04 +11:00
Clark Boylan
32fefdb294 Include ref info on stmp reporter subjects
Our old log urls had ref info in them which people were relying on to
determine what refs jobs reported via smtp ran against. With changes to
the zuul dashboard being the log location the links now only have a
build uuid and lack ref info.

Update the pipeline smtp reporter subject to include the change.ref
object which should give this info to users again.

Change-Id: If81710baa528be779762730e9593b32841ffcb56
2019-08-19 09:56:34 -07:00
Andreas Jaeger
9f18fc8846 Update promote pipeline precedence
Change I45cb34c29d86ca67e75604f6ac3b8af6758f6242 updated the priorities
of pipelines so that they become progressively higher, this change
is not reflected in promote pipeline. Promote pipeline
should have the same priority as the post pipeline, thus update it and
change promote to high precedence.

Change-Id: Ia921f0e191c0526be9a102629304034b68054d98
2019-05-30 19:14:51 +02:00
James E. Blair
a387cbdc9e Also report promote results to gerrit
These are in a change context, and so can report back to gerrit.

Change-Id: I4545e8e2cdf8e6e83ce08e535da68541c0efb71e
2019-01-11 13:19:36 -08:00
Clark Boylan
22d98f7aab Revert "Reduce gate window floor to 10"
This reverts commit 24221d2c0b.

This hasn't had a noticeable impact on the check queue backlog. It is
still floating around 2 ish hours. We may as well go back to larger gate
windows in an attempt to merge more code.

Change-Id: I1b8b90ce371e66cbde63f0f7a62b9aebe0401835
2018-10-16 14:47:51 -07:00
Clark Boylan
24221d2c0b Reduce gate window floor to 10
Both the tripleo gate and the openstack integrated gate are incredibly
flaky and they use up a good deal of test nodes. To mitigate the impact
of this on the check queue and for people not working on either set of
queues reduce the window floor to 10 from 20.

Change-Id: I05aa65a132c272ad6bf60e44c82e0dd24b53bb8b
2018-10-15 13:44:48 -07:00
Clark Boylan
1610b48f34 Add link to gating docs from gate pipeline description
There is confusion around why jobs that have already passed are
restarted after a gate reset. There has also been some confusion around
jobs not starting for inactive changes outside of the gate window.
Attempt to address some of this by explicitly linking the gating docs
for zuul from the gate pipeline description which will show up in the
Zuul Status page UI.

Change-Id: Id2451c813f5e5ea6595a3375f83ae9b49ca8dcd2
2018-10-10 10:01:18 -07:00
Doug Hellmann
221c5293b9 make pipeline precedence progressively higher
This patch changes the precedence settings for pipelines so that they
become progressively higher. Under high load, this is expected to have
the effect of prioritizing jobs needed to "finish" one patch
completely over jobs related to patches that are not as far along in
the approval process, which should prevent the post and gate pipeline
queues from backing up at the expense of making the check pipeline
queues deeper.

Change-Id: I45cb34c29d86ca67e75604f6ac3b8af6758f6242
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2018-09-28 12:33:23 -04:00
Jeremy Stanley
00336ec5ab There are no core developers, only core reviewers
We've insisted in the past that "core developers" aren't a thing, so
if we want to avoid continued propagation of that terminology then
we should do our best to avoid using it in Zuul pipeline
descriptions.

Change-Id: Ifbebf824716e4a4d1bab4eb194a8b6e8b4fedd5f
2018-06-28 15:51:36 +00:00
James E. Blair
1d752622f1 Use supercedent manager in post
Update the post (and promote) pipelines to use the supercedent
pipeline manager.  This will cause only the latest versions of
artifacts to be published, rather than having multiple jobs
racing.

https://zuul-ci.org/docs/zuul/user/config.html#value-pipeline.manager.supercedent

Change-Id: I2db1024b67d40ea3203f3636a61fe2ae7e09ff46
2018-06-26 14:52:34 -07:00
James E. Blair
d2c26a6a87 Add promote pipeline
This is for a demonstration of how we could promote some artifacts
directly from the gate pipeline without generating them in post.

Change-Id: Id60b5e292b5750d701ec77b51ff73f12becf3cbd
2018-05-03 07:39:10 -07:00
Eric Fried
148074807c Document 'post' job names
Some may consider it confusing that most jobs on zuul.openstack.org are
named after their review numbers, but `post` jobs aren't.  This change
adds words to the description of the post queue indicating that jobs are
named after the abbreviated version of the commit hash of the merge.

Change-Id: I8a304b302d13468f6cbb73edadf60c6667ec32e3
2018-02-13 07:01:57 +01:00
Monty Taylor
8311aebbfc
Report zuul failures on github PRs to MySQL
We're not storing failure in the DB. Whoops.

Change-Id: I4a1ee301948951f1e6d10d24e7e8e6378840da1f
2018-02-01 15:58:17 -06:00
Paul Belanger
23db32daa4
Remove tripleo pipelines from zuul
With the shutdown of tripleo-test-cloud-rh1 we no longer have any jobs
that use these pipelines. Jobs that did run, have been moved to 3rd
party CI. Hardware and cloud are also lacking maintenance and soon to
be removed.

Change-Id: I28111b0287b23370fa137a8d0d5731e013889260
Depends-On: https://review.openstack.org/536461/
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-01-31 10:17:00 -05:00
Monty Taylor
8b3bdf74af
Add third-party-check pipeline
Currently merge failure reporting is pipeline global. That means we wind
up reporting  merge failures on ALL changes to third-party github
repos, even if the change is touching files we would not otherwise
normally test.

Add a new pipeline for external projects that does not report merge
failures.

Change-Id: I5a65cf9babdf37b385e321f350752124c3e1de1e
2018-01-30 12:34:07 -06:00
David Moreau Simard
b46891a7e2
Add SQL reporter to Zuul experiemental and tripleo pipelines
The Zuul MySQL database is one of the only ways we can get fairly
precise historical metrics for the jobs that run in all the pipelines.

However, we're missing a significant amount of data right now by
leaving out the experiemental, check-tripleo and
check-tripleo-experimental pipelines.

Let's start recording those so we can make informed decisions with
numbers easily in the future.

Change-Id: I0daeff1f6c6d4527cbd17f55c2df242e1ecb8b33
2018-01-17 13:50:49 -05:00
Jeremy Stanley
7a7c4eebe0 No longer consider "jenkins" votes when enqueuing
Our Gerrit no longer has any "jenkins" account verified votes on
open changes, so there is no reason to consider it in our pipeline
configuration. Remove the reference and simplify configuration.

Change-Id: I80bc50c4dc6c41c732051e57c78230a18c3673af
2017-12-18 13:36:14 +00:00
Paul Belanger
7290396045
Delete infra-check pipeline
This is no longer used anywhere, lets delete it.

Change-Id: I965ea859de43fb4d4bd4b682b56a67167c170af7
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-11-21 10:04:17 -05:00
Clint Byrum
7690da11b7 Only run checks on open patches
We don't want 'recheck' comments to trigger checks on merged patches.

Change-Id: I0b4a56e86563fd47a7a147aa920dcd147ca3548e
2017-11-02 11:01:00 -07:00
Zuul
120a324fda Merge "Remove duplicate post-review key in pipelines" 2017-10-25 19:11:59 +00:00
Paul Belanger
fa94cf76cc
Remove duplicate post-review key in pipelines
Change-Id: Ieda0d233748df5dd52bf139eb17b20b12f021ddb
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-10-25 14:32:20 -04:00
Ian Wienand
d4cc58d067 Add success message for check pipeline
The hideci scripts are looking for this message to show the summary
boxes.

Change-Id: Idf616165e3c2bcd3d505761dfb3e2530d29060b6
2017-10-25 11:26:26 +11:00
Andreas Jaeger
8e1d64aee8
Remove infra specific pipelines and enable pipelines
Remove infra-gate and infra-post; remove infra-check everywhere except
for project-config so that we can quickly iterate on it.

Enable the pipelines for all projects.

Move infra-check pipeline after check to have those related pipelines
displayed together.

This partially reverts I084b819ea0a4b67f36df61ccb3bfd6963cc3940d and
reverts Ieced5db4bb8a29eb494dffce3bed030a528f46a1 and
I5646ab81eb1a6515b32c42a2c3c4e64a94be4748.

Depends-On: I738f7c48b8f47e05c95de645a2d3403363204737
Depends-On: I48b14f2d26972cc06ab2293885b37b61c687e83b
Depends-On: Ib325a20839db3fe7884564db2a877ff4edb920e2
Change-Id: I8ed5d777f077b4ebda42c57a5871f38bd1762f88
2017-10-15 17:46:43 -05:00
Monty Taylor
2d62791fb7
Re-enable zuul v3 pipelines
This will allow them to subsequently be used.

Change-Id: I2a32898c22e26f0b03303d7aca65fe528ae9db5d
2017-10-15 17:25:32 -05:00
Zuul
9552703c6e Merge "Mark publish-openstack-artifacts and pipelines as post-review" 2017-10-15 14:22:45 +00:00
Andreas Jaeger
2dedde9072 Re-enable v3 pipelines
Enable check-tripleo, periodic and check pipelines again for normal
jobs.

This reverts the following commits:
I7734b9f691f039182d68563b46c8b529c39f32c7 "Disable trigger for v3
check-tripleo pipeline"
I13f772618b4e93591ed233a69296e5f51eb88414 "Similarly to disabling check,
disable periodic"
I4c7f14c8dd5bc054704f02451b2d40919ce69416 "Disable zuulv3 check
pipeline"

Change-Id: I8427ac7c4f9629141162849ec8815c8b5d43f05f
2017-10-13 16:59:06 +02:00
Monty Taylor
671a945409
Mark publish-openstack-artifacts and pipelines as post-review
We do not want to allow this job or its children to run without
code-review having happened. Mark it, and the non-speculative pipelines,
as post-review.

Change-Id: I8c8a936798f86283bb4e262164641857b2d6edec
2017-10-13 07:47:17 -05:00
James E. Blair
81f4f4349e Disable trigger for v3 check-tripleo pipeline
We're trying to reduce v3 job counts while we stabilize the log
server.

Change-Id: I7734b9f691f039182d68563b46c8b529c39f32c7
2017-10-12 10:48:10 -07:00
Clark Boylan
643292ac75 Similarly to disabling check, disable periodic
We need to get job log filesystem inode consumption under control so
stop running these periodic jobs on zuulv3.

Change-Id: I13f772618b4e93591ed233a69296e5f51eb88414
2017-10-12 10:03:11 -07:00
Clark Boylan
b4069c305a Disable zuulv3 check pipeline
In an effort to get inode consumption under control on the job logs
filesystem stop running check jobs in both v2 and v3. We will only run
in v2 for now.

Change-Id: I4c7f14c8dd5bc054704f02451b2d40919ce69416
2017-10-12 09:51:09 -07:00
Andreas Jaeger
46557d13a0 Only allow zuul user for infra-gate
Do not allow a single +1 by jenkins to start the gate process, we should
require a +1 by zuul only.

Change-Id: I0808d27c139609cfce42f1e9d794cac94bb55cb5
2017-10-06 16:42:09 +02:00
Monty Taylor
c05fded21e
Add mysql reporter to the other pipelines
We're not collecting mysql reporter information for pipelines other than
check and gate ... but post and tag and friends are actually super
important for collecting the data.

Change-Id: I198bcbf57a6020d24c476070e42a9b0dd3abf32d
2017-10-03 10:48:52 -05:00
Monty Taylor
f8c18eb702
Prevent non-check changes, add infra pipelines
Change the pipeline config to include invalid requirements for all
non-check pipelines so that we can keep project-pipeline configs but not
have any changes be enqueued in them. This should allow running v2 and
v3 side by side.

Add infra- versions of gate and post so that we can continue to use v3
to gate zuul, zuul-jobs, openstack-zuul-jobs and project-config.

Change-Id: I084b819ea0a4b67f36df61ccb3bfd6963cc3940d
2017-10-03 10:13:54 -05:00
James E. Blair
a0019c4302 Disable merge-check pipeline
* It uses merger resources, and Gerrit shows up merge conflicts now.
* It performs speculative configuration on changes with config
  updates, which is expensive.
* In some cases, it can race with reconfigurations to report false
  failures on config changes.

Change-Id: Ic5bbc60e6a0aa19799a903fd5ada7bbe3846bf90
2017-09-28 17:47:32 -07:00
Clark Boylan
b3a97aa6d2 Fix Verified and Workflow label case in pipelines
This is case sensitive now, we need to make sure we use the correct case
on these.

Change-Id: Icf662e3415486126dbdc46bfc12ed87133ec4450
2017-09-27 17:29:32 -07:00
James E. Blair
45f5a7c80a Zuul v3: honor previous votes from jenkins
Change-Id: Ie0c0f8ffa9c5415e9ec2c77ec4768de822e8a9f9
2017-09-25 12:38:10 -07:00