34617 Commits

Author SHA1 Message Date
Bernard Cafarelli
b6cdca2ba2
Update Grafana dashboards for stable Neutron releases
Update listed jobs to be close to master dashboard when relevant and add
some stable-specific jobs
Add master dashboard enhancements like TIMED_OUT count
Fix dashboards description formatting and content

Change-Id: I22cf934898dd357f5e96eb068d6eed6e2fa987ce
2020-04-10 10:51:18 +02:00
Sean McGinnis
e8f3efeb03
Add expression switch to job update sed statement
Local testing passed, but when run in the gate, script execution failed
on the sed expression not being preceded by '-e'.

Change-Id: I02545e1f976f220f197556bdfa6e6225d9bd8d36
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2020-04-08 17:03:16 -05:00
Sean McGinnis
ebee7e0d7c
Fix branch to series matching logic in job updates
Missed in Id58f439052b4ea6b092b87682576a746433dcc27 that the branch name
passed in when determining the next series name will be of the form
'stable/series', resulting in not finding the next name and job update
logic being skipped. This adjusts the branch name to properly match the
series name.

Change-Id: Ie4102ceb0d12b7d98919ddb89b8e17df1859fa6a
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2020-04-08 15:40:05 -05:00
Zuul
5e7bd5ba36 Merge "Add vexxhost/ansible-role-base-server" 2020-04-08 19:28:14 +00:00
Zuul
4a7f837f60 Merge "Add tooling to update python jobs on branch creation" 2020-04-08 14:19:44 +00:00
Jean-Philippe Evrard
6938731988
Add tooling to update python jobs on branch creation
Currently, we need to update jobs manually after a branch is
created.

When a project is branched, the master branch should then
be pointing to the new named python3 tests.

This should do it.

Change-Id: Id58f439052b4ea6b092b87682576a746433dcc27
2020-04-08 08:44:14 -05:00
okozachenko
9f1629f186 Add vexxhost/ansible-role-base-server
Change-Id: I67a034c9afc7c16797d89a569f46077b1eaba72c
2020-04-07 12:56:46 -07:00
Zuul
7eb30f7d66 Merge "Use ensure-* roles" 2020-04-07 16:23:56 +00:00
Mathieu Bultel
441cfe2e32 Add validations-common and validations-libs to pypi
Add publish to pypi for validations common and library

Change-Id: I91f3e9d430efe5670d9f6196fca34539ac7d54f7
2020-04-07 10:26:42 +02:00
Zuul
91c02e031d Merge "Retire repo_build and pip_install roles" 2020-04-07 08:07:06 +00:00
Andreas Jaeger
0aedb7733c Use ensure-* roles
The install- roles have been renamed to ensure-*, follow the rename.

Depends-On: https://review.opendev.org/716698/
Change-Id: I2522028e9091efdbe292529474de7cce2cf29039
2020-04-06 19:49:19 +02:00
Monty Taylor
b6d1e40c54 Blank out the dependencies for zone repos
The job runs dependent on some other infra playbooks, but when
it's just the zonefile changing, we don't need to update
system-config for base.

Change-Id: I59551be29d34246177a54193ff6502f555cdb773
2020-04-06 12:13:19 -05:00
Monty Taylor
f833debe09 Change zone file job file matchers
These are being triggered by the zones repos, not the system-config
repo, so the file matchers aren't right.

Change-Id: Ibdc3690c644bd505abc7aeccda89ad8db667391b
2020-04-06 12:09:02 -05:00
Monty Taylor
49ea0e7bf7 Use deploy pipeline for zone file updates
We switch to deploy from promote in system-config. Follow suit
here.

Change-Id: Iab0015352d208f069bc748d34db63ed61191cec5
2020-04-06 11:32:42 -05:00
Dmitriy Rabotyagov
b37825720a Retire repo_build and pip_install roles
As both repo_build and pip_install roles have been succesfully replaced
with python_venv_build role, we have no need in it's futher maintaining
and releasing them.

Needed-By: https://review.opendev.org/717717
Needed-By: https://review.opendev.org/716389
Change-Id: I3901963eab6845e302feb3d3bca5ee47697a5658
2020-04-06 14:48:45 +00:00
Zuul
e116c563cf Merge "Run service-nameserver playbook on zone file changes" 2020-04-06 14:37:57 +00:00
Clark Boylan
a8a41f162f Install gpg tooling on dib images
This is particularly important for debuntu where we need working gpg for
apt and a missing gpg-agent is fatal. We install it globally so that
consistent tooling is available across systems.

Note everyone but suse seems to have a gnupg2 package. Suse calls it
gpg2.

Change-Id: I6c56e85db501f2c9d7c648e614f1efbaadc213a2
2020-04-03 13:30:26 -07:00
Zuul
fa100f46f4 Merge "Add and use a deploy pipeline" 2020-04-03 19:51:13 +00:00
Zuul
ef8ceaf54d Merge "Update deps list for nodepool job" 2020-04-03 19:51:12 +00:00
Monty Taylor
7f878e6dbf Add and use a deploy pipeline
This is independent + change-merged. With files matchers, promote
is actually problematic because we'd elide sets of different
changes potentially missing triggers.

Use deploy pipeline for project-config deployments

These all have files matchers which makes using them in promote
problematic due to deduplication.

Change-Id: Ic77cdb2aab359b20b9c8b3a66ee031d24f7c95a0
2020-04-03 12:25:10 -05:00
Monty Taylor
a908d7c8e5 Update deps list for nodepool job
We don't need the whole dependency graph.

Change-Id: I0d41c8a404d5913443dcb715541fb6fcc5b92e03
2020-04-03 12:15:17 -05:00
Monty Taylor
b2db1c7768 Trigger nodepool run
The previous patch fixed the promote job for running nodepool
ansible. This should trigger it to run, which was skipped in the
previous patch.

Change-Id: I301750a91039311675fbb0c5fa2a76349f547b62
2020-04-03 11:26:14 -05:00
Monty Taylor
5f199f5bbe Add update-system-config to promote list for project-config
We need this for infra-prod-service-nodepool.

Change-Id: I2732bbecf21f0c61de12bfc53035cb219314f158
2020-04-03 11:10:23 -05:00
Zuul
51d619ade6 Merge "zuul-worker: remove python-apt & libselinux deps" 2020-04-03 16:03:32 +00:00
Zuul
c4cf12f1ae Merge "Trigger infra-prod-service-nodepool on nodepool changes" 2020-04-03 14:24:28 +00:00
Ian Wienand
8a1b382301 zuul-worker: remove python-apt & libselinux deps
These have been here since the initial commit
I0e76931fdb4ca0c7445b1e72dc348f0cf03eaee5 in 2016.

These have now bifurcated into python3 packages and are brought in
elsewhere; we don't need to additionally bring it in here.  At best we
duplicate the install, at worse we get it wrong
(I563896f1caa1a68781f10b27cd7d9cf2606aaa17).

libselinux is installed for all platforms by the redhat-common package
[1].  This element probably pre-dates that.

python[3]-apt is brought in by software-properties-common [2] for all
platforms, which will bring in the correct python[3] version.

[1] https://opendev.org/openstack/diskimage-builder/src/branch/master/diskimage_builder/elements/redhat-common/package-installs.yaml#L14
[2] https://opendev.org/openstack/diskimage-builder/src/branch/master/diskimage_builder/elements/base/pre-install.d/03-baseline-tools

Change-Id: Ie1ca9bda749e17cdd5269850c03feca100395f1f
2020-04-03 09:20:05 -05:00
Thierry Carrez
eef574707e release-approval pipeline: fix zuul-excluding regexp
The release-approval pipeline uses a username filter in the
comment-added trigger so that comments from 'zuul' username would
not trigger it. Unfortunately, the regexp also matched usernames
which contained a dot, like 'rico.lin'.

Fix the regexp so that it matches 'ttx', 'rico.lin', 'zuulfoo' and
'zuul.bar', but not 'zuul'.

See tests for the old and new regexp at:
http://paste.openstack.org/show/791583/

Change-Id: I6834f71b52570310735f202984af8f7f6ce701a1
2020-04-03 12:04:48 +02:00
Zuul
f2d3939433 Merge "Be clear that zone repos are owned by infra-core" 2020-04-03 08:44:51 +00:00
Zuul
9b3c57101e Merge "Add hourly periodic pipeline" 2020-04-03 08:44:50 +00:00
Monty Taylor
f860d5bde0 Add hourly periodic pipeline
Until we can trigger jobs when zuul publishes new images, we should
run a few of our infra-prod playbooks on an hourly cron to keep up
with changes.

Change-Id: I08525729ec30b5f565f1858a357591503dd2a215
2020-04-02 17:32:26 -05:00
Monty Taylor
c60521b840 Run service-nameserver playbook on zone file changes
We've got the keys in place, and the zone file repos are, for now,
owned by infra-root, so this should be safe.

Depends-On: https://review.opendev.org/716764
Change-Id: I050464cc4ad896342ffc9125d12af73058791438
2020-04-02 17:30:33 -05:00
Monty Taylor
5e49aacb60 Trigger infra-prod-service-nodepool on nodepool changes
When we change nodepool config files, we should roll them out.

Depends-On: https://review.opendev.org/716770
Change-Id: I01c7770d8dc310f5da8aa7ee349b58dd0b88d1e0
2020-04-02 17:30:15 -05:00
Zuul
58d5dcc9c8 Merge "Add Fedora 31 to launchers" 2020-04-02 22:15:12 +00:00
Zuul
90d4a5afe5 Merge "Replace incident channel with opendev-meeting" 2020-04-02 21:43:31 +00:00
Ian Wienand
378161469b Add Fedora 31 to launchers
Images are built and seem ready to go

Change-Id: I9677af7e15d8b6c561f9f2dc5ed968a6708dd93e
2020-04-03 08:34:52 +11:00
Monty Taylor
5038a9191f Be clear that zone repos are owned by infra-core
Until we have a better triggering story, this is purely an
infra-core repo.

Change-Id: I6eee810b524a45eb03901ca3d1add911182114c0
2020-04-02 15:56:23 -05:00
Ian Wienand
167b161b7e Add Fedora 31 to main config file
As a follow-on to I811aa3f796e3d1a3a17832bdc038853537f48497; fedora-31
is now built and working on nb04, images are uploaded.  Add it to the
main config file, but paused, so the launchers know about it.

Change-Id: I1688b4eb60e35e47d086a3be6c6476aa413497d7
2020-04-02 15:01:40 +11:00
Ian Wienand
0b6c46a064 Fedora 31 : remove pip-and-virtualenv
As part of [1] we are removing pip-and-virtualenv.  dib 2.35.0 merged
an accidental breakage for Fedora [2].  We might as well use this as
an opportunity to have this as a "bare" test platform; where we leave
configuration of pip/virtualenv up to jobs.  This will be alongside
the ubuntu-bionic-plain images (see
I85438baf5bb31790a56fe5b38327361f0a2398e9).

[1] https://docs.opendev.org/opendev/infra-specs/latest/specs/cleanup-test-node-python.html
[2] https://review.opendev.org/716795

Change-Id: I56a2495e9c768d744ac39073c42a5a1754612f70
2020-04-02 11:16:41 +11:00
Ian Wienand
539b1a3b6c zuul-worker element: use python3-libselinux for fedora
It seems Fedora 31 has completely remvoed python-libselinux, so this
now causes a build failure.

Change-Id: I563896f1caa1a68781f10b27cd7d9cf2606aaa17
2020-04-02 09:34:09 +11:00
Zuul
6d7d1e8674 Merge "Add Fedora 31 builds to nb04" 2020-04-01 21:22:57 +00:00
Clark Boylan
bcbc397a7a Revert "Add system-config and zuul to OpenDev tenant for jobs"
This reverts commit d7c3f55741de79111df3b8e2017049cfa5fb3804.

Change-Id: I2346fa7c33a1ad041cd6f476f114870f46a47034
2020-04-01 13:56:51 -07:00
Zuul
60ddbf5ae5 Merge "vexxhost: load base-jobs & project-config pipelines" 2020-04-01 15:57:13 +00:00
Mohammed Naser
e1dad6a292 vexxhost: load base-jobs & project-config pipelines
With the previous change, we stopped having pipeline configuration
loaded inside the vexxhost tenant, this restores the pipelines.

Change-Id: I8fa6160b4694b93434d269973f95de8ed3ccd180
2020-04-01 11:02:52 -04:00
Zuul
1d5160ec57 Merge "vexxhost: move base-jobs to config-project" 2020-04-01 14:31:25 +00:00
OpenStack Proposal Bot
37ee543582 Normalize projects.yaml
Change-Id: I222a148a30dc155f4a6fc442f9678c575aa79a67
2020-04-01 06:03:38 +00:00
Mohammed Naser
2545dfd73a vexxhost: move base-jobs to config-project
Inside the VEXXHOST tenant, we have a need to be able to use build
Docker images in many different places.  Therefore, we need the
ability to have secrets inside of a repository which other repos
can just use the jobs for, avoiding the need of encrypting the
Docker credentials for every single repository.

However, due to the current limitation in Zuul, it's not possible
to accomplish this without having a config-project, and by being
a config-project, that provides an elevated set of access.  As
an interim solution until Zuul has the ability to do this without
using a config-project, this change makes the project a config
project however changes the ACLs to include project-config-core.

The rationale was that I (mnaser) is already part of that group
and therefore this wouldn't be providing me any more access to
make changes to config projects.  This would be an interim solution
until we're able to do this natively with Zuul and the ACLs can
return to VEXXHOST.

In this change, we also move opendev/project-config to only load
jobs, secrets and nodesets and to avoid loading the project so we
don't end up reporting to changes to opendev/project-config.

Change-Id: I6baefcae3e23767aeeaa2d572b1a17fd2aa5ebe6
2020-03-31 22:53:02 -04:00
Monty Taylor
a311ab9274 Remove upstream from xstatic-dagre
Change-Id: I13f5456ad392e672abe1d42118acebd98a33c30c
2020-03-31 14:55:31 -05:00
Mohammed Naser
d1c645f6e6 vexxhost: add vexxhost/base-jobs
Change-Id: I278c31666a46193640d29121800470d9d79a5e5e
2020-03-31 13:53:51 -04:00
Zuul
8b9086c798 Merge "Add ability to push signed tags to tripleo-ipa" 2020-03-31 17:16:05 +00:00
Zuul
37d9af0187 Merge "Run manage-projects on gerrit related changes" 2020-03-31 16:56:12 +00:00