1040 Commits

Author SHA1 Message Date
Tristan Cacqueray
211e92ec40 crio: add missing registries.conf
This change fixes recent cri-o test failure because of a missing
registries.conf file.

Change-Id: Ieb2efa0e097cc76dc9b67389e86c2646dfc0c00d
2020-02-14 22:22:18 +00:00
Zuul
cc4552bb04 Merge "fetch-output-openshift: initial role" 2020-02-07 16:01:35 +00:00
Zuul
cf898b26a1 Merge "Add event id to emit-job-header" 2020-02-07 13:17:33 +00:00
Simon Westphahl
dd0fa76cff Add event id to emit-job-header
This can aid in debugging a still running job.

Depends-On: https://review.opendev.org/#/c/706222/
Change-Id: Id6d52185b02447484bfc044b20f14088fbe26634
2020-02-06 13:43:06 +01:00
Zuul
d99dc2de67 Merge "Add CentOS8 High Availability repository" 2020-02-05 22:50:15 +00:00
Zuul
83627af4d5 Merge "Move index_links to correct task in generate_zuul_manifest" 2020-02-05 21:31:14 +00:00
James E. Blair
04daed7bc4 Move index_links to correct task in generate_zuul_manifest
This argument is intended for the generate role rather than the
artifact return.

Change-Id: Ie5af37e2f55faa758371327d508f0e255694edd7
2020-02-05 13:06:09 -08:00
Zuul
5a8b257115 Merge "Google logs: Link to index.html files" 2020-02-05 15:44:15 +00:00
Zuul
a568823027 Merge "Add index_links option to zuul manifest" 2020-02-05 15:40:09 +00:00
Zuul
965f68c5a1 Merge "Add upload-logs-gcs role" 2020-02-05 15:34:22 +00:00
James E. Blair
d34881b45a Google logs: Link to index.html files
When generating index.html files for uploading to Google Cloud
Storage, link directories to their index.html files because
(except in certain circumstances) Google does not automatically
serve index.html files at directory URLs.

Change-Id: Ie854de328057ed080c80df9328163da98014ea36
2020-02-05 15:21:37 +00:00
James E. Blair
2aa0dbcf29 Add index_links option to zuul manifest
This allows a deployer to indicate that they prefer the Zuul
dashboard to link to "dir/index.html" rather than just "/dir" when
displaying directory entries in the log browser.  This helps with
log storage systems which do not automatically serve index.html
files at directory urls.

Change-Id: I0444798c689667e51d8761a20b661f8a9b90323d
2020-02-05 07:19:20 -08:00
Alfredo Moralejo
5074bca828 Add CentOS8 High Availability repository
High Availability packages have been added as part of core CentOS
repositories in 8.1.

This patch add this repo and enables it as it provides corosync and
pacemaker based HA solution and some other packages required for it.

Change-Id: Idbddd81f251c1ade97892128e52f9214420bead7
2020-02-05 15:47:06 +01:00
Zuul
f2207abd50 Merge "Use unique loop vars to avoid conflicts" 2020-02-05 05:43:16 +00:00
Zuul
f759c1f92d Merge "upload-afs: rename to upload-afs-roots; add afs-upload-synchronize" 2020-02-04 21:56:05 +00:00
Clark Boylan
4ed66807a0 Use unique loop vars to avoid conflicts
We have to be careful about avoiding outer loop loop_var conflicts in
ansible. Because the zuul-jobs roles are meant to be reconsumed
elsewhere we should not use 'item' loopvars and instead set them to
something a bit more unique.

We use a zj_ prefix to try and be unique to this repo and document this
convention.

Change-Id: I20b9327a914890e9eafcb2b36dc8c23fb472bc8f
2020-02-04 12:23:36 -08:00
Mohammed Naser
45a3790d85 ensure-tox: save tox_executable fact
If we install our own local version of tox, we should set a fact
with the tox_executable so other tasks can leverage it.

Change-Id: If6895bbb898261e88c0e3083d21210209f79995f
2020-02-04 20:46:07 +01:00
James E. Blair
b8ce30f3cb Add upload-logs-gcs role
This uploads logs to Google Cloud Storage.  It is based on
upload-logs-swift.

Change-Id: I4d83c3f4eb7f186271302cbb6ebae6b1f280785b
2020-02-03 16:02:15 -08:00
Ian Wienand
cd258e5a1d upload-afs: rename to upload-afs-roots; add afs-upload-synchronize
The upload-afs role is actually fairly specialised for uploading docs
with its root-marker scheme.  As we're moving more parts of our
infrastructure to publish via AFS I think it's worth making this quite
explicit by renaming the upload-afs role to upload-afs-roots.  This
should be transparent as we call the renamed role, and once callers
have been migrated we can use the usual deprecation process.

Add a partner role, upload-afs-synchronize, which is more of a
straight copy with options to synchronize.  This will be suitable for
uploading tarball and release artifacts.  This is similar in concept
to the promotion job used by zuul [1], but in this case will be
focused on the extant publishing jobs in project-config which don't
currently use the artifact-reporting/promote process.

[1] https://opendev.org/opendev/base-jobs/src/branch/master/playbooks/artifacts/promote.yaml#L39

Change-Id: I493d8829e3fd98e84f1b8f0e776e7ba41abf16c2
Story: #2006598
Task: #38600
2020-02-04 07:41:00 +11:00
Zuul
7a1684fffb Merge "Update upload-afs README" 2020-02-02 23:41:27 +00:00
Clark Boylan
e323dc117b Don't use item in collect container logs loop
The default loop variable 'item' cannot be nested. Because roles like
collect-container-logs may be called from higher level loops that use
'item' we override the loop control var to a name that should be unique.

This should probably be done to all of the other roles in zuul-jobs too.

Change-Id: I2f647596dd40c662aa7447e3d3c8844a77c6b109
2020-02-01 14:24:16 -08:00
Zuul
a7c7d4fa16 Merge "Add a markdownlint job and role" 2020-01-31 17:05:16 +00:00
Andreas Jaeger
1237417ea3 Update upload-afs README
Explain the intention of this role and the details of .root-marker,
some of it is copied verbatim from the infra-specs repository design
document.

Change-Id: I6d9124c7eafadc4b53626ff2fef6be6399f61947
2020-01-31 08:33:38 +01:00
Tristan Cacqueray
67e2abda5b fetch-output-openshift: initial role
This change adds a new fetch-output-openshift role to be able to
fetch-output from pod.

Change-Id: I45d5115a10254432805a02a77e0ebb35d7fd2dd4
2020-01-30 20:00:14 +00:00
Andrii Ostapenko
fc27907b98 Fix periodic image build jobs
Don't try to create change tag if zuul.change is not defined that is the
case for periodic builds.

Change-Id: I5a7e02caf0f502e90e0477daeee868bf06dfbb5c
2020-01-28 14:19:30 -06:00
Clint Byrum
33580f22b0 Add a markdownlint job and role
This tool will ensure that your markdown files follow some best
practices.

Change-Id: I7bcc70443dbe5fa31e3cc1139d608834c00851b9
2020-01-27 12:23:24 +00:00
Zuul
be8308c7ac Merge "Update roles/prepare-workspace-openshift/README.rst" 2020-01-24 17:08:21 +00:00
Zuul
37b53a4d70 Merge "Return subunit test report as artifact" 2020-01-24 10:04:02 +00:00
Zuul
4facd5ddc7 Merge "fetch-tox-output: introduce zuul_use_fetch_output" 2020-01-24 08:36:57 +00:00
Zuul
5ea9bac2df Merge "Add prepare-workspace-openshift role" 2020-01-23 16:19:37 +00:00
Andreas Jaeger
9b655c8d5d Update roles/prepare-workspace-openshift/README.rst
Use a proper link to the referenced role and mention in the short
description that this is related to OpenShift.

While it might work with any Kubernetes, it uses an
openshift tool, oc.

Change-Id: Ia4fba00c8a3adec4dc26a2d32a21df8ff548a120
2020-01-23 17:09:03 +01:00
Andreas Jaeger
ba12fb98a0 Fix ansible-2.9 skipped problem
ansible-2.9 does not allow "|skipped" anymore, it needs "is skipped"
instead, fix the only usage.

See also Ic0c93f2ea896ead76922694e6150882d8a280daf and
Id6c62da8f8a94c270d8a5d5981683a9d8c4e7ad6.

Change-Id: I597c92d2f6dce31dab1ac4bf52bb534c8146b33b
2020-01-23 07:47:49 +01:00
Zuul
bf083b71fd Merge "Revert "Make ara-report role to zuul_return an artifact"" 2020-01-23 06:44:59 +00:00
Paul Belanger
0f0d9bd2e2 Revert "Make ara-report role to zuul_return an artifact"
This seems to introduce the following error with Ansible 2.9

 "The conditional check 'not ara_generated | skipped' failed. 
 The error was: template error while templating string: no filter named 'skipped'. 

This reverts commit 262c16b30583f634588f5a52bd7aab944687a8a4.

Change-Id: Id6c62da8f8a94c270d8a5d5981683a9d8c4e7ad6
2020-01-23 00:39:47 +00:00
Zuul
0ed3f04dd1 Merge "Make ara-report role to zuul_return an artifact" 2020-01-22 10:33:15 +00:00
Zuul
b37367637e Merge "ensure-tox: Output tox version" 2020-01-21 21:32:25 +00:00
Ian Wienand
9e5907f4cc ensure-tox: fix pipe race
The

 command -v pip pip3 | head -n1

introduced with Ie50928c9b782ea84db916bb1441567e1206ff466 has a very
subtle race; if "pip" and "pip3" exists and there are two lines
output, the "head -n1" will exit and depending on scheduling the
"command" might write to a broken pipe (this manifests as exit code
141).

Move this to a more explicit if statement.

Co-Authored-By: Jens Harbott <j.harbott@x-ion.de>
Change-Id: I80823a7bc6351925d6f0b20bdebca3eafef0b27d
2020-01-22 07:49:35 +11:00
David Shrewsbury
4538583b1a ensure-tox: Output tox version
This can be useful for debugging.

Change-Id: Ic5ffb46cf2f583cd6dd04289e55f40f8acd3d9bf
2020-01-21 15:00:05 -05:00
Andreas Jaeger
5eb4c257f5 fetch-sphinx: Exclude doctrees directory
The sphinx .doctrees directory is not needed for publishing. By default
sphinx puts it below html. Some projects add to sphinx-build a "-d"
option to put the content elsewhere and not publish it.

This change assures that a .doctrees directory below "html" will not put
stored as artifact and published later.

Statistics: In all of OpenDev, we have:
* 511 repos putting .doctrees elsewhere and thus not publishing it
* 631 repos  no caring and thus publishing .doctrees

The size of .doctrees directory is not neglectable: 2MB for
system-config, 14 MB for nova.

Change-Id: I63b581164aab84352d9e80278cf4a8d634ff28af
2020-01-21 08:32:26 +01:00
Tobias Henkel
3b0fa71dd2
Return subunit test report as artifact
When returning the subunit test result as an artifact it will be
directly linked on the build result page.

Change-Id: I1a83288ac0857333f87cd085b3e0243bd3b92fc2
2020-01-18 13:31:51 +01:00
Sorin Sbarnea
2410119ac9 ensure-tox: improve pip detection
Fixed issues failing to install tox on python3 only systems which have
only pip3 executable and not the pip one.

Needed-By: https://review.rdoproject.org/r/#/c/24584/
Change-Id: Ie50928c9b782ea84db916bb1441567e1206ff466
2020-01-16 21:06:07 +00:00
Zuul
fc9d36ffe4 Merge "Stop compressing files during intermediate steps part 2" 2020-01-15 16:48:02 +00:00
Tristan Cacqueray
56ee80234c fetch-tox-output: introduce zuul_use_fetch_output
This change enables using fetch-tox role along with
the fetch-output role. By default the role still synchronizes
artifacts back to the executor.

Change-Id: Iffe5ffc52ee4c765b2e23ab8b3235b6bc7c510d8
2020-01-13 21:13:55 +00:00
Zuul
33fc86060b Merge "Fix typo in helm role" 2020-01-11 08:45:30 +00:00
Zuul
5fb6ba9dfe Merge "helm-template: Add role to run 'helm template'" 2020-01-11 08:45:29 +00:00
Zuul
b864698116 Merge "collect-container-logs: add role" 2020-01-10 21:56:26 +00:00
James E. Blair
3748623564 Fix typo in helm role
s/go/helm.

Change-Id: I840fff4e556df4b99994830755daddbe54222bb2
2020-01-10 13:26:51 -08:00
Zuul
e5f39018e4 Merge "install-go: bump version to 1.13.5" 2020-01-10 17:42:50 +00:00
Mohammed Naser
8ae49163f3 helm-template: Add role to run 'helm template'
This role runs Helm template of a specific chart and then makes
sure that all resources become ready afterwards.

Change-Id: I62e160eac673d13bd1018b58fd36cae54e1482b4
2020-01-10 17:31:05 +00:00
Mohammed Naser
228033e78a collect-container-logs: add role
We use this in a few different places and it's really useful
to collect all the logs of all containers.

Change-Id: Idc46a47f444bf48cd040f4f9724f3a6ee8bc8f8e
2020-01-09 19:52:01 -05:00