2373 Commits

Author SHA1 Message Date
Szymon Datko
ced6cd132f Add support for RPM packages
This commit extends the installation of Python interpreter
from system packages to also support RPM packages (assuming
the playbook is run in an environment with proper repositories).

Also the obsolete note about supporting only Debian distribution
is removed, as the `ensure-python` role already supports other
platforms (via pyenv and stow).

Change-Id: Id6ef8ec3537952348e0a7b233bd26b57613da327
2022-01-18 16:00:22 +01:00
Clark Boylan
88c1c731e6 Remove centos-8 testing
CentOS 8 EOL'd at the end of 2021. OpenDev is beginning the process of
removing the image and starting with some job cleanups like the job
cleanups in this change. Users can use CentOS 8 Stream or some other
RHEL alike.

Change-Id: I9dab417b28a0503e1409e70953ed275f2c6f8c30
2022-01-11 12:52:08 -08:00
Clark Boylan
9d51ae5ea8 Update ansible-lint pin to fix rich dep
Older ansible-lint didn't pin the 'rich' dep and that dep updated and
broke ansible-lint. Newer ansible-lint fixed this. Update ansible-lint
to get around this problem.

Change-Id: Ic798398ab68239d4f13cb806a92038fd4946d25a
2022-01-10 11:44:21 -08:00
James E. Blair
90c427d630 Switch docs theme to RTD
To match change I2870450ffd02f55509fcc1297d050b09deafbfb9 in Zuul.

This does not use the versioning feature due to the nature of this repo.

This also corrects a reference which is now an error.

Change-Id: Ia1d31df932b447f11bc588925de9974d4f6dfc7d
2021-12-16 06:48:49 -08:00
Sagi Shnaidman
9a29f54cea Print version of installed podman
Change-Id: Ic3a5d43b726d638d22a9916f128bbcded1b8065a
2021-12-11 11:21:27 +00:00
Zuul
eb8106a155 Merge "Add fips version of jobs needed for OpenStack" 2021-12-10 15:40:09 +00:00
Clark Boylan
0206d6671a Try to fix broken stestr command discovery
When processing subunit streams we attempt to discover where the
(s)testr commands are located. For some reason the output of our scripts
that do this very occasionally emit a newline before the command path.
When this happens we were using the blank line as the command path which
fails as that empty command results in our command arguments being
interpreted as the command path.

Attempt to address this by trimming the stdout instead of taking the
first line. This should remove the leading and trailing newlines and
give us only the command itself.

Change-Id: Id651e019cf3d0b7ab37fdf9df04be249ea7f7af6
2021-12-08 10:51:55 -08:00
Clark Boylan
c697816786 Remove tumbleweed jobs
OpenDev doesn't currently have an image built for tumblweed. Rather than
try and fix this image up and get it running again OpenDev has proposed
it simply be removed. In preparation for that and to avoid running jobs
for a system that doesn't currently have an image we remove the jobs
here.

It was hoped that tumbleweed would be a good forward looking platform
but it seems to need a lot more care than we are able to give it.
Additionally Zuul is probably the major consumer of the platform and it
doesn't see much consumption by other projects.

Change-Id: Iad351b6da1f08183bc4c49c049c303a9491af844
2021-12-08 10:00:06 -08:00
Zuul
538abe9ac4 Merge "ensure-dstat-graph: clone from opendev" 2021-12-07 20:54:39 +00:00
Ian Wienand
7493032793 ensure-dstat-graph: clone from opendev
We have integrated these changes into a new opendev.org managed
repository.

Change-Id: Ie163ae95efe572e60a5b8b6444ecc7a35011ece8
2021-12-07 13:04:11 +11:00
Ian Wienand
219afd0227 Update Fedora 34 to 35
Change-Id: I84f9e052f488217f8a63791556de99469451a1d9
2021-11-22 10:32:59 +11:00
Zuul
0b4bb29b5a Merge "Revert "Add no_log to the log uploading module parameters"" 2021-11-16 19:18:20 +00:00
Artem Goncharov
2f1951c23c Revert "Add no_log to the log uploading module parameters"
This reverts commit 10ee6ebf016fa00c9eb8cd15a09832982b08fe48.

Reason for revert: log url get broken

Change-Id: Ifb8db77c2534a92bbb19fde1bfbf31562ed04daf
2021-11-16 19:06:33 +00:00
Zuul
88e8bf4b2e Merge "Add no_log to the log uploading module parameters" 2021-11-16 16:45:20 +00:00
Zuul
6ff50fb0d4 Merge "Fix zuul-jobs-test-upload-logs-s3 job" 2021-11-16 16:34:48 +00:00
Artem Goncharov
10ee6ebf01 Add no_log to the log uploading module parameters
Use no_log parameter for potentially sensitive log uploading modules

Change-Id: I6264f1b028db0e4f1f74ae557847c146c00295da
2021-11-16 16:29:31 +00:00
Artem Goncharov
e7d7575eaf Fix zuul-jobs-test-upload-logs-s3 job
Since the security update we are not able to modify
zuul.executor.log_root variable in the role testing.
Replace this with explicit log folder creation on the test node.

Change-Id: Ie6cff6f9e9c5594167ddda6cd345f9c3d9f2f470
2021-11-16 16:20:33 +00:00
Andre Aranha
cac1875575 Add fips version of jobs needed for OpenStack
FIPS needs to be enabled before test-setup is run, as enabling
FIPS requires the node to be rebooted, test-setup needs to run and
setup the environment after the reboot.

Change-Id: I6fecb9c6e917d1a36b2b82c1b02098eed4323ac7
2021-11-05 14:17:26 +00:00
Gonéri Le Bouder
3cba437a15
enable-fips: Fedora also support FIPS
Fedora supports FIPS. There is no version check because the feature is
available on all the supported Fedora releases.

Change-Id: I924fb565a4d70e7c93a215e9e0a5b2b80bced52a
2021-10-28 15:20:59 -04:00
Gonéri Le Bouder
72581dcaac
use-buildset-registry: remove useless import
The module was not used and Python does not provide any `test` module since
py39.

Change-Id: Ia69a632bd4fff05da644c58d557912bc877a8135
2021-10-28 12:48:06 -04:00
Zuul
0bfa518718 Merge "ensure-dstat-graph: pull updated branch" 2021-10-25 23:31:59 +00:00
Zuul
9ff0c50c6e Merge "ensure-zookeeper: eliminate the tmpfs size limit" 2021-10-24 23:14:42 +00:00
Zuul
89bf334822 Merge "Update dstat to support bionic and others" 2021-10-24 23:01:36 +00:00
James E. Blair
5a83a49dac ensure-zookeeper: eliminate the tmpfs size limit
Zuul's use of this role has exceeded the 500M cap.  Let's go ahead
and remove it since it's arbitrary anyway, and Zuul is likely the
primary user of the role.

Change-Id: Ib0bc72f6c909e44bc04af7a8fbe40ef8415addcf
2021-10-22 15:32:03 -07:00
James E. Blair
aeeb946ebf Update dstat to support bionic and others
Change-Id: Ida88ebbc6c169878adbb8e4f06da05eac813a04b
2021-10-22 12:51:41 -07:00
Zuul
d453753fe6 Merge "ensure-rust: verify cryptography build on Ubuntu" 2021-10-22 16:13:06 +00:00
Zuul
24aea0f5c5 Merge "ensure-docker: remove Debian Stretch testing" 2021-10-22 15:19:12 +00:00
Ian Wienand
94d7d42f14 ensure-dstat-graph: pull updated branch
This updated branch fixes a few issues and should ensure display with
pcp-dstat (I9234b226242f145db9c235797649202aa530ec74)

Add an override so we pull it

Change-Id: I0d5e1b567c364a9e6c7aa0b95de17abffaef0434
2021-10-22 18:31:10 +11:00
James E. Blair
61d00fec6f Use pcp instead of dstand and return dstat graph artifact
Dstat is dead, but pcp supplies a compatible interface.

Installation can be unreliable, so let's ignore failures since
this isn't generally critical.

Change-Id: I9234b226242f145db9c235797649202aa530ec74
2021-10-21 15:39:54 -07:00
Zuul
bd60fbd744 Merge "Add FIPS enable multinode job definition" 2021-10-20 23:54:04 +00:00
Zuul
984147663c Merge "build-python-release: Add flag for whether to build a wheel or not" 2021-10-20 20:32:00 +00:00
Douglas Viroel
9107f3ee7d Add FIPS enable multinode job definition
This patch adds a new multinode job definition that enables
FIPS mode prior to multinode configuration.
In order to enable FIPS mode, the OS boot procedure need to be
changed to enable the appropriate kernel flag. This modification
has effect only after system reboot.
The default behavior of this job is to always enable FIPS mode.

Change-Id: I6f1365837d9ed2ba82c391a20f9094c9ef0e6c4e
Signed-off-by: Douglas Viroel <dviroel@redhat.com>
2021-10-20 11:20:52 -03:00
Zuul
e3519ce469 Merge "multi-node-bridge: repos to install ovs in C9" 2021-10-20 12:45:36 +00:00
Sandeep Yadav
a795073493 multi-node-bridge: repos to install ovs in C9
With this patch, Adding repos to install openvswitch
in Centos9 stream.

For Centos9 stream nodes we need to enable 2 repos:-
* nfv repo - Ussuri+ openvswitch is shipped as part of NFV SIG
* rdo xena repo - rdo-openvswitch(which provides openvswitch wrapper)
is available in OpenStack repo

Closes-Bug: #1947665
Change-Id: If5a32b30637296a070f2e75ba8feb6aa45d8ecac
2021-10-20 11:17:41 +05:30
Ian Wienand
a3f3458566 ensure-docker: remove Debian Stretch testing
Remove Debian Stretch testing in preparation for node removal

Change-Id: I072d931f21a8a4eefacf75eb25dd717cbd7db7fd
2021-10-20 14:54:26 +11:00
Ian Wienand
db23e0af70 ensure-podman: support Debian bullseye
The package is included in the latest stable, Debian bullseye.  Add an
install match, and test it.

Change-Id: I62d2582e8adf2bedb2ea7d41b4b22a48c9b2f274
2021-10-15 11:38:58 +11:00
Ian Wienand
72d4e506d5 intermediate-registry: handle socat warning out
Zuul switched to a new base image, and it seems the new socat puts out
a warning (something like

 ...  socat[489590] W ioctl(5, IOCTL_VM_SOCKETS_GET_LOCAL_CID, ...): Inappropriate ioctl for device

for reference).

Grep the output so we only get the line about what port it is
listening on.

Change-Id: I74fb86a9158b45e6601ee1fbc199ba80cd4991fe
2021-10-14 16:04:46 +11:00
Bhagyashri Shewale
84b86437c5 Handled TypeError while installing any sibling python packages
The below error is coming on mol-centos7 jobs while
installing sibling for python2 packeges on centos7

Error: TypeError: initial_value must be unicode or None, not str

This patch handled the TypeError while installing sibling
for python packeges for centos7.

Closes-Bug: #1946641
Change-Id: Ie8058cca92d099e50af19b95b4c417c5a665da0d
2021-10-13 12:52:03 +05:30
Gonéri Le Bouder
ad56b0b4eb
build-container-image: improve the reliabilty
build-container-image may ends up pushing large files. Network is not
always as reliable as we want. This commit ensures we retry several
times in case of failure.

Change-Id: Ieaf92a8c3531e24ab5e41783b540de1df806c02f
2021-10-08 11:38:11 -04:00
Zuul
d5e4d55c15 Merge "ensure-rust: rework global install" 2021-10-08 01:40:58 +00:00
Zuul
08e37ff140 Merge "Revert "Revert "Include tox_extra_args in tox siblings tasks""" 2021-10-06 17:31:10 +00:00
Zuul
bbf4c1bbaa Merge "ensure-twine: Avoid Reinstalling twine if present" 2021-10-04 20:58:04 +00:00
Zuul
ec6b89b0d4 Merge "ensure-tox: Avoid Reinstalling tox venv if present" 2021-10-04 20:48:06 +00:00
Ian Wienand
5cd0182aac ensure-rust: verify cryptography build on Ubuntu
Just for sanity, ensure the cryptography build (that uses rust) works.

Change-Id: I2fc9dc1fd0f19191af1535dd660d2a5376139764
2021-10-04 13:44:19 +11:00
Ian Wienand
67ae84ce39 ensure-rust: rework global install
I think the secondary "rustup default" was intended to make sure the
Zuul user sets up to use the installed rust toolchain
(I32f9b285904a7036f9a80ada8a49fa9cf31b5163) but actually results in a
re-download of components and another local installation.  This isn't
really the intention, and also doubles the time spent installing.

From the linked comment, it seems like we're not doing our global
install correctly; even putting it in /usr doesn't avoid the need for
RUST_HOME to be set.  Take it's suggestion and install out-of-the-way
in /opt, use a small /usr/local/bin wrapper to call with correct env
vars set and then setup the installed global binary names to be called
via that.

Change-Id: I28ef747b809a17664305bfd9754022251390647b
2021-10-04 11:43:22 +11:00
Jeremy Stanley
c02c28a982 Revert "Revert "Include tox_extra_args in tox siblings tasks""
This reverts commit 3668acc723d5b54cdaf789842a3c6e236bb6adb7.

Change-Id: I643b82c7dc6fd78ff67678b56c639a6c45fd0061
2021-10-01 16:03:13 +00:00
Jeremy Stanley
1861faf567 More exact section matching for tox showconfig
With the original verbose output support in change
Iafeb88eaf9a596603ad4d2134a4574345d5189ab we looked for lines from
tox --showconfig output starting with an opening '[' but verbosity
also causes output from pip install activity to be included if a
tox.requires entry causes it to install packages before continuing
and these lines are prefixed by a process ID number wrapped in
brackets with the command string after that, which prematurely
triggered our search for the start of the INI content. Add a
stipulation that the first INI output line also end in ']' in order
to skip over those additional prepended lines.

Change-Id: If29e5a9abe3b92a145d87f5efc1b93350ea3908a
2021-10-01 16:03:12 +00:00
Jeremy Stanley
31a470245b Test tox.requires doesn't break sibling installs
Update the alternate tox.ini files in test-playbooks/python to
trigger configuration we saw expose a bug in the siblings lib's
showconfig parser when a tox.requires value resulted in pip
activity. Update its minversion to the earliest tox which provides
the tox.requires configuration option, for clarity.

While we're there, switch to using tox_config_file instead of
overriding zuul_work_dir since that's now an option for this role
and was previously not exercised in the test job.

Change-Id: I521580da978903cd116c872447b1c028c470e63d
2021-10-01 12:46:14 +00:00
Jeremy Stanley
3668acc723 Revert "Include tox_extra_args in tox siblings tasks"
This reverts commit 8b1cc73ee30428517f9524624b9eb309e9b14c1f.

Apparently tox.requires adds lines like this to verbose showconfig
output:

    using tox-3.24.4 from /.../tox/__init__.py (pid 2919)

Which is confusing the current parser in the siblings module. Roll
this back while we work on a fix and regression test.

Change-Id: If3b1d48b36a5d32fddfdabd9c0ec1b81dd6453f2
2021-09-30 17:54:17 +00:00
Zuul
7fcb90c59d Merge "Deprecate EOL Python releases and OS versions" 2021-09-30 17:33:30 +00:00