Commit Graph

73 Commits (36ac9fe878785856a49276970473f2bb0ce87f07)

Author SHA1 Message Date
Takashi Kajinami 5cadc6d36e Update the logic to use stable branch of puppet-ceph
... so that we don't need to update it when switching Ceph to a new
release.

Change-Id: Ic3f0ccfa5a423b3ec48fc7bd9f289e31813d1176
9 months ago
Takashi Kajinami f94e042df5 CentOS 9: Switch back to puppetlabs packages
CnetOS 9 packages were already released in the puppetlabs repo.

This removes the workaround to use RDO packages, which was earlier
added to run integration jobs on CentOS Stream 9 before the packages
were released[1].

[1] f384effdb4

Change-Id: I0b9529b6a4f1c4beefa72b6e32b586b1ac9bea73
11 months ago
Alfredo Moralejo f384effdb4 Add support for for CentOS Stream 9
CentOS has published the official mirror for CentOS Stream 9 [1]. In RDO,
we are working to get ready for it ASAP and we have the required repos
to run p-o-i on CS9 [2].

This patch is adding support to CS9 in p-o-i repo with the required
fixes. Also is adding integrations jobs for scenarios 0-4 and adding
them as non-voting. Note that we don't have promotion pipeline working
so i think it's better to not make it voting yet.

[1] http://mirror.stream.centos.org/9-stream/
[2] https://trunk.rdoproject.org/centos9-master/report.html

Change-Id: I9da46a6aaef3559b24d5a47fb0bde9ae1d09abdb
2 years ago
Joel Capitao ceb720bd8c Switch to Ceph Pacific from Octopus
As discussed in [1] we'll go along with Pacific with Xena
on CS8.

[1] https://review.rdoproject.org/r/c/rdo-infra/ansible-role-weirdo-puppet-openstack/+/35706

Change-Id: Iafbcd03b03adfb8597f5a7025dd84574a08b952f
2 years ago
yatinkarel ea8824c436 Remove epel-release using yum/dnf
With [1] epel-next-release added as weak dep
to epel-release, so now epel-release cannot
be removed alone due to below error, so let's
used dnf/yum for removal as that will clean
the deps too.

epel-release = 8-11.el8 is needed by (installed)
epel-next-release-8-11.el8.noarch

[1] https://koji.mbox.centos.org/koji/buildinfo?buildID=18210

Change-Id: I893d63bf9ffa4b960ab76a54d76af5c58ef428a7
2 years ago
yatinkarel c218b2d33f Ignore sealerts in CentOS 9 too
We already disable for CentOS8, let's do for CentOS9
too for same reasons.

Removed VERSION_ID check as both supported C8 and C9
need to be ignored, and same should be there for future
CentOS releases.

Change-Id: Ie84e91a7fed16cd727e8cd9c50066617a1cb23b7
2 years ago
Thomas Goirand 6ce74b546e Fix installing puppet in Debian.
This patch fixes the install of the puppet packages in Debian.

Change-Id: I5674333169c8d961dbe29fc2f93bf42635cc2748
2 years ago
Takashi Kajinami a13001fc36 Switch to Ceph Octopus from Nautilus
EOL of Nautilus is coming soon (2021-06-01) so let's switch to newer
version now.

Change-Id: Idd9e509e49827ce490819df762108afd50585153
2 years ago
Takashi Kajinami fe029254fd Ubuntu: Switch to Focal and Victoria
We already have OpenStack Victoria releae available in cloud archive
so let's switch our master tests to that latest version.
Since Victoria release is only available in Focal this change also
switch base Ubuntu version from Bionic to Focal.

Change-Id: Ie78b6ef1c3f09fbbc3bc584ac99d2a0acfc5d9d9
2 years ago
Zuul ad94a7f237 Merge "Retry sealert command on failure" 2 years ago
yatinkarel ec57a35931 Improve retry_cmd function to handle set -e
In run_tests.sh we use 'set -e' which makes
script fail as soon as error hit but we don't
want to fail in case of retries, this patch fixes it.

Change-Id: Ia33ff3dbb88317171143a43e5b1c674038187254
2 years ago
yatinkarel 425f454bdc Retry sealert command on failure
We randomly see issues while running sealert
in RDO puppet promotion pipeline, sealert fails with:-
"SELinux is disabled or we can't open a policy file"
As per logs selinux is enabled and selinuxfs is mounted
so seems it's some filesystem issue.

Locally was able to reproduce only with selinux disabled
or umount /sys/fs/selinux. Adding retries in hope to
fix these random failures.

Change-Id: Icb07742d328827a41132cdd6a6c2bcfa3cde11ec
2 years ago
yatinkarel 8d5b34c552 Add retries to module installation with r10k
Since the modules are git cloned when installed via r10k and
clones may fail due to some network glich, adding retries should
help in these cases.

We randomly hit failures during git clone in RDO promotion
jobs running on ci.centos.org, adding retries to r10k
installation to handle those random failures.

Added function 'retry_cmd' which can also be used
with other commands.

Change-Id: I5f3b94eaa5a65c76877363e9ca41684445c9cb12
2 years ago
Takashi Kajinami eda1d55cf3 CentOS: Install gpg keys from repository
... instead of maintaining copies in our own repo.

Change-Id: Ie965151027dba330fb867c6ef28a36132e755d91
2 years ago
Takashi Kajinami 3f3da39c68 CentOS: Install new gpg key for puppet packages
This change ensures that the new gpg key for puppet packages[1] are
install before installing puppet-agent, so that we can install any
package signed with the new gpg key.

[1] https://puppet.com/blog/updated-puppet-gpg-signing-key-2020-edition/

Closes-Bug: #1912871
Change-Id: I015770275192d9834e38593e249b472f56d7ccd4
2 years ago
yatinkarel cb96526867 Rely on ID/VERSION_ID to detect distro
REDHAT_SUPPORT_PRODUCT* are removed from recent
CentOS8.3 release[1], Let's use ID/VERSION_ID instead
which are available[2] and would serve our purpose.

[1] https://git.centos.org/rpms/centos-linux-release/c/2e3df0
[2] https://www.freedesktop.org/software/systemd/man/os-release.html

Change-Id: If14f4edad391fd9ee61851859ecdd3a51b97a215
3 years ago
Zuul 31b1026b56 Merge "Remove Puppet 4 repo fixes" 3 years ago
Tobias Urdin 3376fc2b63 Remove Puppet 4 repo fixes
These are no longer needed since we dont run Puppet 4.
Also fixes some hardcoded EL 7 values.

Change-Id: Ia8ad51db49004b0a9c2b60a3b1f5bd12e7f56138
3 years ago
Alfredo Moralejo 88e0f5e99e Fix puppetfile name in install_all
r10k commands where updated in [1], and file name in install_all was
wrongly changed to Puppetfile1 instead of Puppetfile.

[1] https://review.opendev.org/#/c/726568/

Change-Id: I5edda0bac10ead8c78cc96a4b259fe52b5cc93fc
3 years ago
Takashi Kajinami baecae0460 r10k: Replace removed env parameters by options
The environment parameters, PUPPETFILE_DIR and PUPPETFILE is no longer
valid in r10k command, so should be replaced by options, --moduledir
and --puppetfile[1].

[1] ea477d4729

Change-Id: I0d12f2c4efafc7a8a998d846814c94eb39927c26
3 years ago
Alfredo Moralejo d2b34d006b Move CentOS8 to standard Puppetfile and bump puppet-mysql
mariadb has been updated in RDO CentOS7 for Ussuri so we can bump
puppet-mysql and use the same Puppetfile for all cases, no more
exceptions for CentOS8 are needed.

Change-Id: I1c4204c5b9fb893a2209666894792938f72b7548
3 years ago
Emilien Macchi 70ac070db1 Invert the logic of Puppetfile
I98fc088cd87c1412544f9590ce7a925b413297e2 broke unit 5.5 for
puppet-tripleo and probably puppet-pacemaker, since it can't find the
Puppetfile by default anymore.

Change-Id: I43718a849d09653e6c352b581aef6bbbf372fc41
3 years ago
yatinkarel b44d0bdd5a Add CentOS8 support and jobs
- scenario001 and 004 will be running without ceph
  until ceph repos get available for CentOS8
- scenario003 will run not run with linuxbridge until next CentOS
  minor version as it has issues:-
    - https://bugzilla.redhat.com/show_bug.cgi?id=1720637
- Add Puppetfile_centos7 to have different puppet modules
  as compared to other distros. Currently only puppet-mysql
  needs to be kept pinned for centos7 as newere mariadb version
  is required to remove the pin, CentOS8 and ubuntu have required
  mariadb version so pin is removed. So automatic updates of puppet
  modules will not be applied for CentOS7 as those jobs are going to
  be removed in coming months.
- check for rdo_dlrn url existence only for RedHat distros.

Change-Id: I98fc088cd87c1412544f9590ce7a925b413297e2
3 years ago
Tobias Urdin fff72afe75 Remove zuul-cloner usage
Depends-On: https://review.opendev.org/#/c/667439/
Change-Id: I6e11c12ad73c89466aefbb926c111ed1d00784b8
4 years ago
ZhongShengping a8bf4ac2e8 Move to opendev
Change-Id: I467e86b132314d6bf5331ff44a254d38a84dfab0
4 years ago
Tobias Urdin 0ccadc01ed Add Ceph Nautilus support
Adds support to set the jobs to use Ceph
Nautilus when testing.

Change-Id: Ibf2b82435a0f9c29d363c67a973399228bfb90a3
4 years ago
Ian Wienand 6208fc4f3c Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: I34c2be045d56d99792fcc1533b67c2c8de1aedac
4 years ago
Tobias Urdin a5b22a67fe Use hiera v5 format
Use hiera version 5 instead of version 3 which is
deprecated and outputs a warning.

Change-Id: I26ee3329aa75109625476d6c355e82fed2c050e6
4 years ago
yatin 0c938590d2 Add support to all Scenarios to work with Fedora and RedHat > 7
Disable SSL as currently there are known issues in services
to work with python3 + SSL on Fedora.

Also fixed following:-
- watcher to work without SSL
- Handle source /etc/bashrc for users don't have .bashrc created
- Install python3-rbd in Fedora and RedHat > 7

Change-Id: I5b67f40ec3c687f5282c65e10b4a1ee1fe5528f3
4 years ago
Tobias Urdin 047ea125dd Add puppet core providers for puppet6
In puppet 6 they have moved out a lot of builtin
resources to their owns modules since they didn't
belong in the Puppet core however in deb/rpm packaging
they are still bundled in but not when installing from
gem.

So we must add them in here so that they are available
in our unit tests.

Change-Id: I7060191395eff9c1e3146cb10594a38bef113117
5 years ago
Tobias Urdin eace0d6b15 Add puppet6 testing
Add puppet6 testing and run all those on Ubuntu Bionic.
Change from Xenial to Bionic for all other default jobs.

Run libraries unit for 6.0 on Ubuntu Bionic.

Change-Id: I4d9f1d1b62acece9bc0b4ce7bd49d2093af8e5ee
5 years ago
yatin dc9ccd6a20 Ignore sealert notices for Fedora also
Don't fail on selalert notices with scenario-py3,
Fedora jobs are failing on that, so remove the
Fedora check.

Change-Id: I46dc06d3e8e005ff0e18a10d17a75ef9e1c9e23d
5 years ago
Tobias Urdin 2daefe49a8 Change Puppet repo for Bionic
Puppet 5 for Bionic is now released and we don't need
to run the nightly puppet5 builds anymore.

Change-Id: If91bd851f3f67813cc44064be01290b9bd617cbb
5 years ago
Tobias Urdin a696192bf2 Add Ubuntu 18.04 Bionic to CI
We now have support to Mimic and can select that version
and this patch fixes Puppet 5 for Bionic we can add it to CI.

When this is fixed the only thing left is to add beaker acceptance
testing for Bionic.

Bionic only has Puppet 5 and can currently only use Ceph Mimic.

Change-Id: I6f94e214a70f92278f1f3806471ef2f622a938c3
5 years ago
Cloud User edca617537 Add new scenario to test python3 services
Also modify provision manifest to skip provisioning
some services.
The new scenario will be used for testing py3 services
starting with keystone and glance.

Also update puppet-apache reference to the required commit,
this can be updated once a new tag is released with the commit.

Change-Id: I55558f35068457175e2ef508f9e5989151db4aa2
5 years ago
Tobias Urdin 1cafb2d4fc Fix select ceph version failing beaker tests
Change-Id: Ie4bd3c46882a1cd4ec2be8c6bb4850e17fe79905
5 years ago
Tobias Urdin eaacd3f841 Add support to select ceph version
We are closing in on adding Ceph Mimic support and
want to ensure we can select either Luminous or Mimic
for running our tests.

For example Ubuntu 18.04 must run Ceph Mimic because
Luminous is not available (yet), Debian doesn't have
Ceph Mimic packages so we must run Luminous there.

Depends-On: https://review.openstack.org/#/c/576247/
Change-Id: If84ecbf86f3ebde8e69a1a26759ad967d061725a
5 years ago
yatin e931cd247a Allow running poi scenarios on Fedora
Change-Id: I409c11f31d4b82ef9a3d6ba20e2dd045156d66a9
5 years ago
Tobias Urdin b5ca31399a Use latest puppet5 repos
This change makes sure the latest puppet5 version
is used when running integration jobs for puppet5.

The puppetlabs yum mirror is ready to be used and
has the proper packages and is mirrored, example:

* http://mirror.mtl01.inap.openstack.org/yum-puppetlabs/puppet5/

For the puppetlabs apt mirror the puppet5 pool is
needed before this will work. A patch has been fixed
for that here [1]. Therefore this change cannot be
merged until [1] is merged.

[1] https://review.openstack.org/#/c/565867/

Change-Id: I1a2716fdd4b960b12ff24303038bec5ea8fb80a3
5 years ago
Mohammed Naser a45fae3c03 Fix MANAGE_REPOS for Debian-based OS
Change-Id: Iab59f0e818f8c5be1beba200f6c475669ce6ba0b
5 years ago
Thomas Goirand ca8fd0d8b8 Add GPG-KEY-ceph
At first, I thought this would go in puppet-ceph, but in fact,
every compute node needs a librados dependency which is in the
Ceph repo. So at then end, all nodes need GPG-KEY-ceph, so it
is a good idea to install the repository key there.

Change-Id: Ia33718a8350a60c69ce9632eddb6156f9b43c745
5 years ago
Mohammed Naser f416da3a9a Drop unnecessary clean-ups for Puppet
Nodepool images no longer have Puppet in them anymore so there
is no point in removing files and packages which are not there
anymore in the first place.

Change-Id: Idb89512251ca9125fcb3f44768873d2cb76eb879
5 years ago
Thomas Goirand 7a25b04990 Fixed puppet repo & key in Debian
It appears that the puppetlabs Debian repository is set to always
install a repository for Xenial (instead of using lsb_release to
find the OS), and that the Puppetlabs repo GPG key is outdated. This
patch fixes that.

Change-Id: I35231cdf7503d129bb408bc5d29a2cfe95c4e08e
5 years ago
ZhongShengping f8d4883f52 Grep command error
Error[1] when executing grep command. add sudo for the grep commands
when it is currently enabled.

[1]:http://logs.openstack.org/63/554163/1/check/puppet-openstack-integration-4-scenario002-tempest-ubuntu-xenial/dd454e9/job-output.txt.gz#_2018-03-19_08_44_16_398090

Change-Id: I5e5e89a4d691fc3890fbc863caa1fc87e42e7d87
Closes-Bug: #1756832
5 years ago
Emilien Macchi 3c8f4ccd85 Revert "Remove r10k env vars with proper args"
It broke all unit tests jobs:
http://logs.openstack.org/98/535698/16/gate/puppet-openstack-unit-4.8-centos-7/bd7dedf/job-output.txt.gz#_2018-02-05_23_19_05_369251


This reverts commit 9f14f75ec6.

Change-Id: Ibcb2bb60a668d232371e4d87febad6d67b3302d8
5 years ago
Zuul b3bdcfa99d Merge "Remove r10k env vars with proper args" 5 years ago
Emilien Macchi 83e2127db8 Use mirrors to deploy Puppet from Puppetlabs
Change-Id: Ia832c1f8dd27bd1ec919f9156df38a67b4d51cc1
5 years ago
Tobias Urdin 9f14f75ec6 Remove r10k env vars with proper args
The PUPPETFILE and PUPPETFILE_DIR environment
variables are deprecated since several releases
and are superseeded by the --puppetfile and
--moduledir arguments. [0] [1]

This patch replaces all those occurences to future
proof it when the env vars are removed.

[0] http://logs.openstack.org/57/529657/2/check/puppet-openstack-integration-4-scenario004-tempest-ubuntu-xenial/ce6f987/job-output.txt.gz#_2017-12-21_22_52_53_499924
[1] https://github.com/puppetlabs/r10k/pull/479

Change-Id: I216fe01a13e46c90bbb1455df72b25daf899c9f0
6 years ago
Mohammed Naser bde052c8e4
Add Zuul V3 support for Puppet Jobs
This patch moves in the Puppet OpenStack integration
jobs as well as the module tests in-repo.

Depends-On: Ib96ee354cbf9c88f9265f5743a97b2d013addc70
Change-Id: Idd846c569a6e067125e130f189be9ae8ffba1646
6 years ago
Bogdan Dobrelya 885abd1ae0 Rework r10k verbose option
The command "r10k puppetfile install -v" fails with:
Unrecognized options: verbose.

Rework the command to be compatible with the r10k 1.1.4.

Closes-bug: #1707629

Change-Id: I05d888125284d2808fb248e52afc95ab2b948353
Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
6 years ago