Since virtualenv 20.0 (amongst other changes) six version >1.12.0 is required.
This change adds upgrade of virtualenv and six in pre - to be reverted once
infra CentOS images are sorted out.
Depends-On: https://review.opendev.org/707377
Change-Id: I75249055989309d0afdfc29c894beb6b1fcd1994
Currently we use CentOS 8 nodepool images for all CI build jobs. This
means we can't use the ansible_distribution_major_version fact to detect
whether we are building CentOS 7 or 8 images. Due to this, all CentOS
images (including CentOS 7) are currently published with a
'master-centos8' tag.
This change fixes the issue by using the base_tag variable which is
defined for CentOS 8 build jobs.
Change-Id: I29b7b8ee742120107a11bd419ac58ab5c09b0b75
Partially-Implements: blueprint centos-rhel-8
On CentOS, ansible_distribution is 'CentOS' rather than 'centos'.
Our logic when setting the image tag for publisher jobs is incorrect,
meaning that the centos8 publisher publishes images as 'master'
rather than 'master-centos8'. Since this job only has two images it
is likely to complete before the CentOS 7 publisher, so hopefully
images will not be broken for long.
This change fixes the issue by using a case-insensitive comparison.
Change-Id: I66c93e07fe5c6c143e9cf65c6451e573bbfc51d8
Partially-Implements: blueprint centos-rhel-8
* Some further changes for python2 vs python3 packages
* Allow rabbitmq 3.7.*, since a newer erlang is available
* Switch from qemu-img-ev to qemu-img on CentOS 8
* bridge-utils no longer available on CentOS 8
* libvirt-daemon-driver-lxc no longer available on CentOS 8
* Mark some more images buildable for CentOS 8
Change-Id: Iaf5b68ff6d944ae730ca0b1d5832172c106a6c08
Partially-Implements: blueprint centos-rhel-8
Partially-Implements: blueprint centos-rhel-python-3
Stop renaming files. Swift should be able to serve text/plain files
based on content, not extension.
Failed logs symlinks were broken because we stopped gzipping log
files and improperly rewrote the logic there.
Change-Id: Idddf51730821644948f51577807f5beaa18c6262
This reverts commit ca4da16836.
This is adapted to revert only the missed part of
aarch64 publisher which now blocks publishing for debian.
Change-Id: I02932857454bdb09b72f539038d394760457109d
Turned out that linaro-london network pipe is too thin
to support this job. Pushing images took 3 hours so job
timed out.
Will check it once new nodes arrive.
This reverts commit f2801fabdd.
Change-Id: I8897ede43f11090902fe7c0c096f17f57c1c9c67
We should allow the tag set in kolla-build.conf to be used for the image
tags, since our deploy jobs need to set it to change_XXXXXXX when images
are built for the job.
Change-Id: I705514ee0249ff1d309e280001d653271e3686af
Partially-Implements: blueprint centos-rhel-8
So far we built 'base' image using upstream mirrors and then replaced
them with OpenStack infra ones. Let do that right after we copy own
APT sources.list file.
Change-Id: Icb745f628c1c50d9f20df022b08ddc46fccc270c
This time proper approach involves job dependencies.
First we build and publish x86-64 and aarch64 images with architecture
name in image tag. Then we create multiarch manifests to create 'master'
images.
Change-Id: I6b9505dc326636fc6df8798c62c3a5eb1f728a51
Follow up to I5b5f323471676317a2898875cbbf297082328fcc. Logs are no
longer gzipped, so we do not need to modify the 000_FAILED_* symlinks.
Change-Id: I5df42ac0ff91b1b97537a4fbc33fc7970f29d60e
Adds support to the base and openstack-base images for CentOS 8.
These images have been removed from the list of unbuildable images, and
replaced with all dependent images.
Change-Id: I18fba8a5c2f99b700990cbf41c76077a1ec2408a
Partially-Implements: blueprint centos-rhel-8
Adds build and publishing jobs for CentOS 8 images:
- kolla-build-centos8-binary
- kolla-build-centos8-source
- kolla-publish-centos8-binary
- kolla-publish-centos8-source
The 'base' image has been added to the list of unbuildable images for
CentOS 8 (now separate from the list for CentOS 7). This means that no
images will be built - the jobs should essentially be a 'noop'.
Change-Id: Ie9a0109bd4eef337358d714e4b5088b8e3de2f23
Partially-Implements: blueprint centos-rhel-8
AArch64 is getting popular and not all changes working on x86-64 work
properly on aarch64 architecture. Let check them.
Job is running in separate pipeline due to low number of aarch64 nodes.
Authored-By: Xinliang Liu <xinliang.liu@linaro.org>
Co-Authored-By: Jeffrey Zhang <zhang.lei.fly@gmail.com>
Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
Implements: blueprint aarch64-3rd-party-ci-kolla
Depends-On: https://review.opendev.org/#/c/698606
Change-Id: I7e7802dfa4f4d9c61d01dba4b77c01cfb24301c0
This change modifies the CentOS build CI jobs to use a CentOS 8 host
image.
NOTE: This does not affect the version of CentOS used as the base image
in containers built by kolla.
Partially-Implements: blueprint centos-rhel-8
Partially-Implements: blueprint centos-rhel-python3
Change-Id: Ie25b54a4e6116ed2bcb9c3b5c44eb6edbd2e6b49
Since https://review.opendev.org/#/c/682600/, the following lines result
in /var/yum/cache being present in one of the layers of the base image:
RUN {{ macros.install_packages(base_centos_yum_repo_packages |
customizable("centos_yum_repo_packages"), chain=True,
clean=False) }} \
{% for repo in base_centos_yum_repos_to_disable |
customizable('centos_yum_repos_to_disable') -%}
&& yum-config-manager --disable {{ repo }} \
{% endfor -%}
{% for key in base_centos_yum_repo_keys |
customizable('centos_yum_repo_keys') -%}
&& rpm --import {{ key }} \
{% endfor -%}
&& /bin/true
{% block base_centos_repo_overrides_post_yum %}{% endblock %}
RUN {{ macros.rpm_security_update(clean_package_cache) }}
This is because it is not cleaned in the first RUN statement. This adds
76MB to the image. Also, using two separate RUNs which results in an
extra 23MB due to updates to /var/lib/rpm/Packages.
Found via https://github.com/wagoodman/dive.
Change-Id: I0302ee1dfc10a2b7df127ac6a7764a84b1d74a33
Closes-Bug: #1850036
This profile has not been used since Kolla Ansible was separated.
Also removes the relevant "tests".
Change-Id: I29dbcea169a6e338bc9a8fb4fcde7a77c1d6fac6
TODO: Debian build still requires access to original repo.
Change-Id: Ie4bac5334369a63793d36568a9d3a58a0cdc7667
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
This makes mirrored repos used as soon as they are installed
in the image, instead of hitting upstreams.
This patch also adds crmsh override.
Usable only after infra change merges.
Depends-on: https://review.opendev.org/682576
Change-Id: Ic7494eff4c740b6e528da4508dc88a64e697bc04
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
XtraBackup started failing to install on Ubuntu and does not support
MariaDB 10.3 version.
Related-Bug: #1843043
Change-Id: I9cf62c8e03a02574d85e5349df1d23a51d4c99be
We have a list of images which are unbuildable for distro/buildtype/arch
combos. This patch renames it from SKIPPED_IMAGES to UNBUILDABLE_IMAGES
because 'skipped' images is something else in our code.
Now all unbuildable images are marked as such and so are their children.
At the end of build there is information provided about skipped images
(due to --skip-parents or --skip-existing options) and then information
about not buildable images. Both list should only contain entries
related to requested build.
Change-Id: If9b521339f564e483cba03d52e7c4eba271821a5
- unify RDO mirror definition with others
- drop definitions of unused mirrors: grafana, elastic
- clean up the process of mirror substitution:
- use the more common style of sed d command
- apply more specific substitutions
Change-Id: Idad2c6956cca647d4c865d6f6149ea37164db568
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
Oracle Linux is no longer tested via CI after [1].
This patch removes OL support from Zuul files.
[1] https://review.opendev.org/664217
Change-Id: I527aba3635ef82e2d2a88ee7f5250bf03e420800
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
If stestr failed, then no node info was logged.
Logging node info is now handled in pre and post stages of Zuul.
Additionally Zuul v3 migration recommendations were applied
and some unused code removed improving general readability.
Change-Id: Iae9d37cb76997ba8389e21c7e2a3bf5905abe029
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
Percona site has connectivity issues from OVH hosts (of Zuul).
This patch makes it so that:
- the internal repo is actually used
- RPM GPG keys are downloaded from the actually used repo
- Ubuntu mimics the RHEL behavior (i.e. the Percona repo is
enabled only in the xtrabackup image)
extra benefit: no need for APT preferences for Percona repo
to spare MariaDB deps
Change-Id: Id27831f6b404762f9e44fd6bd1c4702bf06b05f8
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
When we run Debian 'buster' or Ubuntu 18.04 in CI job they refuse to
work as infra mirror is not signed.
This patch instructs APT to use unsigned repos anyway.
Change-Id: I530fde5b57894afda2de98d7c217e735497e3feb
Radosław Piliszek