91 Commits

Author SHA1 Message Date
Radosław Piliszek
1ef537d65d [CI] Add no-infra-wheels jobs
Since Kolla is run in the wild against PyPI mirrors which do not
include the OpenDev-provided wheels, it might be nice to be able
to test these scenarios in the CI.

These jobs are added to the experimental queue so that they do
not consume resources when not needed.
Any Gerrit user may run them now to verify whether the change
passes them.

Change-Id: I9c33eeaf03be037651f82c831f0e07ab9a27752a
2020-08-12 09:57:37 +00:00
Marcin Juszkiewicz
d2966452c5 ubuntu: move to 20.04 Focal
There is a time once every 2 years when ubuntu team releases new LTS
release. And then UCA joins with binary packages for current OpenStack
development cycle.

It is this time for Ubuntu 20.04 'focal'.

Depends-On: https://review.opendev.org/745156
Change-Id: I045aa6b4b4fd83fbe7d1fda89549f0ef1e88ec12
2020-08-07 14:38:02 +00:00
Radosław Piliszek
a807439bc5 CI: Add the KVM jobs
They are triggered only on changes to Nova to avoid using this
scarce resource too often.

Depends-On: https://review.opendev.org/735454
Depends-On: https://review.opendev.org/741679
Change-Id: I609db6f4670da7ddfe132dcc62a58bce71aacfe2
2020-07-31 11:05:51 +02:00
Mark Goddard
e68cc2054a CI: Add jobs for mariadb, masakari, linuxbridge, ovn, prometheus-efk
These jobs exist in kolla-ansible but have not yet been added to kolla.

Change-Id: I15c5d20df83bf3ecb83ba390a01c7ad711c9d889
2020-07-23 13:47:35 +01:00
Zuul
aaba5387bf Merge "CI: Ignore more" 2020-05-24 13:56:00 +00:00
Radosław Piliszek
8500eaee2a CI: Ignore more
This aligns Kolla with Kolla Ansible.

Change-Id: I02ee643d0f46e6ff1ed376362b4ee35ddadf7960
2020-05-23 09:20:35 +00:00
262a247e4c Add Python3 victoria unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for victoria.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Iefa5a9242ef32cedb5a85dc46850bcf5c509ce9a
2020-05-22 18:32:13 +00:00
Marcin Juszkiewicz
d898534f15 CI: Fix Debian aarch64 jobs
Debian defaults to Python2 which is not complete in aarch64 images.

This patch changes CI to always use Python3.

Change-Id: Ie2582baf1cf47201e077d49d8c9102b1af9b2bd5
2020-04-30 13:55:05 +00:00
Radosław Piliszek
8970f6b898 CI: Add swift jobs
Also marks swift as tested in x86 matrix.

Change-Id: I635a4693915df7bd10668fbc620ef451042eaa38
2020-04-23 20:41:34 +02:00
Marcin Juszkiewicz
64ff6feed7 CI: add kolla-ansible-debian-source-aarch64 job
We have it defined in kolla-ansible so let's use it.

Change-Id: Ic492786072586281f25d315d74482040f9abfe0c
2020-04-16 18:58:42 +00:00
Marcin Juszkiewicz
584da06751 CI: add Centos 8 and Ubuntu jobs for aarch64
also simplify Debian job definition

Depends-on: https://review.opendev.org/718413
Depends-on: https://review.opendev.org/718363
Depends-on: https://review.opendev.org/718236
Depends-on: https://review.opendev.org/718238

Change-Id: I2c75dbc2ea063dd3507eaaf93a484c50acae5fb5
2020-04-08 21:11:44 +00:00
Radosław Piliszek
c089eab392 CI: Avoid tox
We don't need tox nor tell our users to use it when doing kolla builds.

Tox is going away from base infra images (it is already gone from
aarch64 ones).

Depends-on: https://review.opendev.org/713134
Co-authored-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>

Change-Id: Ib1d97a783951ac42740ebf91bcc6ecaf2bf70853
2020-04-03 15:46:11 +02:00
Marcin Juszkiewicz
c2a3380707 CI: publish AArch64 Debian/source images
We want to test upgrades on aarch64. For this we need to publish images.

AArch64 images will get "-aarch64" added to tag to not collide with
x86-64 ones.

Change-Id: Ibae2578b4bc18c0ab7fcc1840c39bb86659ab920
2020-03-19 15:28:00 +00:00
Mark Goddard
8294bac01b CentOS 8: Switch default base image, tag as master
Changes the default base tag and distro for CentOS images from 7 to 8.

Also changes the tag used by the publisher jobs for CentOS 8 images from
'master-centos8' to 'master'.

Change-Id: I5498141ade23219d63f34debc2b8e1330dec2e68
Partially-Implements: blueprint centos-rhel-8
2020-03-17 16:38:43 +00:00
Zuul
e6d3d77bbd Merge "CI: Ignore .zuul.d" 2020-03-16 10:31:48 +00:00
Radosław Piliszek
a0087490ff CI: Ignore .zuul.d
Zuul handles jobs updates just fine, no need to run kolla build
jobs when touching .zuul.d for different reasons.

Change-Id: I201a194fa473a63b880cefc00febb543b40bcec8
2020-03-12 17:24:10 +01:00
Mark Goddard
f6ee342278 CI: CentOS 8: Enable ceph-ansible jobs
Change-Id: I308dcd92666993f6726c8984270f2796283aca9a
Partially-Implements: blueprint centos-rhel-8
2020-03-12 15:49:39 +00:00
Zuul
031b17226a Merge "CentOS 8: Build bifrost image" 2020-03-09 22:26:24 +00:00
Mark Goddard
a7ba77fa89 CentOS 8: Build bifrost image
Also enables CentOS 8 ansible bifrost job.

Change-Id: Iec3d51abe50b05f90f764a4058be620cad1f9388
Partially-Implements: blueprint centos-rhel-8
2020-03-09 16:44:36 +00:00
Mark Goddard
48a1630f4f CentOS 8: Add upgrade job
Change-Id: Id1beefee220b1014e5f90dbb22a496ccb8d0cf53
Partially-Implements: blueprint centos-rhel-8
2020-03-06 13:00:00 +00:00
Mark Goddard
a755304795 Multiple fixes to unblock CI
This change includes a number of fixes to make CI functional.

* Blacklist ansible 2.8.9 in kolla-toolbox

  Ansible 2.8.9 broke the OpenStack modules, see
  https://bugs.launchpad.net/kolla/+bug/1866181 for details.

  This causes us to fail with the following error:

    /usr/lib64/python2.7/distutils/version.py\", line 40, in __init__
    self.parse(vstring)
    File "/usr/lib64/python2.7/distutils/version.py", line 105, in parse
    match = self.version_re.match(vstring)\nTypeError: expected string or buffer

  This change works around the issue by blacklisting ansible 2.8.9 in
  the kolla-toolbox image.

* Drop CentOS 7 CI jobs. There are multiple issues with CentOS 7 now,
  and we have CentOS 8 jobs in place so it's time to move on

* pin requirements to commit
  ea42244642c3c091cb4f70917ae8d79af217b6af. This is required to avoid
  oslo.cache 2.1.0, which breaks us. See
  https://bugs.launchpad.net/kolla-ansible/+bug/1866008.

Change-Id: Iebc39bd804d2c4f553d42c285549f50f4c8bc8be
Closes-Bug: #1866181
Related-Bug: #1866008
2020-03-05 17:54:44 +00:00
Wes Hayutin
1b0884af8a change tripleo centos-7 build containers to centos-8
mark the job non-voting
remove the gate job.

Once the job is confirmed stable we should
add voting, gating.

Change-Id: Ied6df5412c58446c6b090bc8e9822685ed51ddb1
2020-02-17 10:59:25 -07:00
Mark Goddard
018f69bc71 CentOS 8: Add deploy jobs in CI
Adds the following deploy jobs, defined in kolla-ansible, to the CI
check pipeline:

- kolla-ansible-centos8-source
- kolla-ansible-centos8-binary
- kolla-ansible-centos8-source-cinder-lvm
- kolla-ansible-centos8-source-scenario-nfv
- kolla-ansible-centos8-source-ironic

The following job is not yet passing:

- kolla-ansible-centos8-source-bifrost

Also adds the following deploy job to the CI gate pipeline:

- kolla-ansible-centos8-source

Partially-Implements: blueprint centos-rhel-8

Depends-On: https://review.opendev.org/693544/

Change-Id: Idca0f983451fb67527f4917642de510dbf9af921
2020-02-06 19:53:09 +00:00
Radosław Piliszek
a7c2e4b34c CI: Replace cinder-lvm scenario with zun scenario
As discussed during the meeting. [1]

[1] http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-02-05-15.00.html

Change-Id: Ie095590b82d6e1b3922d99178d3a4019626ab630
2020-02-06 20:42:32 +01:00
Michal Nasiadka
e75051d3a1 CI: Replace ceph jobs with ceph-ansible
Change-Id: Ic2a75d72c2f5f00f1a46ea50a0ba091b964a7858
2020-02-05 17:21:42 +01:00
Zuul
c10f9d7acf Merge "Revert "Add AArch64 publisher for Debian/source"" 2020-01-16 12:21:42 +00:00
Marcin Juszkiewicz
b66f144c42 Revert "Add AArch64 publisher for Debian/source"
Turned out that linaro-london network pipe is too thin 
to support this job. Pushing images took 3 hours so job
timed out.

Will check it once new nodes arrive.

This reverts commit f2801fabdd727fc72a28b056d79787af484424a7.

Change-Id: I8897ede43f11090902fe7c0c096f17f57c1c9c67
2020-01-15 16:33:04 +00:00
Zuul
0fdf656427 Merge "Add AArch64 publisher for Debian/source" 2020-01-14 10:15:44 +00:00
Marcin Juszkiewicz
f2801fabdd Add AArch64 publisher for Debian/source
This time proper approach involves job dependencies.

First we build and publish x86-64 and aarch64 images with architecture
name in image tag. Then we create multiarch manifests to create 'master'
images.

Change-Id: I6b9505dc326636fc6df8798c62c3a5eb1f728a51
2020-01-10 12:50:34 +01:00
Mark Goddard
b060623b90 CentOS 8: Add zuul build and publish jobs
Adds build and publishing jobs for CentOS 8 images:

- kolla-build-centos8-binary
- kolla-build-centos8-source
- kolla-publish-centos8-binary
- kolla-publish-centos8-source

The 'base' image has been added to the list of unbuildable images for
CentOS 8 (now separate from the list for CentOS 7). This means that no
images will be built - the jobs should essentially be a 'noop'.

Change-Id: Ie9a0109bd4eef337358d714e4b5088b8e3de2f23
Partially-Implements: blueprint centos-rhel-8
2020-01-09 16:23:39 +00:00
Marcin Juszkiewicz
fba81eb0a0 Revert "Add AArch64 publisher for Debian/source"
This reverts commit 61fed77d79c8242c64772df5d409fdaffdc3a150.

Images overwrite x86-64 ones.

We need to solve it better.

Change-Id: I57e725b44efe16a9f2f3900c6e14eb84aac37c32
2019-12-20 07:55:49 +00:00
Marcin Juszkiewicz
61fed77d79 Add AArch64 publisher for Debian/source
We want to have AArch64 in kolla-ansible CI. But building images each
time takes time. So let build them once, publish and re-use.

Change-Id: Ie0b39743e2dbfaac55a6467ca98fb2f5a53a49e9
2019-12-19 09:32:10 +01:00
Marcin Juszkiewicz
d6935edb43 Add Debian/source aarch64 CI job
AArch64 is getting popular and not all changes working on x86-64 work
properly on aarch64 architecture. Let check them.

Job is running in separate pipeline due to low number of aarch64 nodes.

Authored-By: Xinliang Liu <xinliang.liu@linaro.org>
Co-Authored-By: Jeffrey Zhang <zhang.lei.fly@gmail.com>
Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>

Implements: blueprint aarch64-3rd-party-ci-kolla

Depends-On: https://review.opendev.org/#/c/698606

Change-Id: I7e7802dfa4f4d9c61d01dba4b77c01cfb24301c0
2019-12-16 08:17:38 +00:00
Mark Goddard
6c86915597 CI: Move to CentOS 8 nodepool images
This change modifies the CentOS build CI jobs to use a CentOS 8 host
image.

NOTE: This does not affect the version of CentOS used as the base image
in containers built by kolla.

Partially-Implements: blueprint centos-rhel-8
Partially-Implements: blueprint centos-rhel-python3

Change-Id: Ie25b54a4e6116ed2bcb9c3b5c44eb6edbd2e6b49
2019-11-26 10:22:06 +00:00
Marcin Juszkiewicz
9c9106bcc1 Drop openstack-tox-py27 job
Change-Id: I26ab8824d8c6c108eadb85698dc8367b576f485c
2019-11-14 11:30:38 +01:00
Marcin Juszkiewicz
0ab4dd25d7 Switch to Ussuri jobs
Change-Id: I3022a62f85d24f4edfef72698d4a53a74b271e23
2019-11-13 11:39:25 +01:00
Mark Goddard
98fb7dc8ff CI: Increase job run attempts to 5
Attempts affect pre failures.  This means we can increase stability of
jobs by rejecting nodes that fail pre without failing runs at the same
time (unless we are really unlucky and hit b0rken nodes 5 times in a
row).

This change is adapted from I17b7f878c742fa8db66f738526855a02ab9f1905 in
kolla-ansible.

Change-Id: Ied5d2cb8ffa47b90833ee3cf241797601906f9b2
2019-10-21 15:48:01 +01:00
Zuul
138afba32e Merge "Add Debian/source kolla-ansible job" 2019-10-06 19:22:11 +00:00
Zuul
17fd2b62f2 Merge "CI: increase both limits to 3h" 2019-10-04 13:41:53 +00:00
Marcin Juszkiewicz
7e1d3eba92 CI: increase both limits to 3h
Our publishing job is barely managing to fit in 2h time so let add
another one.

Change-Id: Id9312830fb9961927ac8d317c432f52a4ad7af24
2019-10-04 02:44:36 -07:00
Marcin Juszkiewicz
2a46d9ba78 Add Debian/source kolla-ansible job
Depends-On: https://review.opendev.org/686133

Change-Id: I79c9c678a140931f2470591c88e008b497a893cf
2019-10-03 09:02:22 -07:00
Marcin Juszkiewicz
9b60e010f4 Debian: publish images
Let us publish Debian/source images periodically and at release time.

Debian/binary images publish at release time as we may not have binary
packages during development cycle.

Change-Id: I1e821a04d8637141ac7977937fddab6910c4eeaf
2019-10-02 05:13:55 -07:00
Marcin Juszkiewicz
657ce9bc5f CI: add Debian/binary job
While we do not get up-to-date Debian packages (usually one release back)
it would be nice to see how situation looks.

Depends-On: https://review.opendev.org/#/c/683680
Depends-On: https://review.opendev.org/#/c/683677

Change-Id: I84ba1c981ce8a57937f7614b9ba3223dbc9ac66e
2019-09-27 16:51:30 +00:00
Andreas Jaeger
454d834bce Remove unneeded Zuul branch matcher
We have implicit branch matchers, so there's no need to add a check for
not-ocata, this job is only run for the branch it's on - like master
now.

Remove it to not confuse Zuul when multiple branches matches and the job
is different.

Change-Id: I2052e6c9cf1082f238988eeb9f6a20341d2d4886
2019-09-13 09:25:38 +02:00
Marcin Juszkiewicz
63d397b8a8 Restore TripleO CI as voting and gated
Change-Id: Ic141ec854aa9bee7cb30ec982c6f91fedbc4a3a3
2019-08-31 06:53:23 +00:00
Radosław Piliszek
f8d81e0307 CI: Gate on jobs kolla-ansible already gates on
We should gate on kolla-ansible jobs. Period.
This makes kolla gate on jobs that kolla-ansible gates on already.
They are already voting in kolla.

Change-Id: Iee51a5c340d071e653afd4ecd4996d04bd9cfb7f
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-08-20 12:51:08 +00:00
Zuul
62493243ae Merge "Add Debian/source CI job" 2019-08-20 09:58:06 +00:00
Radosław Piliszek
b16bfdd4bb CI: follow-up on TripleO demotion - no gating
Backported to Stein already.
See also: https://review.opendev.org/677144

Change-Id: Ic2948953b9e8cd5148d6bde539003ab9d081b215
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-08-19 16:49:04 +02:00
Radosław Piliszek
07b55048e6 Unbreak CI: fluentd and TripleO dependency
fluentd - we are not deploying kubernetes, no need for plugins
TripleO - CI currently broken (to reverse, FIXME in place)

Change-Id: I203f70176af7f2b53398ddeb5c21e6234a45e268
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-08-19 10:30:58 +02:00
Marcin Juszkiewicz
c8b2ee97b7 Add Debian/source CI job
For start just simple debian/source build job.

Depends-On: https://review.opendev.org/676896
Depends-on: https://review.opendev.org/676905
Depends-on: https://review.opendev.org/676909

Change-Id: I55e2b32c673f5e06458bec6e88184c3415f1f1fa
2019-08-16 13:21:29 +02:00