214 Commits

Author SHA1 Message Date
Zuul
3daf6d5fe5 Merge "Make explicit the network backend used in the CI jobs" 2021-06-30 19:44:54 +00:00
Rodolfo Alonso Hernandez
17cca270a6 Make explicit the network backend used in the CI jobs
All Neutron CI jobs (except for unit, functional and fullstack jobs),
have explicitly defined the network backend used:
- linuxbridge
- ovs
- ovn

That was discussed and approved during the Neutron CI meetings [1].

[1]https://meetings.opendev.org/meetings/neutron_ci/2021/neutron_ci.2021-06-15-15.00.log.html

Depends-On: https://review.opendev.org/c/openstack/neutron/+/797051
Change-Id: I23889eb8ebc5911f6ac6c283bcd7316271a77715
2021-06-23 13:05:35 +00:00
Lee Yarwood
b5b2e99824 zuul: Add nova-tox-functional-centos8-py36 job
The nova-tox-functional-py36 job was replaced with the current py38
version during Victoria by I1d6a2986fcb0435cfabdd104d202b65329909d2b.

However as clearly stated in both the Victoria and Xena runtime
reference documents python 3.6 remains supported through CentOS 8 and
later CentOS 8 stream.

This change reintroduces functional test coverage for py36 using a
CentOS 8 stream based job.

[1] https://governance.openstack.org/tc/reference/runtimes/victoria.html
[2] https://governance.openstack.org/tc/reference/runtimes/xena.html

Change-Id: I6ef77bd92f2595016a99d1953414d3f554f6b2eb
2021-06-18 12:34:44 +01:00
Stephen Finucane
98b01c9a59 Move 'check-cherry-picks' test to gate, n-v check
This currently runs in the 'check' pipeline, as part of the pep8 job,
which causes otherwise perfectly valid backports to report as failing
CI. There's no reason a stable core shouldn't be encouraged to review
these patches: we simply want to prevent them *merging* before their
parent(s). Resolve this conflict by moving the check to separate voting
job in the 'gate' pipeline as well as a non-voting job in the 'check'
pipeline to catch more obvious issues.

Change-Id: Id3e4452883f6a3cf44ff58b39ded82e882e28c23
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2021-06-16 15:51:38 +01:00
Lee Yarwood
7c478ac099 zuul: Skip block migration with attached volumes tests due to bug #1931702
Bug #1931702 details soft lockups reported within the guest OS during
live migration with block migration and a volume attached. These lockups
then causing the request to detach the volume as part of the cleanup to
fail. For the time being we should skip these tests until the underlying
issue is resolved.

Related-Bug: #1931702
Change-Id: I7c1a647fb840fce98672a8429d554dd399cd13b7
2021-06-11 13:31:48 +01:00
Lee Yarwood
d5ed968826 zuul: Skip swap_volume tests as part of nova-next
The volume update or swap_volume API has long been a source of gate
failures within Nova. Most recently we've seen increased instability
when running the temptest.api.compute.admin.test_volume_swap tests as
part of the nova-next job as documented in bug #1929710.

This change temporarily removes the failing test from the nova-next job
while the underlying issue is identified lower in the virt stack.

Change-Id: Ib56a034fb08e309981d0b4553b8cee8d16b10152
Related-Bug: #1929710
2021-05-26 19:35:29 +01:00
Lee Yarwood
dab4ec1a53 zuul: Remove nova-dsvm-multinode-base
This is no longer used with the removal of the legacy
nova-grenade-multinode job in I02b2b851a74f24816d2f782a66d94de81ee527b0.

dsvm-irrelevant-files is also renamed to nova-base-irrelevant-files and
now defined within the nova-live-migration job.

Change-Id: I67faa85618e2de1400d868299426b0ba8274c90e
2021-04-29 11:05:58 +01:00
Lee Yarwood
91e53e4c2b zuul: Replace grenade and nova-grenade-multinode with grenade-multinode
If2608406776e0d5a06b726e65b55881e70562d18 dropped the single node
grenade job from the integrated-gate-compute template as it duplicates
the existing grenade-multinode job. However it doesn't remove the
remianing single node grenade job still present in the Nova project.

This change replaces the dsvm based nova-grenade-multinode job with the
zuulv3 native grenade-multinode based job.

Various legacy playbooks and hook scripts are also removed as they are
no longer used. Note that this does result in a loss of coverage for
ceph that should be replaced as soon as a zuulv3 native ceph based
multinode job is available.

Change-Id: I02b2b851a74f24816d2f782a66d94de81ee527b0
2021-04-29 11:05:58 +01:00
Zuul
3c52685125 Merge "Switch to new rolevar for run-tempest role" 2021-04-24 09:37:23 +00:00
Lucas Alvares Gomes
a3c44c6243 [OVN] Explicitly set nova-next job to ML2/OVS
This patch explicitly enable ML2/OVS for the nova-next job.

Devstack is changing the Neutron default to OVN backend. Currently, the
nova-next job requires QoS minimum bandwidth support in its
post_test_hook.sh script [0] which is currently not supported in OVN [1]
(feature needs to come to core OVN first).

[0]
ede0147abd/gate/post_test_hook.sh (L131-L136)
[1] https://docs.openstack.org/neutron/latest/ovn/gaps.html

Change-Id: I91b8056e73658fc815eb2f6711e89d4ab5deed92
Signed-off-by: Lucas Alvares Gomes <lucasagomes@gmail.com>
2021-04-12 09:40:19 +01:00
Zuul
08ef1a4985 Merge "nova-next: Drop NOVA_USE_SERVICE_TOKEN as it is now True by default" 2021-04-11 10:23:16 +00:00
Ghanshyam Mann
9d285e0bb4 Switch to new rolevar for run-tempest role
Tempest replaced the below rolevar for run-tempest role
- tempest_test_blacklist is replaced by tempest_test_exclude_list
- tempest_black_regex is replaced by tempest_exclude_regex

old name are still supported for compatiblity but we recommend
to switch to new one.

Change-Id: I4f2d01a4cf443f9c539158e77032cd3d8ce24ad7
2021-04-09 16:06:10 +00:00
Zuul
7a1222a865 Merge "Add Python3 xena unit tests" 2021-03-29 21:06:15 +00:00
b8ca4d3139 Add Python3 xena unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for xena.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Depends-On: https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/783310

Change-Id: I7ba67f4763730affa259189d10230d90d294b100
2021-03-26 14:22:52 +00:00
Lee Yarwood
efd2816619 zuul: Add nova-live-migration-ceph job
Since Ib342e2d3c395830b4667a60de7e492d3b9de2f0a the nova gate has lacked
any libvirt live migration test coverage for ceph. This change
reintroduces this via a new zuulv3 native multinode live migration job
for ceph that includes additional instance evacuation coverage.

Depends-On: https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/711625
Change-Id: I6d0dbdcc84fe070e84d19d0c3d4306e6e0326e46
2021-03-19 15:59:55 +00:00
Lee Yarwood
8f317f442c nova-next: Start testing the q35 machine type
With the introduction of the libvirt-default-machine-type blueprint
operators are now able to change the default machine type used by an
existing environment more easily. This should hopefully allow more
deployments to switch to the modern q35 machine type, away from the
legacy pc machine type that is currently the default.

With this in mind this change aims to start testing the q35 machine type
as part of the nova-next job before we eventually change the default in
the future.

The following changes are made to the job to allow it to pass with q35:

- [libvirt]num_pcie_ports is increased to 24

This is required as more devices are now connected by default over PCIe.

- [compute-feature-enabled]ide_bus is disabled

The q35 machine type does not support an IDE bus so any tests using this
bus are now skipped.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/779179
Depends-On: https://review.opendev.org/c/openstack/tempest/+/775630
blueprint: libvirt-default-machine-type
Change-Id: Iad1adbc23b31dd54a96299e7a8a4b622c15eed8d
2021-03-08 08:58:57 +00:00
Zuul
bf6a53f8b4 Merge "Run nova-live-migration job with neutron-trunk enabled" 2021-02-17 15:22:01 +00:00
elajkat
21656d4e9c Run nova-live-migration job with neutron-trunk enabled
A recent fix was merged to Neutron (see [0]), that fixed live-migration
of VMs with trunks, a new tempest test will cover this usecase (see [1])

To make the test executed enable neutron_trunk for the job
nova-live-migration.

[0]: https://review.opendev.org/q/I98e55242d381ada642ca0729e9aefdea7628c945
[1]: https://review.opendev.org/c/openstack/tempest/+/774689
Related-Bug: #1914747

Change-Id: I89989f69f76d1a1ad4c2851da027b3e763e6b0d3
2021-02-16 14:58:51 +01:00
Lee Yarwood
bc0d1c8d63 nova-next: Drop NOVA_USE_SERVICE_TOKEN as it is now True by default
Change-Id: I68f7b7e78cc8a7f22f3e495b1b20a311dacff6c5
Depends-On: https://review.opendev.org/c/openstack/devstack/+/775573
2021-02-15 10:32:53 +00:00
Dan Smith
94b5db6d2e Make a couple test jobs run async devstack
This makes us run a couple of our jobs with devstack in parallel
mode.

Change-Id: Ie3ca2332f8172ec8f0e3062a812e57739475e8af
2021-02-11 15:58:51 -08:00
Lee Yarwood
96cf885ecd zuul: Mark nova-lvm as voting
As covered in the removed TODO this was to be done after bug #1771700
was resolved in Queens but instability in the job over the years stopped
this from ever happening.

With I7ad1d9820c48644bff7834560cdc7d5c13f7ed41 hopefully addressing the
only outstanding stability issue we can now finally mark the job as
voting again.

Related-Bug: #1771700
Change-Id: Ie9cba36ab602ab7c20c9a2c3b60e11e8506581ce
2021-02-02 10:23:37 +00:00
Lee Yarwood
7d66f97e0a zuul: Increase SWIFT_LOOPBACK_DISK_SIZE within nova-lvm job
This is required as instance snapshots taken in this environment are
fully allocated RAW snapshots and consume considerably more space than
sparsely allocated RAW snapshots taken when Nova is using a file based
imagebackend.

We could look into sparsifying the resulting snapshots from the lvm
imagebackend but for the time being given the available space in our CI
hosts we can just extend space available to g-api via swift.

Closes-Bug: #1913451
Change-Id: I7ad1d9820c48644bff7834560cdc7d5c13f7ed41
2021-02-02 10:22:52 +00:00
Zuul
3fc4824e66 Merge "zuul: Allow encryption tests in nova-ceph-multistore again" 2021-01-27 13:35:10 +00:00
Zuul
93e0994b56 Merge "add openstack-python3-wallaby-jobs-arm64 job" 2021-01-23 20:01:22 +00:00
Lee Yarwood
6b4db089b2 zuul: Allow encryption tests in nova-ceph-multistore again
I50d3b874b7e0676436c434be6c059f221041560f and
Iee0d863770def63df8601222265dc22226457c0c should avoid any image
creation from breaking these tests while
[workarounds]/never_download_image_if_on_rbd remains set in this job.

Depends-On: https://review.opendev.org/c/openstack/tempest/+/771958
Depends-On: https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/771835

Related-Bug: #1912607
Change-Id: I06f95d68fcf20d40096b0ee120fe780097d82320
2021-01-22 10:15:42 +00:00
Lee Yarwood
6eae97843a zuul: Skip test_attach_cloned_encrypted_volume in nova-ceph-multistore
As with the already listed encrypted volume tests this job specifically
blocks us from downloading non-raw images via Glance as part of these
tests so skip it.

Change-Id: Iaf6f6e0dbcb25561bf00e969e1964cd30e974e64
Closes-Bug: #1912607
2021-01-21 09:43:34 +00:00
ricolin
af15488be9 add openstack-python3-wallaby-jobs-arm64 job
This is a non-voting job to validate py3 unittests on ARM64

Task: 40400
Story: 2007938
Change-Id: Ib45df16aaf718850ccdaf4b001f3b7c03b2f1d04
2021-01-19 20:45:05 +08:00
Zuul
b012361a53 Merge "Revert "zuul: Skip test_attach_scsi_disk_with_config_drive in nova-ceph-multistore"" 2020-11-30 10:23:11 +00:00
Ghanshyam Mann
4bea68f12b Revert "zuul: Skip test_attach_scsi_disk_with_config_drive in nova-ceph-multistore"
This reverts commit 836e13cd5785a9614bcddb98ee2b7367a3dc8541.

Reason for revert: depends-on patch fixed the test.

Change-Id: I999336dff277954e7621489cc7f5e486962ee2a5
Depends-On: https://review.opendev.org/c/openstack/tempest/+/764407
2020-11-28 14:36:49 +00:00
Lee Yarwood
7f7a7a163e zuul: Add devstack-plugin-ceph-compute-local-ephemeral to experimental
This job tests the recently introduced direct download of rbd hosted
Glance images into a file based imagecache.

Depends-On: https://review.opendev.org/748212
Change-Id: I0933447e6caa0013f0b26dbf6532ff1976197e80
2020-11-27 13:33:16 +00:00
Lee Yarwood
836e13cd57 zuul: Skip test_attach_scsi_disk_with_config_drive in nova-ceph-multistore
Related-Bug: #1905725
Change-Id: Ia108a7ac04defe742efcac09e7c0d61b08ab4e6d
2020-11-27 09:11:34 +00:00
Balazs Gibizer
3fcaf579a2 Add functional-py39 testing
This patch adds both a tox target and a zuul job to run functional tests
with python3.9

Depends-On: https://review.opendev.org/760932

Change-Id: I672904e9bfb45a66a82331063c7d49c4bc0439df
2020-11-11 17:34:00 -06:00
Lee Yarwood
be752b8175 zuul: Reintroduce nova-dsvm-multinode-base
This was incorrectly removed by
Ib342e2d3c395830b4667a60de7e492d3b9de2f0a while still being used by the
nova-grenade-multinode job. This was missed as the check queue appears
to default to silently skipping jobs where it can't find the parent
instead of failing.

Change-Id: I3ece71ab75a28a0ba662c56fb140525e8ce4aa6c
2020-11-09 08:52:41 +00:00
Lee Yarwood
4ac4a04d18 zuul: Replace nova-live-migration with zuulv3 jobs
This change removes the original nova-live-migration job and replaces it
directly with the new Focal based zuulv3 native job.

The nova-dsvm-multinode-base base job is no longer used and so also
removed as part of this change.

Note that this new nova-live-migration job does not yet contain any
ceph coverage like the original, this is still pending and will be
completed early in the W cycle.

This change is being merged ahead of this to resolve bug #1901739, a
known QEMU -drive issue caused by the previous jobs use of libvirt 5.4.0
as provided by Ubuntu Bionic. The fix here being the migration to Ubuntu
Focal based jobs and libvirt 6.0.0 that now defaults to using QEMU
-blockdev.

Closes-Bug: #1901739
Change-Id: Ib342e2d3c395830b4667a60de7e492d3b9de2f0a
2020-11-06 10:55:52 +00:00
Lee Yarwood
c0fe95fcc5 zuul: Merge nova-evacuate into nova-multinode-live-migration
Both jobs deploy a multinode env before running their tests so just
append the new nova-evacuate tests to the end of the job.

Change-Id: If64cdf1002eec1504fa76eb4df39b6b2e4ff3728
2020-11-06 10:49:25 +00:00
Zuul
2745e68537 Merge "Add Python3 wallaby unit tests" 2020-10-06 23:01:27 +00:00
ed4a748bda Add Python3 wallaby unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for wallaby.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Ia50ca4e32e0d1ebb4d98ef966c117b7c85002855
2020-09-25 08:40:43 +00:00
Lee Yarwood
f357d80407 zuul: Introduce nova-evacuate
This change reworks the evacuation parts of the original
nova-live-migration job into a zuulv3 native ansible role and initial
job covering local ephemeral and iSCSI/LVM volume attached instance
evacuation. Future jobs will cover ceph and other storage backends.

Change-Id: I380e9ca1e6a84da2b2ae577fb48781bf5c740e23
2020-09-23 16:47:47 +01:00
Ghanshyam Mann
049c0e6bde Run voting jobs in gate pipeline also
nova-ceph-multistore and neutron-tempest-linuxbridge
jobs are voting jobs but only run in check pipeline.
We should run all voting job in check as well as in gate
pipeline.

Change-Id: If6758c83a6bd95aefb7703529cbccd14e3adfee2
2020-09-05 22:35:14 +00:00
Zuul
5f6feccc44 Merge "zuul: Start to migrate nova-live-migration to zuulv3" 2020-08-28 09:40:27 +00:00
Luigi Toscano
f881854ea6 zuul: use the new barbican simple-crypto job
The old job name is still available as an alias for a while,
but it is time to switch away from it.

Change-Id: I93c35b386e1b1cbcff74fe0a2388f0eda5dea3b9
2020-08-17 20:09:47 +02:00
Lee Yarwood
1c733d9730 zuul: Start to migrate nova-live-migration to zuulv3
This initial change introduces a non-voiting
nova-multinode-live-migration check job. This initial job simply runs
the live migration tests against a multinode env.

Future changes will introduce ceph based live migration and evacuation
jobs before removing the original nova-live-migration job.

Change-Id: Ibbb3930a6e629e93a424b3ae048f599f11923be3
2020-08-05 11:18:11 +01:00
Zuul
6072f408a4 Merge "Make our ceph job test with glance in multistore mode" 2020-07-22 02:46:12 +00:00
Balazs Gibizer
e8eb8d8387 Remove broken legacy zuul jobs
These are legacy jobs in the experimental queue that never run
successfully:
* legacy-grenade-dsvm-neutron-multinode-zero-downtime [1]
* legacy-tempest-dsvm-nova-libvirt-kvm-apr [2]

As we need to get rid of the legacy jobs this patch
proposes to simply drop these broken jobs.

[1] https://zuul.opendev.org/t/openstack/builds?job_name=legacy-grenade-dsvm-neutron-multinode-zero-downtime
[2] https://zuul.opendev.org/t/openstack/builds?job_name=legacy-tempest-dsvm-nova-libvirt-kvm-apr

Change-Id: I215d0fca6e7f9a44e1f5d49aedda6d5884b634e1
2020-07-17 16:11:07 +00:00
Dan Smith
a81189b0e2 Make our ceph job test with glance in multistore mode
This makes our ceph job configure glance with multiple stores enabled.
It also makes sure that devstack uploads the cirros image to the file-
backed store, and configures nova for automatic copy-to-store
functionality. In order to allow this, we must grant all users ability
to copy-to-store for public images, since the tempest tests run as
their own users. This broadens the coverage of our ceph job to hit not
only the ceph paths, but the copy-to-store paths, as well as glance's
multi-store paths, and glance's async task paths.

Related to bp/rbd-glance-multistore

Depends-On: https://review.opendev.org/#/c/740322
Depends-On: https://review.opendev.org/#/c/738703
Change-Id: Iff5e9eaed7eb2345eaafc90c8cd6466a2cbca08c
2020-07-14 09:11:42 -07:00
Luigi Toscano
bce4a3ab97 zuul: remove legacy-tempest-dsvm-neutron-dvr-multinode-full
The job was part of the neutron experimental queue but then removed
during the ussuri lifecycle.
See https://review.opendev.org/#/c/693630/

Change-Id: I04717b95dd44ae89f24bd74525d1c9607e3bc0fc
2020-07-10 13:26:48 +02:00
Lee Yarwood
236f1b2d09 zuul: Make devstack-plugin-ceph-tempest-py3 a voting check job again
This job was marked as non-voting for instability reasons long ago but
has been stabilised more recently and is ready to be marked as voting
once again.

https://zuul.opendev.org/t/openstack/builds?job_name=devstack-plugin-ceph-tempest-py3&project=openstack%2Fnova

Change-Id: I4737f4839b1b65004944088548ce99fb6d2378f7
2020-05-26 09:44:21 +01:00
Lee Yarwood
4e394380a3 zuul: Make barbican-simple-crypto-devstack-tempest a non-voting check job
The job itself appears very stable at present and would greatly improve
our coverage of features such as image signature verification, encrypted
volumes using an actual key manager etc.

https://zuul.opendev.org/t/openstack/builds?job_name=barbican-simple-crypto-devstack-tempest#

Change-Id: I73cc2252bd59a4de00deab9d9c522717d6842c46
2020-05-22 14:04:08 +01:00
Ghanshyam Mann
c3834e675f Moving functional jobs to Victoria testing runtime
As per Victoria testing runtime[1], we need to tests py3.6,
py3.7, and py3.8.

- py3.7 is being tested with integration jobs.
- py3.6 and py3.8 are tested with unit test jobs.

Nova functional tests are testing py3.6 which can be moved to the latest
python available in this cycle which is 3.8. We do not need to run functional
or integration tests on each supported python version. Testing them on
the latest python version is enough. Coverage of all supported python version
is achieved via unit tests job.

[1] https://governance.openstack.org/tc/reference/runtimes/victoria.html

Change-Id: I1d6a2986fcb0435cfabdd104d202b65329909d2b
2020-05-08 11:01:34 -05:00
Lee Yarwood
9f0d2d8ecf zuul: Switch to the Zuulv3 grenade job
This change switches the single node legacy grenade-py3 job over to the
newly introduced Zuulv3 based grenade job.

Change-Id: I212692905a1d645cd911c2a161c13c794c0e0f4d
2020-04-27 08:48:58 +00:00