292 Commits

Author SHA1 Message Date
Zuul
927eeb54f2 Merge "Remove n-v ceph live migration job from gate" 2023-08-21 22:18:09 +00:00
Zuul
74a2da32c6 Merge "Add integrated job to test the Nova RBAC old defaults" 2023-08-01 21:15:52 +00:00
Zuul
a612688124 Merge "Add nova-tox-functional-py310 to gate jobs" 2023-08-01 11:50:09 +00:00
Dan Smith
f2a10afb64 Remove n-v ceph live migration job from gate
This job is marked as non-voting in the parent definition, which
causes us to run it in gate as non-voting, which is just a waste of
resources. Remove it from the gate queue until it is marked as voting
in the definition (or maybe consider just leaving it out).

Depends-On: https://review.opendev.org/c/openstack/devstack/+/890136
Change-Id: I2ddbafe851be2c7826d78613f12560a1713ac1b1
2023-07-31 09:12:50 -07:00
Zuul
b6f4c57b43 Merge "Drop Fedora support" 2023-07-18 17:49:07 +00:00
3f7cc63d94 Add config option to configure TB cache size
Qemu>=5.0.0 bumped the default tb-cache size to 1GiB(from 32MiB)
and this made it difficult to run multiple guest VMs on systems
running with lower memory. With Libvirt>=8.0.0 it's possible to
configure lower tb-cache size.

Below config option is introduced to allow configure
TB cache size as per environment needs, this only
applies to 'virt_type=qemu':-

[libvirt]tb_cache_size

Also enable this flag in nova-next job.

[1] https://github.com/qemu/qemu/commit/600e17b26
[2] https://gitlab.com/libvirt/libvirt/-/commit/58bf03f85

Closes-Bug: #1949606
Implements: blueprint libvirt-tb-cache-size
Change-Id: I49d2276ff3d3cc5d560a1bd96f13408e798b256a
2023-07-13 19:35:52 +05:30
Sean Mooney
6f56c5c9fd enable validations in nova-lvm
As of I8ca059a4702471d4d30ea5a06079859eba3f5a81 validations
are now requried for test_rebuild_volume_backed_server.
Validations are also required for any volume attach/detach based test
in general due to know qemu issues.

This patch just turns them back on to unblock the gate.

Closes-Bug: #2025813
Change-Id: Ia198f712e2ad277743aed08e27e480208f463ac7
2023-07-04 15:49:11 +00:00
jskunda
86c542c56a Drop Fedora support
We are about to drop Fedora support as the latest image in upstream
has been transitioned to EOL. Centos 9 Stream has evolved as
replacement platform for new features. Patch which removes fedora
jobs and nodeset from devstack:
https://review.opendev.org/c/openstack/devstack/+/885467

Change-Id: Ib7d3dd93602c94fd801f8fe5daa26353b04f589b
2023-06-21 23:58:44 +02:00
Ghanshyam Mann
aeddcd61fd Add integrated job to test the Nova RBAC old defaults
Nova has enabled the scope checks and new defaults in
antelope release and now devstack is switching the testing
to new defaults by default (depends-on). With that all the
jobs will run the the new defaults.

As old defaults are still supported (as deprecated), we should
test those at least in a single integrated job. Adding
new job tempest-integrated-compute-rbac-old-defaults to test those
old defaults.

Keeping existing job enabling the new defaults because other services
have not switched to new defaults yet to this job enable new defaults
for those service and test Nova against that.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/883601
Change-Id: Ifc3d0abe3e4caab701b695d3781f20ab3dba267d
2023-05-23 03:30:40 +00:00
Dan Smith
6ff3237149 Bump nova-ceph-multstore timeout
The recent change(s) to enable a lot more SSHABLE checks puts the
runtime of the ceph job really close to the 2h timeout even when
things are working. Sometimes it times out before it finishes even
though things are progressing. Bump the timeout to avoid that.

Also bump us to 8G swap to match what is set on the parent ceph job
when we upgraded to jammy. We could just unset this, but better to
pin it high in case that job (defined elsewhere) changes. Our job
is the largest ceph job, so it makes sense that it keeps its own
swap level high.

Change-Id: I6cefd87671614d87d92e4675fbc989fc9453c8b9
2023-05-10 17:54:38 -07:00
Elod Illes
b50bcdf2b2 Add nova-tox-functional-py310 to gate jobs
Change-Id: I1da1ed56e32a754a4e5c9aeba09b62aef3401596
2023-05-02 11:35:59 +02:00
Dan Smith
2f86a8a088 Remove focal job for 2023.2
Neutron also flipped to python>=3.9 on all their repos this morningi[1]
which means we can't install neutron on focal at all. I'm not sure if
that's going to get reverted at this point, but even if it is, it's
going to take a while to undo. As noted in the comments and the
original commit[2] that added this job, it was intended to be removed
when we dropped focal from the test interface, which we have now done.

1: https://review.opendev.org/q/topic:bug%252F2017478
2: https://review.opendev.org/c/openstack/nova/+/861111

Change-Id: I5be638a702629e07ec9c88bd67bb9b7f1212f7fc
2023-04-24 15:25:32 -07:00
Dan Smith
402b155043 Add grenade-skip-level-always to nova
This makes us test N-2->N even for non-SLURP releases. Ideally we
would continue to keep this working, even though we don't have to.
But, even if this highlights some breaking change and we have to drop
this job, the sentinel will be useful.

Depends-On: https://review.opendev.org/c/openstack/grenade/+/875990
Change-Id: I2b21e7d5f487f65ce4391f5c934046552d01a1e2
2023-03-23 07:16:43 -07:00
Dan Smith
59c85b6a28 Make nova-next reduce mysql memory
This job is known to fail due to OOM in various places, so this makes
it enable the memory footprint reduction flags for devstack that we
already use in the ceph job.

Change-Id: Ibf1bdb55018a329075e31058f83ab95331c84ebb
2023-03-03 06:53:16 -08:00
Dan Smith
84d1f25446 Use mysql memory reduction flags for ceph job
This makes the ceph-multistore job use the MYSQL_REDUCE_MEMORY
flag in devstack to try to address the frequent OOMs we see in that
job.

Change-Id: Ibc203bd10dcb530027c2c9f58eb840ccc088280d
Closes-Bug: #1961068
2023-02-21 08:44:48 -08:00
Ghanshyam Mann
d97af33c06 Enable new defaults and scope checks by default
As discussed in PTG, we need to test the new RBAC in the
integrated gate and accordingly enable the new defaults
and scope check by default. A new integrated testing job
has been added and results show that the new defaults and
scope checks are working fine. During testing, we found a
few bugs in neutron policies but all are fixed now.

enforce_scope and enforce_new_defaults are oslo policy config
options but they are per service level and the default value
can be overridden. Oslo policy 3.11.0 version allows to override
the default value for these config options[1] so upgrading the
oslo policy version in requirements.txt

Depends-On: https://review.opendev.org/c/openstack/devstack/+/869781
Depends-On: https://review.opendev.org/c/openstack/placement/+/869525

[1] https://github.com/openstack/oslo.policy/blob/3.11.0/oslo_policy/opts.py#L125

Change-Id: I977b2daedf880229c8d364ca011f2ea965b86e3a
2023-01-10 23:37:13 -06:00
Zuul
3ec23d3f37 Merge "Update gate jobs as per the 2023.1 cycle testing runtime" 2022-12-20 16:24:47 +00:00
Ghanshyam Mann
2aa779016d Temporary skip some volume detach test in nova-lvm job
A few tests related to volume detach are timeout in
nova-lvm job (failing 100%[1]). Root cause of timeout is not
known and it may take time to find and fix the issue. To unblock
gate and keep runing rest of the tests in lvm job, let's skip
the failing tests until they are fixed.

Related-Bug: #1998148

[1] https://zuul.opendev.org/t/openstack/builds?job_name=nova-lvm&branch=master&skip=0

Change-Id: Id29ce352df84168d0a45512e2c59820aefc75943
2022-11-28 17:54:45 -06:00
Ghanshyam Mann
58500c9967 Update gate jobs as per the 2023.1 cycle testing runtime
As per 2023.1 testing runtime[1], we need to test on Ubuntu
Jammy (which will be taken care by tempest and devstack patches
to move base jobs to Jammy) and at least single job to run on
Ubutnu Focal (for smooth upgrade). Also, python 3.10 testing is
voting now.

This commit adds a new job to run on focal which can be removed
in future cycle when testing runtime drop the requirement of Focal
testing. Also, make python 3.10 functional and unit test job as voting
(openstack-tox-py310 is running as part of generic template so we do
not need to explicitly add that)

[1] https://governance.openstack.org/tc/reference/runtimes/2023.1.html

Change-Id: Ia43f73dba00b0b5932939bcc7d11b97a83072ee3
2022-11-22 13:44:26 -06:00
Dan Smith
010983e803 Test ceph-multistore with a real image
This inflates the cirros image to 1G for a more realistic scenario.
Technically we should have been doing something like this all along,
as the deployment guidance for ceph is to use a raw image, not a qcow2
one, so this also increases our accuracy to real-life.

We also need to up the volume size tempest uses for various tests
to make sure we will fit.

Change-Id: I5c447e630aaf1413a5eac89c2e8103506d245221
2022-11-09 11:34:02 -08:00
Dan Smith
7e960b125e Enable glance location tests on ceph-multistore
Change-Id: I5672d2e1352bd5236a92630234e1261a782bc539
Depends-On: https://review.opendev.org/c/openstack/tempest/+/861390
2022-11-02 13:26:29 -07:00
Zuul
ce15e7fa68 Merge "Remove the periodic Centos 8 job" 2022-10-05 04:58:19 +00:00
afariasa
6aea9f3772 Remove the periodic Centos 8 job
Centos 9 fips tests are already merged on Nova and Centos 8 jobs were already replaced by Centos 9,
this patch will delete a Centos 8 periodic pipeline that should have been deleted on previous patcc.

Change-Id: Ib735e9b52915639006bb08424d83f8ee39113d4f
2022-10-03 11:49:45 +00:00
c48b75c459 Switch to 2023.1 Python3 unit tests and generic template name
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for antelope. Also,
updating the template name to generic one.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Ieecbed5216c1ed47743bc2b74745c0a91bb105a3
2022-09-16 10:02:19 +00:00
Zuul
72f7e89db1 Merge "Test setting the nova job to centos-9-stream" 2022-09-14 13:26:08 +00:00
Jay Faulkner
c7b865c79b nova-live-migration tests not needed for Ironic
Ironic does not support live migration, so we will skip these tests
if the only changed files are in Ironic virt driver to ensur we
don't waste resources or time trying to run unneeded tests.

Change-Id: Ieb5ac3bb93af6a950acff4d76d0276096a6a24dd
2022-08-17 11:31:39 -07:00
Balazs Gibizer
bf654e3a4a Remove double mocking... again
I thought we fixed all the double mocking issues with
I3998d0d49583806ac1c3ae64f1b1fe343cefd20d but I was wrong.

While we used both mock and unittest.mock the fixtures.MockPatch
used the mock lib instead of the unittest.mock lib.
The path Ibf4f36136f2c65adad64f75d665c00cf2de4b400 (Remove the PowerVM driver)
removed the last user of mock lib from nova. So it is also
removed the mock from test-requirements. This triggered that
fixtures.MockPatch athat started using unittest.mock too.

Before Ibf4f36136f2c65adad64f75d665c00cf2de4b400 a function can be mocked
twice once with unittest.mock and once with fixtures.MockPatch (still
using mock). However after that patch both path of such double
mocking goes through unittest.mock and the second one fails.

So this patch fixes double mocking so far hidden behind
fixtures.MockPatch.

Also this patch makes the py310 and functional-py310 jobs voting at
least in the check queue to prevent future changes adding double mocks.

Change-Id: Ic1352ec31996577a5d0ad18a057339df3e49de25
2022-08-08 19:50:02 +02:00
Ade Lee
9a7028f02c Test setting the nova job to centos-9-stream
Depends-On: https://review.opendev.org/c/openstack/tempest/+/831607

Change-Id: Ic8da6ee0313a911d742190ea5b0d4362cb6aef2f
2022-07-13 14:08:03 +00:00
Sylvain Bauza
4fb2aa4682 zuul: Put Centos9 Stream job periodic-weekly and experimental
This patch is a followup on 45c0a3884b6b4c0b9a6b1b3cef47651f5504502e

As agreed on the Nova weekly meeting [1], we won't put back C9S job to voting
and we'll rather put it on both experimental and periodic-weekly pipelines.
In order to insure we will monitor the status of those runs, we'll check
the status of the job during every Nova meeting happening weekly.

In order to trigger potential race conditions, it was acted to provide an
experimental job for C9S too.

[1] https://meetings.opendev.org/meetings/nova/2022/nova.2022-07-05-16.00.log.html#l-52

Change-Id: I2de4d90202fd7e735026150f79409d51f2d70e0e
2022-07-12 09:58:39 +02:00
Sean Mooney
cbf9b2b873 update nova-next and nova-ovs-hybrid-plug to disable linuxbridge
neutron now declares linuxbridge experimental and requires
it to be enabled by a new config option. We do not set
that in these jobs so the neutron server fails to load
since we enable the linux bridge mech driver.

we do not actully use linuxbridge in these jobs so this patch
just disables the mech driver.

Change-Id: I129a850c3327498d26d899c7709f5749622afdd8
Closes-Bug: #1980948
2022-07-07 12:46:32 +01:00
Sylvain Bauza
45c0a3884b zuul: Temporarly put Centos9 Stream job non-voting
Due to the bug below, all the nova patches are failing. I accordingly
propose to make the job non-voting as it would allow our gate to ressurect.

Of course, this is a transient solution and we need a proper fix for the
job in order to have Centos 9 Stream support back in place ASAP.

When the job is back OK, please make it voting again by reverting this patch.

Change-Id: I5c3fff65fd6d9e4f3632d1ec62ae3f1f9cfbe626
Related-Bug: #1979047
2022-06-17 12:04:13 +02:00
Lee Yarwood
512aab83c8 Revert "zuul: Skip block migration with attached volumes tests due to bug #1931702"
This reverts commit 7c478ac0992d9713c0fd7ea0a0498f0b7f92ce0d.

With the resolution of bug #1945983 in devstack we should also be able
to start testing block migration with attached volumes once again.

Closes-Bug: #1931702
Depends-On: https://review.opendev.org/c/openstack/devstack/+/812391
Depends-On: https://review.opendev.org/c/openstack/devstack/+/812925
Change-Id: I1cb7a8f76c372d19227315361ecf5ff730ec6c36
2022-05-18 11:23:35 +00:00
Zuul
4939318649 Merge "Drop lower-constraints.txt and its testing" 2022-05-17 00:01:41 +00:00
Zuul
a4312a67f9 Merge "Add Python 3.10 functional jobs" 2022-05-13 15:15:46 +00:00
Stephen Finucane
9063e3a1fd Add Python 3.10 functional jobs
These are currently non-voting since we don't care about this stuff for
Zed. It does get us ready for a 3.10-having future, however.

Change-Id: I7740dafd6523eca27fa4e725d7eaf8558e434779
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2022-05-06 15:53:09 +00:00
Balazs Gibizer
a3a593ad55 Enable live_migration_events in nova-ovs-hybrid-plug
The flag was added to prevent the source host neutron agents to trigger
a vif-plugged event too early during a live migration. But actually it
can be used in a more generic sense as the code filter on migration_to
binding profile attribute.

We saw too early vif-plugged events from neutron during evacuation in
post part of the nova-ovs-hybrid-plug job. So this patch enables the
workaround flag for this job too.

Closes-Bug: #1971563
Change-Id: Ifd20ece3a4f126da16f077247c2f1e072edb7163
2022-05-04 14:20:56 +02:00
Ghanshyam Mann
4c339c10e3 Drop lower-constraints.txt and its testing
As discussed in TC PTG[1] and TC resolution[2], we are
dropping the lower-constraints.txt file and its testing.
We will keep lower bounds in the requirements.txt file but
with a note that these are not tested lower bounds and we
try our best to keep them updated.

[1] https://etherpad.opendev.org/p/tc-zed-ptg#L326
[2] https://governance.openstack.org/tc/resolutions/20220414-drop-lower-constraints.html#proposal

Change-Id: Ifbc383f6d4c858189cee55e67b4d4274d9c3358a
2022-04-29 20:56:30 -05:00
Zuul
833022a74b Merge "Add nova-emulation to the experimental queue too" 2022-04-29 11:55:48 +00:00
Ghanshyam Mann
5f5551448d Move centos stream testing to centos-9-stream
In Zed cycle testing runtime, we are targetting the centos 9 stream
- https://governance.openstack.org/tc/reference/runtimes/zed.html

With dropping the python 3.6 support, project started adding python 3.8
as minimum, example nova:
- 56b5aed08c/setup.cfg (L13)

with that, centos 8 stream job is failing 100%
- https://zuul.openstack.org/build/970d029dc96742c3aa0f6932a35e97cf
- https://zuul.openstack.org/builds?job_name=tempest-integrated-compute-centos-8-stream&skip=0

QA is dropping the centos-8-stream testing and support
- https://review.opendev.org/q/topic:drop-c8s-testing

This commit replace tempest-integrated-compute-centos-8-stream job to
tempest-integrated-compute-centos-9-stream.

Depends-On: https://review.opendev.org/c/openstack/tempest/+/839274
Change-Id: I516b9d732ccea6e12904a1612530bce273d06587
2022-04-25 18:11:12 -05:00
Ghanshyam Mann
7c8b800867 Update python testing as per zed cycle teting runtime
In Zed cycle, we have dropped the python 3.6/3.7[1] testing
and its support. Removing the py36 centos8 job as well as
updating the python classifier also to reflect the same.

[1] https://governance.openstack.org/tc/reference/runtimes/zed.html

Change-Id: Iba5074ea6f981a7527e86cfc98edd1ed7dd3086f
2022-04-21 22:06:22 +00:00
Balazs Gibizer
abfd692285 Add nova-emulation to the experimental queue too
This job was moved to periodic in the past to save CI resources. However
sometimes it can be valuable to trigger it on a given review. To be able
to do that easily this patch also adds the job to the experimental
queue.

Then the following gerrit comment can be used to trigger it:
        check experimental

Change-Id: I6a018b57de5afe772c2478aff836b39227dce228
2022-04-06 12:12:06 +02:00
Zuul
ac0cec7c05 Merge "Move FIPS jobs to experimental and periodic queue" 2022-03-29 06:23:19 +00:00
Zuul
de10013328 Merge "Add Python3 zed unit tests" 2022-03-19 11:29:29 +00:00
Zuul
dde15d9c47 Merge "Attempt to thin out nova-ceph-multistore" 2022-03-15 00:33:56 +00:00
Dan Smith
16a463a68f Attempt to thin out nova-ceph-multistore
This job is pretty heavy and has been triggering OOMs that take out
mysqld lately. This disables swift (and c-bak as a result) to try to
reduce the runtime footprint. Losing coverage of these services
should not be a problem for the goal of this job.

Change-Id: Icc18ddd847465069aea34b226851afaeb94594fc
2022-03-14 11:48:00 -07:00
afariasa
6ab6969550 Move FIPS jobs to experimental and periodic queue
Change-Id: Id8d29ac00102c958ddc6f8d0c217fb11282a7d08
2022-03-14 11:54:51 +00:00
3d20fd3fd1 Add Python3 zed unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for zed.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Ia141d43de268b1153b157b1adccb111955f36fd6
2022-03-11 09:54:50 +00:00
Jonathan Race
43f13acab5 Changes Emulation CI to weekly-periodic
Due to initial release of emulated architecture feature the CI
has been changed to run less frequent to save CI hours. This
will be revisited in later releases as feature gains greater
support and capabilities.

Implements: blueprint pick-guest-arch-based-on-host-arch-in-libvirt-driver
Signed-off-by: Jonathan Race <jrace@augusta.edu>
Change-Id: I7b085c2086a720a049c9b04a6ff10a0e5cc9d650
2022-03-10 13:21:50 -05:00
Zuul
3d9d328727 Merge "Add grenade-skip-level irrelevant-files config" 2022-03-07 20:36:44 +00:00
Zuul
1fe1624e95 Merge "Enable unified limits in the nova-next job" 2022-03-05 07:25:29 +00:00