324 Commits

Author SHA1 Message Date
Sean Mooney
aca63b66e5 Test live migration between hosts with differnet cpu_shared_sets
This change modifes the nova-live-migration job to define
[compute]cpu_shared_set to different ranges on the controller
and compute node. in ci we have 8 cpus so the controller is set
to 0-5 and the compute uses 2-7

6 cores with our default allocation ratio should be sufficent
for our current level of concurrancy. This change also adds
the remaining cores as cpu_dedicated_set, they will currently
be unused but are thre if we want to enable pinned cpu testing
in the future.

Change-Id: I0d8463cf584d6ac141a5e1cb492d17996db458e0
2024-08-30 01:31:45 +00:00
Sean Mooney
804bc98759 update nova-next to use ubuntu 24.04
This change updates the nova-next nodeset
to use openstack-two-node-noble and revert to
using qemu without nested virt.

using nested virt was a tempory messure to mitigate the kernel
panics we were seeing related to volume detach while we also explored
using split kernel images. since then we have reverted the other
jobs back to using normal whole disk images and we have not
seen a marked uptic in kernel panics.

as such this change drop the use of nested virt since the other jobs
are not using it an updates the nodeset to move nova-next to test on
ubuneu 24.04 (noble) on python 3.12

Depends-On: https://review.opendev.org/c/openstack/devstack/+/922427
Change-Id: I5059ba3c519efb18947a8f3d24868ce1c9289e3d
2024-08-30 02:29:38 +01:00
Sean Mooney
c69a9eb87f Skip new image format tests
The nova-ceph-multistore job is currently
not configured properly for the new image format
tests. This change skips them until we decided
how to fix this.

Change-Id: I3de7588ba224453c24beabf8a799c71677603ba7
2024-08-13 19:32:47 +01:00
Zuul
73012258e7 Merge "[CI] Replace deprecated regex" 2024-07-24 23:38:49 +00:00
Dan Smith
c0ff2386ed Fix disk_formats in ceph job tempest config
Tempest currently defaults to disk_formats[0] for images it creates,
which is 'ami'. However, it's actually using a qcow2 disk image by
default, which means we're lying to glance when we create those.

Change-Id: I737e9aa51c268a387f1eed24cf717618d057d747
2024-07-02 12:52:36 -07:00
Elod Illes
9b77bae8a3 [CI] Replace deprecated regex
Latest Zuul drops the following warnings:

  All regular expressions must conform to RE2 syntax, but an
  expression using the deprecated Perl-style syntax has been detected.
  Adjust the configuration to conform to RE2 syntax.

  The RE2 syntax error is: invalid perl operator: (?!

This patch replaces the 'irrelevant-files' to 'files' with explicitly
listing the pattern which files should be the tests run against.

Change-Id: If287e800fb9ff428dbe6f9c4c046627f22afe3df
2024-06-18 16:18:33 +02:00
Sean Mooney
3811c7f648 tweak emulation job to avoid OOM errors
This change increases the swap in the emulation job form
1G to 8G
This change updates the default cirrors image form 0.5.2
to 0.5.3 to avoid know kernel bugs
this change reduces the tb_cache_size: to 128
The tempest concurrency is reduced to 4 to avoid
no valid host error in the resize tests

Change-Id: Ic1dde3d54f5ca12408ef53218773a27d55760705
2024-05-27 14:19:02 +01:00
Zuul
4e3a41f0a4 Merge "Stop using split UEC image (mostly)" 2024-05-22 19:03:32 +00:00
Zuul
61ad4f1f27 Merge "Enable virtio-scsi in nova-next" 2024-05-20 21:41:24 +00:00
Dan Smith
eed3e2b47f Stop using split UEC image (mostly)
This reverts us back to using the standard disk image for most of our
tests, which is more representative of how people actually use nova.
This leaves the UEC image on a few jobs for the sake of comparison
data for the time being, and because we should actually test that
code path if we're going to say we support it.

Change-Id: I16ed92d342464325d4bef33c1e22b328bcfbe7d6
2024-05-20 08:24:18 -07:00
Dan Smith
84b0a481fe Enable OCaaS for several nova jobs
This uses the OCaaS feature in devstack which saves *minutes* of time
running devstack by effectively caching the openstackclient startup
instead of taking that hit for every invocation.

Change-Id: I78308128c6249f7f871e0231ce717b1ec0f88509
2024-05-20 08:24:18 -07:00
Dan Smith
50b180023f Make python 3.12 unit and functional voting
Change-Id: I6de86f3e3e283ba404f927ea4c8164f791df3989
2024-05-15 12:29:14 -07:00
Dan Smith
32546d9c1b Enable virtio-scsi in nova-next
This lets us test the direct-lun volume attachment model.

Change-Id: Ibc7bff377cc5b5572e2a11006116401babaac347
Depends-On: https://review.opendev.org/c/openstack/tempest/+/918457
2024-05-07 11:49:21 -07:00
Stephen Finucane
8b70e29487 Remove SQLAlchemy tips jobs
The most recent SQLAlchemy and Alembic versions are now in
upper-constraints. As a result, this job has served its purpose and can
be removed. For more information, see [1].

[1] https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/RBHXHTO3GUOOXVSZXD4C2O3TKDOH2QSC/

Change-Id: I9d0261aad8dbca3f05600c8d8879411be232886e
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
Depends-on: https://review.opendev.org/c/openstack/requirements/+/879743
2024-04-12 11:41:45 +01:00
Sean Mooney
3b25b1e94c add multinode ironic shard job
This change adds the
ironic-tempest-ipa-wholedisk-direct-tinyipa-multinode-shard
to the periodic-weekly and experimental pipelines replacing
the existing ironic-tempest-ipa-wholedisk-direct-tinyipa-multinode
job in the experimental line.

&policies-irrelevant-files is moved to the job defintions to
make workign on jobs simpler when commeting out jobs during devleopemt
yes this is unrelated but it make our lives simpler.

Change-Id: I1ee8f7f7d0cbcfb3a8cd61b5fec201b4ba4bf671
2024-03-01 00:20:40 +00:00
Sean Mooney
e123055530 bump nova-lvm to use 8G of swap from 4G
nova-lvm ocationally has OOM events causing
g-api to get killed. This can result in test failures
with a 502 form glance so we bump the swap to 8G
like the ceph jobs to avoid that.

Change-Id: Ib88f9feb692ee440b8f73e9b3dca56c08dadb665
2024-02-19 16:54:04 +00:00
Zuul
fed123085d Merge "Lower num_pcie_ports to 12 in the nova-next job" 2024-01-11 05:00:33 +00:00
melanie witt
d3181bf202 Set UEC image vars for jobs not defined in Nova
This is another follow up for change
I1a6468fbfa51eedec0ab91d73f313784a9a618a0 which missed setting the
*uec_image_vars for jobs that are not defined in Nova. For example,
the tempest-integrated-compute job is not defined in Nova and if we
don't set *uec_image_vars for it, it will not use the UEC image and
will instead use the default full image.

This also sets *uec_image_vars for one job defined in Nova,
nova-osprofiler-redis, that was missed in the original change.

Change-Id: Ia8741d46c28277e9addadf0e2a568c3ad86fb8dc
2023-12-06 19:01:06 +00:00
melanie witt
07d4138a43 Remove redundant setting of DEFAULT_IMAGE_NAME(_FILE)
This is a follow up for change
I1a6468fbfa51eedec0ab91d73f313784a9a618a0 which had residue from an
earlier PS that set DEFAULT_IMAGE_NAME and DEFAULT_IMAGE_FILE_NAME
intended to override project.vars. The project.vars approach did not
work because we needed to set IMAGE_URLS as well and the
devstack-tempest ancestor job sets IMAGE_URLS which overrides
project.vars.

The approach was changed to use YAML anchors instead of project.vars to
reduce duplication, which made the setting of DEFAULT_IMAGE_NAME and
DEFAULT_IMAGE_FILE_NAME in nova-next redundant as the default values
from Devstack can be used.

This removes the setting of DEFAULT_IMAGE_NAME and
DEFAULT_IMAGE_FILE_NAME in nova-next.

Change-Id: I3929b6c55d77575a6c0bd205f933cc2a690db91e
2023-12-05 22:30:52 +00:00
melanie witt
326279962b Use split kernel/initramfs Cirros UEC image by default in jobs
This change is in attempt to reduce the occurrence of guest kernel
panics in the APIC timer handler that we have been seeing in job
failures more recently.

We will try using the split kernel/initramfs image by default for jobs
and use the full disk image in the nova-next job to cover testing of
the full image.

The approach follows the example of CI improvements that were made in
the Neutron project in the past:

  https://review.opendev.org/c/openstack/neutron/+/843237
  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/821067

Depends-On: https://review.opendev.org/c/openstack/tempest/+/902609

Change-Id: I1a6468fbfa51eedec0ab91d73f313784a9a618a0
2023-12-05 07:24:48 +00:00
melanie witt
283eece679 Lower num_pcie_ports to 12 in the nova-next job
This change is being proposed in response to guest kernel panics that
are happening occasionally in the nova-next CI job. In these particular
cases, we see messages like the following in the guest console log dump
[1]:

  pci 0000:00:03.6: BAR 13: no space for [io  size 0x1000]
  pci 0000:00:03.6: BAR 13: failed to assign [io  size 0x1000]

which seems to indicate the guest is running out of memory to allocate
to the pcie devices.

This lowers num_pcie_ports to 12 from 24 in an effort to use less
memory.

[1] https://pastebin.com/raw/cVDem0Xr

Change-Id: Ibfa65a00dd91e6c3f28fef837a7e172221f72f42
2023-11-29 17:14:09 +00:00
Zuul
e5e5e00579 Merge "Make sqlalchemy-2x job voting again" 2023-11-14 18:24:48 +00:00
Zuul
338ee65c4c Merge "Fix unit tests broken by olso.utils" 2023-11-10 02:55:21 +00:00
Takashi Kajinami
f4f056dda8 Make sqlalchemy-2x job voting again
... because the new oslo.utils version is now used in CI.

Depends-on: https://review.opendev.org/c/openstack/requirements/+/900517
Related-Bug: #2042886
Change-Id: I916a2b64d8d611f0e2bd4583bbe68fdc3bd00511
2023-11-09 15:49:10 +00:00
Takashi Kajinami
e04d20a8bc Fix unit tests broken by olso.utils
Some of the object unit tests grub Mock object unintentionally, and
that results in failure during initializing an versioned object,
because the Mock object does not present its version correctly.

This fixes that problem

The sqlalchemy-2x job is made non-voting because this job requires
oslo.utils 6.3.0 which is blocked by this problem.

Closes-Bug: #2043116
Related-Bug: #2042886
Change-Id: Id1c1b77c020e2d8f0ac61c2aee86c9f37d388d53
2023-11-09 15:41:57 +00:00
Sylvain Bauza
b64ecb0cc7 Adding server actions tests to grenade-multinode
We recently found a rolling-upgrade bug on rebuild so we need to make
sure that grenade-multinode can verify all our instance actions.

Given we pin the compute RPC API version to the N-1 compute one, we are
sure that all RPC calls continue to behave the previous release.

NOTE : Given the previous cycle was already supporting 6.2 RPC version,
we can't test here the previous problems hence why this is the last
patch from the series.

Change-Id: I1d8deb139922494dd74ff32965fd7dd74d1d768b
Related-Bug: #2040264
2023-10-30 10:17:57 -07:00
Zuul
16d4e1d455 Merge "disable ovn based testing of test_live_migration_with_trunk" 2023-10-29 21:06:30 +00:00
Dan Smith
82f4da91ab Compile mdev samples for nova-next
Change-Id: If44964f2b99ee0482600ec31e85ea1d4caeea1b3
2023-10-12 08:57:35 -07:00
Zuul
9246630058 Merge "Add job to test with SQLAlchemy master (2.x)" 2023-10-03 16:00:57 +00:00
Stephen Finucane
ed6563b078 Add job to test with SQLAlchemy master (2.x)
Change-Id: I9ae3ddc7e57d2afcfc9dad49e3361080f8145357
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2023-09-22 11:15:56 +01:00
Sean Mooney
c290a6ed75 disable ovn based testing of test_live_migration_with_trunk
due to bug #1940425 where ml2/ovn is not correctly configuring the
active status on trunk port we see test_live_migration_with_trunk
fail more often then not.

This was previously disbaled in tempest and then fixed in neutorn.
the tempest skip was then reverted and so was the neutron fix as
it broke somethign else... so this is failing in our gate again.

This change skips test_live_migration_with_trunk on all jobs that
are using ml2/ovn but keeps it enabled on the hybrid plug job
which uses ml2/ovs.

Related-Bug: #1940425
Change-Id: I0a8dd6e6e30526aa2841b4db67ed9affed166fd8
2023-09-18 13:49:59 +01:00
Amit Uniyal
c486cc89dc Make our nova-ovs-hybrid-plug job omit cinder
modifies nova-ovs-hybrid-plug job to disable cinder and swift to
ensure we test for this going forward.

Change-Id: I52046e6f7acdfb20eeba67dda59cbb5169e5d17e
2023-09-13 12:23:43 -07:00
Zuul
927eeb54f2 Merge "Remove n-v ceph live migration job from gate" 2023-08-21 22:18:09 +00:00
Zuul
74a2da32c6 Merge "Add integrated job to test the Nova RBAC old defaults" 2023-08-01 21:15:52 +00:00
Zuul
a612688124 Merge "Add nova-tox-functional-py310 to gate jobs" 2023-08-01 11:50:09 +00:00
Dan Smith
f2a10afb64 Remove n-v ceph live migration job from gate
This job is marked as non-voting in the parent definition, which
causes us to run it in gate as non-voting, which is just a waste of
resources. Remove it from the gate queue until it is marked as voting
in the definition (or maybe consider just leaving it out).

Depends-On: https://review.opendev.org/c/openstack/devstack/+/890136
Change-Id: I2ddbafe851be2c7826d78613f12560a1713ac1b1
2023-07-31 09:12:50 -07:00
Zuul
b6f4c57b43 Merge "Drop Fedora support" 2023-07-18 17:49:07 +00:00
3f7cc63d94 Add config option to configure TB cache size
Qemu>=5.0.0 bumped the default tb-cache size to 1GiB(from 32MiB)
and this made it difficult to run multiple guest VMs on systems
running with lower memory. With Libvirt>=8.0.0 it's possible to
configure lower tb-cache size.

Below config option is introduced to allow configure
TB cache size as per environment needs, this only
applies to 'virt_type=qemu':-

[libvirt]tb_cache_size

Also enable this flag in nova-next job.

[1] https://github.com/qemu/qemu/commit/600e17b26
[2] https://gitlab.com/libvirt/libvirt/-/commit/58bf03f85

Closes-Bug: #1949606
Implements: blueprint libvirt-tb-cache-size
Change-Id: I49d2276ff3d3cc5d560a1bd96f13408e798b256a
2023-07-13 19:35:52 +05:30
Sean Mooney
6f56c5c9fd enable validations in nova-lvm
As of I8ca059a4702471d4d30ea5a06079859eba3f5a81 validations
are now requried for test_rebuild_volume_backed_server.
Validations are also required for any volume attach/detach based test
in general due to know qemu issues.

This patch just turns them back on to unblock the gate.

Closes-Bug: #2025813
Change-Id: Ia198f712e2ad277743aed08e27e480208f463ac7
2023-07-04 15:49:11 +00:00
jskunda
86c542c56a Drop Fedora support
We are about to drop Fedora support as the latest image in upstream
has been transitioned to EOL. Centos 9 Stream has evolved as
replacement platform for new features. Patch which removes fedora
jobs and nodeset from devstack:
https://review.opendev.org/c/openstack/devstack/+/885467

Change-Id: Ib7d3dd93602c94fd801f8fe5daa26353b04f589b
2023-06-21 23:58:44 +02:00
Ghanshyam Mann
aeddcd61fd Add integrated job to test the Nova RBAC old defaults
Nova has enabled the scope checks and new defaults in
antelope release and now devstack is switching the testing
to new defaults by default (depends-on). With that all the
jobs will run the the new defaults.

As old defaults are still supported (as deprecated), we should
test those at least in a single integrated job. Adding
new job tempest-integrated-compute-rbac-old-defaults to test those
old defaults.

Keeping existing job enabling the new defaults because other services
have not switched to new defaults yet to this job enable new defaults
for those service and test Nova against that.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/883601
Change-Id: Ifc3d0abe3e4caab701b695d3781f20ab3dba267d
2023-05-23 03:30:40 +00:00
Dan Smith
6ff3237149 Bump nova-ceph-multstore timeout
The recent change(s) to enable a lot more SSHABLE checks puts the
runtime of the ceph job really close to the 2h timeout even when
things are working. Sometimes it times out before it finishes even
though things are progressing. Bump the timeout to avoid that.

Also bump us to 8G swap to match what is set on the parent ceph job
when we upgraded to jammy. We could just unset this, but better to
pin it high in case that job (defined elsewhere) changes. Our job
is the largest ceph job, so it makes sense that it keeps its own
swap level high.

Change-Id: I6cefd87671614d87d92e4675fbc989fc9453c8b9
2023-05-10 17:54:38 -07:00
Elod Illes
b50bcdf2b2 Add nova-tox-functional-py310 to gate jobs
Change-Id: I1da1ed56e32a754a4e5c9aeba09b62aef3401596
2023-05-02 11:35:59 +02:00
Dan Smith
2f86a8a088 Remove focal job for 2023.2
Neutron also flipped to python>=3.9 on all their repos this morningi[1]
which means we can't install neutron on focal at all. I'm not sure if
that's going to get reverted at this point, but even if it is, it's
going to take a while to undo. As noted in the comments and the
original commit[2] that added this job, it was intended to be removed
when we dropped focal from the test interface, which we have now done.

1: https://review.opendev.org/q/topic:bug%252F2017478
2: https://review.opendev.org/c/openstack/nova/+/861111

Change-Id: I5be638a702629e07ec9c88bd67bb9b7f1212f7fc
2023-04-24 15:25:32 -07:00
Dan Smith
402b155043 Add grenade-skip-level-always to nova
This makes us test N-2->N even for non-SLURP releases. Ideally we
would continue to keep this working, even though we don't have to.
But, even if this highlights some breaking change and we have to drop
this job, the sentinel will be useful.

Depends-On: https://review.opendev.org/c/openstack/grenade/+/875990
Change-Id: I2b21e7d5f487f65ce4391f5c934046552d01a1e2
2023-03-23 07:16:43 -07:00
Dan Smith
59c85b6a28 Make nova-next reduce mysql memory
This job is known to fail due to OOM in various places, so this makes
it enable the memory footprint reduction flags for devstack that we
already use in the ceph job.

Change-Id: Ibf1bdb55018a329075e31058f83ab95331c84ebb
2023-03-03 06:53:16 -08:00
Dan Smith
84d1f25446 Use mysql memory reduction flags for ceph job
This makes the ceph-multistore job use the MYSQL_REDUCE_MEMORY
flag in devstack to try to address the frequent OOMs we see in that
job.

Change-Id: Ibc203bd10dcb530027c2c9f58eb840ccc088280d
Closes-Bug: #1961068
2023-02-21 08:44:48 -08:00
Ghanshyam Mann
d97af33c06 Enable new defaults and scope checks by default
As discussed in PTG, we need to test the new RBAC in the
integrated gate and accordingly enable the new defaults
and scope check by default. A new integrated testing job
has been added and results show that the new defaults and
scope checks are working fine. During testing, we found a
few bugs in neutron policies but all are fixed now.

enforce_scope and enforce_new_defaults are oslo policy config
options but they are per service level and the default value
can be overridden. Oslo policy 3.11.0 version allows to override
the default value for these config options[1] so upgrading the
oslo policy version in requirements.txt

Depends-On: https://review.opendev.org/c/openstack/devstack/+/869781
Depends-On: https://review.opendev.org/c/openstack/placement/+/869525

[1] https://github.com/openstack/oslo.policy/blob/3.11.0/oslo_policy/opts.py#L125

Change-Id: I977b2daedf880229c8d364ca011f2ea965b86e3a
2023-01-10 23:37:13 -06:00
Zuul
3ec23d3f37 Merge "Update gate jobs as per the 2023.1 cycle testing runtime" 2022-12-20 16:24:47 +00:00
Ghanshyam Mann
2aa779016d Temporary skip some volume detach test in nova-lvm job
A few tests related to volume detach are timeout in
nova-lvm job (failing 100%[1]). Root cause of timeout is not
known and it may take time to find and fix the issue. To unblock
gate and keep runing rest of the tests in lvm job, let's skip
the failing tests until they are fixed.

Related-Bug: #1998148

[1] https://zuul.opendev.org/t/openstack/builds?job_name=nova-lvm&branch=master&skip=0

Change-Id: Id29ce352df84168d0a45512e2c59820aefc75943
2022-11-28 17:54:45 -06:00