14866 Commits

Author SHA1 Message Date
Zuul
571959dd2b Merge "Use stable constraint in tox to release Tempest new tag" 40.0.0 2024-09-04 08:20:36 +00:00
Martin Kopec
b7ab42af30 Use stable constraint in tox to release Tempest new tag
We are going to release Tempest new tag which work with
the stable/2024.1 constraint so use that in the tox env.

For example: if anyone use Tempest new tag in future say
1 year later then tox env also should use the 2024.1 contstraint for
compatibility instead master.

These need to be move back to master constraint once release is done.

Change-Id: I4e8fe7650f088ecbbbb279c35f8931c71de4ece1
2024-09-03 23:46:32 +02:00
Zuul
f03c90109e Merge "Skip the glance vmdk-footer test for now" 2024-09-03 21:34:50 +00:00
Zuul
b34c45f884 Merge "Fix misuse of assertIsNone" 2024-09-03 20:23:26 +00:00
Martin Kopec
3ba975fce2 Add release notes for 2024.2 cycle intermediate release
This is to make new functionality available to plugins
and other consumers.

Change-Id: Ic49a928f26a368c7119e96b0d809da6c9721c672
2024-09-03 16:08:32 +02:00
Takashi Natsume
df14157e3a Fix misuse of assertIsNone
Change-Id: I6f52e4dc7c7d0668ee2a401632cce51795a5aee2
Signed-off-by: Takashi Natsume <takanattie@gmail.com>
2024-09-01 07:54:13 +00:00
Dan Smith
3d41c31a02 Skip the glance vmdk-footer test for now
Glance did not initially support the vmdk-with-footer image format,
but will after it moves to the oslo version of format-inspector. So,
skip this test if it fails, to account for older versions.

Needed-By: https://review.opendev.org/c/openstack/glance/+/927291
Change-Id: Ieb20fc63ccc65769778e6303bd321837dc57169f
2024-08-28 10:04:03 -07:00
Dan Smith
f6bb9d1e4b Support proper image import ISO format testing
This makes the image import format test not skip ISO and assert that
the import conversion process does not change it from iso to something
else.

Depends-On: https://review.opendev.org/c/openstack/glance/+/923676
Change-Id: I2e88b0a086838d68055ac9a5808b84c8dc1efc2e
2024-08-28 06:59:38 -07:00
Dan Smith
32da46943e Allow nova vmdk-footer test to pass
Nova originally did not support vmdk-with-footer and the test asserted
that fact. Now we need to fix nova and have this test work with both
fixed and non-fixed code. Since the tests are not split by image
format, we can easily skip in the case where an image is marked as
usable, but fails in a known way, which will allow us to pass the
job with and without a fixed nova.

Change-Id: I71268fa915055300e1cb42e592bc62a1f276d733
2024-08-26 07:19:59 -07:00
Zuul
76c925aab7 Merge "Add configurable hostname pattern to filter hosts" 2024-08-20 19:46:21 +00:00
jamepark4
9d8d631bdd Add configurable hostname pattern to filter hosts
Currently when aggregating potential target hosts via
get_host_other_than, it's hostname filtering only addresses the suffix
'-ironic'. In the event that pattern is located within the hostname e.g.
nova-cell1-compute-ironic-compute-0, then it will still be used as a
target candidate. Update tempest to allow for a configurable hostname
pattern to filter on when searching for candidates.

Also updated additional testcases that are still using the suffix only
check when removing guests with ironic in the name.

Change-Id: If5bab817e04412512186be2195cd2437bd310980
2024-08-16 10:06:44 -04:00
Zuul
a996eecba5 Merge "Skip iso image import testing for now" 2024-08-16 01:50:31 +00:00
Dan Smith
e248a157c2 Skip iso image import testing for now
Glance previously would fail to import ISO images because they could
not be converted by qemu-img. The proper behavior is to give them
special handling and leave them as ISOs without failing, so that
people can use things like web-download to ingest ISOs into glance.
However, the current test asserts that they fail (status=queued) so
we need to skip that case until glance fixes that feature and then we
can test it properly here.

Needed-By: https://review.opendev.org/c/openstack/glance/+/923676
Change-Id: Ia29d4ab7ab923c37db2779255958c4c4da8e8997
2024-08-15 07:19:25 -07:00
Zuul
26c17ff85d Merge "Add early failure detection in devstack-tempest-ipv6" 2024-08-13 21:47:48 +00:00
Zuul
627333b9a5 Merge "Add compute image format test" 2024-08-12 19:10:33 +00:00
Zuul
8d39e1f95e Merge "Test image formats with import" 2024-08-12 19:10:30 +00:00
Zuul
b023865f8a Merge "Test image formats" 2024-08-12 19:01:45 +00:00
Dan Smith
eccd82f311 Add compute image format test
This adds tests to make sure that nova rejects invalid image formats
and also rejects any format when the disk_format does not match the
image content.

Change-Id: I29b1af0a4034decad3d6ec0191460c251a745300
2024-08-09 07:19:12 -07:00
Dan Smith
e8efa4f94d Test image formats with import
This tests our image format samples against glance's import
conversion routine and asserts that it rejects unsafe and unusable
images. Note that glance does not support conversion from iso/udf,
which is called out here in the test.

Depends-On: https://review.opendev.org/c/openstack/glance/+/923624
Change-Id: Ibda8ea567bc81d21add3f72d8e620b34c8726136
2024-08-09 07:19:12 -07:00
Dan Smith
97ef286942 Test image formats
This implements testing of image formats based on the sample images
in os-test-images. We should be able to assert that formats we accept
are allowed by glance and formats that we do not are rejected.

Note that glance currently does not do enough of this validation, so
not nearly enough of the unusable samples are currently rejected,
but this will serve as a base from which to start implementing and
testing that in glance.

This adds testscenarios as a dependency and uses that utility along
with the load_tests() protocol to generate test scenarios from the
manifest file. This results in separate tests for each image format,
without us needing to manually add those cases (and without the risk
of missing some because we don't).

Depends-On: https://review.opendev.org/c/openstack/devstack/+/925425
Change-Id: I4536b6b36b23071447ea8efbfcd2b3a313414034
2024-08-09 07:19:11 -07:00
Katarina Strenkova
0795166adf Fix cleanup of keypairs for --prefix option
When running tempest cleanup --prefix, there is an issue with
cleaning up keypairs, because of incorrect listing of them. This
issue is solved by setting the right dictionary key.

Change-Id: I81da575b0f40d2f04440a322b3b694f332c5d58e
2024-07-31 08:50:40 +00:00
Ghanshyam Mann
7a39bc1551 Add early failure detection in devstack-tempest-ipv6
Early failure detection was added in devstack-tempest job
in https://review.opendev.org/c/openstack/tempest/+/924956
but missed to add ipv6 base job.

Change-Id: I3970ac7d68248b9720a9062e2ebc7915035e52a1
2024-07-30 11:32:57 -07:00
Dr. Jens Harbott
a4a48b2f29 Add early failure detection for tempest base job
Zuul can do better resource allocation if it learns early that a job
will fail even when tests haven't completed yet. This is done by adding
a regular expression that will match on a single failing test within a
tempest run. The regex is copied from what the zuul project has already
been using successfully for some time.

Change-Id: I8c9488a55d04e32384d1523a9658a8711b05c340
2024-07-25 20:37:03 +02:00
Zuul
1af21705c5 Merge "Add wait for location import task" 2024-07-19 07:39:05 +00:00
Zuul
95064194ad Merge "Add test to verify hostname allows FQDN" 2024-07-17 11:17:57 +00:00
Luigi Toscano
b73ead02dc Switch the default disk and container formats to bare/qcow2
The first item of image.disk_formats and image.container_formats
tempest options is used by default if the options are not
specified by the person runnig tempest.
The most likely format to be used and supported are bare and qcow2,
so let's switch to those as default options.

Also, move raw to the second place of disk_formats because
a specific test (test_list_images_param_disk_format from the
tempest.api.image.v2.test_images.ListUserImagesTest class)
requires an image in raw format, but its initializer only
creates a subset of the images (only the first 6 (!) items
of all combinations of container_formats and disk_formats)
which means that raw should be in the first 6 combinations.

Change-Id: Iab3e5205e2ec6cd5a253715ff87853b2805e4819
2024-07-17 01:00:09 +02:00
Pranali Deore
953940288c Add wait for location import task
We are working to get support of new location APIs in glance,
where we are adding hash calculation mechanism once the image
location is added. Since new location api is async,
we need to wait for the task to finish before performing the
cleanup else we will fail due to the existing bug [1].

[1]: https://bugs.launchpad.net/glance/+bug/2045769

Change-Id: Ibde7620c9388fdbc93f741e38c9d63fca44a1bbb
2024-07-15 14:55:26 +00:00
Ashish Gupta
e27a9d6221 Add test to verify hostname allows FQDN
This patch adds a test for verifying that hostname allows
FQDN and can contains periods in hostname starting API microversion 2.94.
This patch also verifies hostname from the metadata api and also checks
hostname allows character length above 64 .

Also, adding a config feature flag dhcp_domain to set the suffix in
order to verify the hostname correctly .

Relates to : https://review.opendev.org/c/openstack/nova/+/869812

Change-Id: If92d4b469bfff4b205801bdd5ea8fd943942b943
2024-07-15 17:43:09 +05:30
Zuul
e47f4457cb Merge "Drop identity v2 api tests" 2024-07-09 18:52:33 +00:00
Zuul
149eabd47e Merge "Fix unit tests cleanup for --resource-list option" 2024-07-09 11:21:28 +00:00
Takashi Kajinami
c0c90279ce Drop identity v2 api tests
These tests can be removed now, because the identity v2 API was removed
from Keystone during Queens cycle and Queens is no longer supported
by current master of tempest.

This also deprecates the related options so that we can drop these
options later.

Change-Id: I0be2273890cecaa26da37624c185c1bd367b2acf
2024-07-09 11:16:56 +09:00
Katarina Strenkova
69f622b108 Fix unit tests cleanup for --resource-list option
This patch fixes the incomplete cleanup of unit tests for
`record_resources()` function. These unit tests are tied with the
tempest cleanup --resource-list option. The issue was the creation
of None file and resource_list.json file while running unit tests.

Closes-Bug: #2070449

Change-Id: Id8ff96606b30d52ad4c8a6bd31bcb09ae03cc963
2024-07-08 12:35:40 +00:00
Zuul
8e7232b740 Merge "Validate [validation] ssh_key_type at config layer" 2024-07-05 08:26:42 +00:00
Zuul
1a7a5a4d80 Merge "Update http_image config option to use latest image" 2024-07-05 01:36:32 +00:00
Zuul
aa57d98fc4 Merge "Test image <-> volume <-> server dependency" 2024-07-04 21:36:40 +00:00
Abhishek Kekane
9eea03cd57 Update http_image config option to use latest image
`http_image config` option of `image` section is still referring
to old cirros image `cirros-0.3.1-x86_64-uec.tar.gz`.

Updated it to use new cirros image `cirros-0.6.2-x86_64-uec.tar.gz`.

Change-Id: I55e2fbd062c476e839fe8404bae18e918e745bc5
2024-07-04 16:55:39 +00:00
Abhishek Kekane
cfdbbb0ac3 Reno for http_qcow2_image config option
Change-Id: I3a03657d155d82d87fef715a138e507670159053
2024-07-04 06:33:28 +00:00
Zuul
4bae4b08cc Merge "Allow visibility of external subnet as shared ones" 2024-07-03 20:51:16 +00:00
Zuul
5e54bf66b3 Merge "extend tempest-integrated-compute and tempest-full-py3" 2024-07-03 20:08:05 +00:00
Zuul
ad6f94cad8 Merge "Introduce new config parameter to download qcow2 image" 2024-07-03 19:59:59 +00:00
Abhishek Kekane
9aa4144e32 Introduce new config parameter to download qcow2 image
Current http_image config format downloads tar.gz image which is no
more useful since recent changes in glance to fix CVE-2024-32498.
It will fail to import the image using web-download method as we
anticipate disk-format is qcow2 but it's not. Same it will further
fail if image_conversion plugin is enabled in the environment.

Introduced new config parameter http_qcow2_image which will by
default has reference to qcow2 image.

Change-Id: Ic07a55edc9a0ae713265220c9711f3dee48093fc
2024-07-03 10:58:47 +00:00
Abhishek Kekane
e1451f4ae0 Provid raw disk-format to images which uses raw data
Recent changes in glance to fix CVE-2024-32498 causes some tests
to fail because those tests assumes disk-format is qcow2 or ami
but it is actually raw and fails to detect the format.

Change-Id: Id92cbcece145426ec95c46649a2f11c3d19ad4bd
2024-07-03 05:23:59 +00:00
Sean Mooney
f207d29e32 extend tempest-integrated-compute and tempest-full-py3
This change adds 30mins to the timeout to account
for timeouts on slow nodes and gather more data.

once stabilised we should consider
enabling zswap, or adding more swap to account
for OOM issues thereby allowing a higher concurrency
to reduce overall execution time.

Change-Id: I9529f554acb5b67401ed1cb8700a916c7131ec02
2024-07-02 19:55:23 +01:00
Rajat Dhasmana
ea914a22e2 Test image <-> volume <-> server dependency
This patch adds a test where we test the following workflow:
1. Create image
2. Create a bootable volume from Image
3. Launch an instance from the bootable volume
4. Take snapshot of the instance -- which creates the volume snapshot
5. Delete the image

In the above workflow, steps 2 and 3 are performed together as we
create the instance as volume backed providing the image ID to
instance create call.

Change-Id: Ie9c27e7e7305147b7081c5f1dcc8f1631081fda5
2024-07-02 22:09:57 +05:30
Zuul
6b8ff89c8f Merge "Fix missing space in parameter description" 2024-07-02 12:46:00 +00:00
Zuul
0bb9f6de1a Merge "Remove deprecated alias of test decorators (2/2)" 2024-07-02 11:48:20 +00:00
Zuul
3a922be8a8 Merge "Use 'tempest run --slowest' in integrated-compute (again)" 2024-07-02 11:48:17 +00:00
Zuul
36e0b2a714 Merge "Log request-id in test_delete_server_while_in_verify_resize_state test" 2024-07-02 11:27:13 +00:00
Zuul
5fb37931dd Merge "Adds placement resource provider traits API calls" 2024-07-02 09:15:24 +00:00
Zuul
832ce91985 Merge "Adds placement trait api calls" 2024-07-02 09:15:20 +00:00