14845 Commits

Author SHA1 Message Date
Katarina Strenkova
0795166adf Fix cleanup of keypairs for --prefix option
When running tempest cleanup --prefix, there is an issue with
cleaning up keypairs, because of incorrect listing of them. This
issue is solved by setting the right dictionary key.

Change-Id: I81da575b0f40d2f04440a322b3b694f332c5d58e
2024-07-31 08:50:40 +00:00
Dr. Jens Harbott
a4a48b2f29 Add early failure detection for tempest base job
Zuul can do better resource allocation if it learns early that a job
will fail even when tests haven't completed yet. This is done by adding
a regular expression that will match on a single failing test within a
tempest run. The regex is copied from what the zuul project has already
been using successfully for some time.

Change-Id: I8c9488a55d04e32384d1523a9658a8711b05c340
2024-07-25 20:37:03 +02:00
Zuul
1af21705c5 Merge "Add wait for location import task" 2024-07-19 07:39:05 +00:00
Zuul
95064194ad Merge "Add test to verify hostname allows FQDN" 2024-07-17 11:17:57 +00:00
Luigi Toscano
b73ead02dc Switch the default disk and container formats to bare/qcow2
The first item of image.disk_formats and image.container_formats
tempest options is used by default if the options are not
specified by the person runnig tempest.
The most likely format to be used and supported are bare and qcow2,
so let's switch to those as default options.

Also, move raw to the second place of disk_formats because
a specific test (test_list_images_param_disk_format from the
tempest.api.image.v2.test_images.ListUserImagesTest class)
requires an image in raw format, but its initializer only
creates a subset of the images (only the first 6 (!) items
of all combinations of container_formats and disk_formats)
which means that raw should be in the first 6 combinations.

Change-Id: Iab3e5205e2ec6cd5a253715ff87853b2805e4819
2024-07-17 01:00:09 +02:00
Pranali Deore
953940288c Add wait for location import task
We are working to get support of new location APIs in glance,
where we are adding hash calculation mechanism once the image
location is added. Since new location api is async,
we need to wait for the task to finish before performing the
cleanup else we will fail due to the existing bug [1].

[1]: https://bugs.launchpad.net/glance/+bug/2045769

Change-Id: Ibde7620c9388fdbc93f741e38c9d63fca44a1bbb
2024-07-15 14:55:26 +00:00
Ashish Gupta
e27a9d6221 Add test to verify hostname allows FQDN
This patch adds a test for verifying that hostname allows
FQDN and can contains periods in hostname starting API microversion 2.94.
This patch also verifies hostname from the metadata api and also checks
hostname allows character length above 64 .

Also, adding a config feature flag dhcp_domain to set the suffix in
order to verify the hostname correctly .

Relates to : https://review.opendev.org/c/openstack/nova/+/869812

Change-Id: If92d4b469bfff4b205801bdd5ea8fd943942b943
2024-07-15 17:43:09 +05:30
Zuul
e47f4457cb Merge "Drop identity v2 api tests" 2024-07-09 18:52:33 +00:00
Zuul
149eabd47e Merge "Fix unit tests cleanup for --resource-list option" 2024-07-09 11:21:28 +00:00
Takashi Kajinami
c0c90279ce Drop identity v2 api tests
These tests can be removed now, because the identity v2 API was removed
from Keystone during Queens cycle and Queens is no longer supported
by current master of tempest.

This also deprecates the related options so that we can drop these
options later.

Change-Id: I0be2273890cecaa26da37624c185c1bd367b2acf
2024-07-09 11:16:56 +09:00
Katarina Strenkova
69f622b108 Fix unit tests cleanup for --resource-list option
This patch fixes the incomplete cleanup of unit tests for
`record_resources()` function. These unit tests are tied with the
tempest cleanup --resource-list option. The issue was the creation
of None file and resource_list.json file while running unit tests.

Closes-Bug: #2070449

Change-Id: Id8ff96606b30d52ad4c8a6bd31bcb09ae03cc963
2024-07-08 12:35:40 +00:00
Zuul
8e7232b740 Merge "Validate [validation] ssh_key_type at config layer" 2024-07-05 08:26:42 +00:00
Zuul
1a7a5a4d80 Merge "Update http_image config option to use latest image" 2024-07-05 01:36:32 +00:00
Zuul
aa57d98fc4 Merge "Test image <-> volume <-> server dependency" 2024-07-04 21:36:40 +00:00
Abhishek Kekane
9eea03cd57 Update http_image config option to use latest image
`http_image config` option of `image` section is still referring
to old cirros image `cirros-0.3.1-x86_64-uec.tar.gz`.

Updated it to use new cirros image `cirros-0.6.2-x86_64-uec.tar.gz`.

Change-Id: I55e2fbd062c476e839fe8404bae18e918e745bc5
2024-07-04 16:55:39 +00:00
Abhishek Kekane
cfdbbb0ac3 Reno for http_qcow2_image config option
Change-Id: I3a03657d155d82d87fef715a138e507670159053
2024-07-04 06:33:28 +00:00
Zuul
4bae4b08cc Merge "Allow visibility of external subnet as shared ones" 2024-07-03 20:51:16 +00:00
Zuul
5e54bf66b3 Merge "extend tempest-integrated-compute and tempest-full-py3" 2024-07-03 20:08:05 +00:00
Zuul
ad6f94cad8 Merge "Introduce new config parameter to download qcow2 image" 2024-07-03 19:59:59 +00:00
Abhishek Kekane
9aa4144e32 Introduce new config parameter to download qcow2 image
Current http_image config format downloads tar.gz image which is no
more useful since recent changes in glance to fix CVE-2024-32498.
It will fail to import the image using web-download method as we
anticipate disk-format is qcow2 but it's not. Same it will further
fail if image_conversion plugin is enabled in the environment.

Introduced new config parameter http_qcow2_image which will by
default has reference to qcow2 image.

Change-Id: Ic07a55edc9a0ae713265220c9711f3dee48093fc
2024-07-03 10:58:47 +00:00
Abhishek Kekane
e1451f4ae0 Provid raw disk-format to images which uses raw data
Recent changes in glance to fix CVE-2024-32498 causes some tests
to fail because those tests assumes disk-format is qcow2 or ami
but it is actually raw and fails to detect the format.

Change-Id: Id92cbcece145426ec95c46649a2f11c3d19ad4bd
2024-07-03 05:23:59 +00:00
Sean Mooney
f207d29e32 extend tempest-integrated-compute and tempest-full-py3
This change adds 30mins to the timeout to account
for timeouts on slow nodes and gather more data.

once stabilised we should consider
enabling zswap, or adding more swap to account
for OOM issues thereby allowing a higher concurrency
to reduce overall execution time.

Change-Id: I9529f554acb5b67401ed1cb8700a916c7131ec02
2024-07-02 19:55:23 +01:00
Rajat Dhasmana
ea914a22e2 Test image <-> volume <-> server dependency
This patch adds a test where we test the following workflow:
1. Create image
2. Create a bootable volume from Image
3. Launch an instance from the bootable volume
4. Take snapshot of the instance -- which creates the volume snapshot
5. Delete the image

In the above workflow, steps 2 and 3 are performed together as we
create the instance as volume backed providing the image ID to
instance create call.

Change-Id: Ie9c27e7e7305147b7081c5f1dcc8f1631081fda5
2024-07-02 22:09:57 +05:30
Zuul
6b8ff89c8f Merge "Fix missing space in parameter description" 2024-07-02 12:46:00 +00:00
Zuul
0bb9f6de1a Merge "Remove deprecated alias of test decorators (2/2)" 2024-07-02 11:48:20 +00:00
Zuul
3a922be8a8 Merge "Use 'tempest run --slowest' in integrated-compute (again)" 2024-07-02 11:48:17 +00:00
Zuul
36e0b2a714 Merge "Log request-id in test_delete_server_while_in_verify_resize_state test" 2024-07-02 11:27:13 +00:00
Zuul
5fb37931dd Merge "Adds placement resource provider traits API calls" 2024-07-02 09:15:24 +00:00
Zuul
832ce91985 Merge "Adds placement trait api calls" 2024-07-02 09:15:20 +00:00
Rodolfo Alonso Hernandez
2779712635 Allow visibility of external subnet as shared ones
The Neutron network can have the attribute "external". If a
network is external, can be seen by other projects, same as
when it is shared. However the subnets cannot be seen now.
This issue is being solved in LP#2051831, in [1].

This patch changes the logic implemented in [2], where the
subnets belonging to an external network where hidden to
a non-admin user of other project.

[1]https://review.opendev.org/c/openstack/neutron/+/907313
[2]https://review.opendev.org/c/openstack/tempest/+/484960

Related-Bug: #2051831
Change-Id: I58b2a1ddf9b0fe85d96617863d121aebb7d81e58
2024-06-27 14:14:15 +00:00
Amit Uniyal
6587e780d6 Adds placement resource provider traits API calls
Change-Id: Iaaff5fa36a6559d30a64c8679a0c1852f9e00342
2024-06-27 00:37:14 -04:00
Amit Uniyal
3c3985c2ec Adds placement trait api calls
Change-Id: I0c4523c6916821781c3a67b01ed2e0091407734e
2024-06-26 03:07:40 -04:00
Jakub Skunda
6618aa253e Modify mounting paths
When we create mounting paths for devices we have same paths if we create
them on 2 servers. For example for 2 servers and 2 volumes paths look like
this:
- /mnt/vdb
- /mnt/vdc
- /mnt/vdb
- /mnt/vdc
In this patch we add one more directory - id of server to this paths,
that when we have unique patch for each. After this patch paths will look
like this:
- /mnt/226575324/vdb
- /mnt/226575324/vdc
- /mnt/356104023/vdb
- /mnt/356104023/vdc

Change-Id: I7e4b2f68d987cd4d303915062984ce2125667db6
2024-06-25 16:36:47 +02:00
Maxim Sava
4bd81f8b17 Fix enable-volume-image-dep-tests config option
Replaced hyphen with underscore in config option

Change-Id: I5a34b57809fe2b3ef94e3b4b2ae3a6ea23003c0f
2024-06-25 11:17:16 +03:00
Maxim Sava
1be8cabb46 Add image dependencies test for image <-> instance snapshot
Detect problems related to Glance images not allowing
Glance images to be deleted.

Adds new option:
  CONF.volume_feature_enabled.enable_volume_image_dep_tests

Change-Id: Ia216f5be377bf5c35d7addb78d7f8aabb2393405
2024-06-19 23:42:18 +03:00
Zuul
3619d297d5 Merge "Create independent mount path for each device" 2024-06-09 15:00:34 +00:00
melanie witt
4f9d735923 Use 'tempest run --slowest' in integrated-compute (again)
Change I53b0fa6dcf077191565e2aaf3f08a24b3238a34b added the --slowest
option to the tempest run command for scenario and serial tests but
missed adding it when running api tests.

The --slowest option will show a list of the slowest tests after the
tests finish running.

Change-Id: Ia5a995121748a2c244f060e6ce4b395213bb196e
2024-06-07 20:35:41 +00:00
Takashi Kajinami
8280f43489 Create independent mount path for each device
Currently the single mount path is used for all volume devices, but
this sometimes causes mount to fail because of resource busy. Create
an independent mount path per device to avoid such timing problems.

Change-Id: Ida4381f28fc528ca83b0818aec6c7633112d19fa
2024-06-03 23:44:42 +09:00
melanie witt
89a6811cd0 Bump http_timeout in devstack-tempest
In the gate we occasionally see failures like the following:

  urllib3.exceptions.ReadTimeoutError:
    HTTPSConnectionPool(host='10.209.0.62', port=443):
    Read timed out. (read timeout=60)

  urllib3.exceptions.ReadTimeoutError:
    HTTPSConnectionPool(host='10.209.99.246', port=9696):
    Read timed out. (read timeout=60)

where Tempest gives up waiting for an HTTP response after 60 seconds.

It doesn't appear to be related only to one service, as it has been
seen when calling Nova API or Neutron API (the port=9696 example is a
call to Neutron API).

We could try bumping the http_timeout from the default 60 seconds to 90
seconds to see if it helps in slow environments.

Related-Bug: #1999893

Change-Id: I2b2a6a4dee40ee86ca89f6f7f9a83409f8312617
2024-05-30 21:23:56 +00:00
Zuul
c3200abba5 Merge "Add releasenote page for v39.0.0" 2024-05-27 06:17:49 +00:00
Ghanshyam Mann
cbd0897804 Add releasenote page for v39.0.0
Change-Id: Ifa42169ef047a73b31dc389687b41a6472b49fa5
2024-05-23 12:57:19 -07:00
Zuul
23302a5174 Merge "Use service_available option to detect Neutron" 2024-05-22 19:09:53 +00:00
Zuul
8842ed3fd4 Merge "Switch back the tox constraint to master" 2024-05-21 16:16:23 +00:00
Zuul
5b9b80e3c9 Merge "Pin stable/2024.1 constraint in tox to release 39.0.0" 39.0.0 zed-last 2024-05-21 16:14:12 +00:00
Zuul
c54fd8d9e6 Merge "End support for stable/zed" 2024-05-21 15:17:57 +00:00
Zuul
de60d34499 Merge "Enable tempest cleanup with record_resources in jobs" 2024-05-21 14:21:17 +00:00
Zuul
06831f9811 Merge "Adds validation schema for compute" 2024-05-21 10:12:14 +00:00
Zuul
e838ec9fa8 Merge "Implement purge list for tempest cleanup" 2024-05-21 06:13:54 +00:00
Martin Kopec
1a9c40d469 Enable tempest cleanup with record_resources in jobs
This enables tempest cleanup with record_resources in the tempest-all job
to create a list of all the resources created during the tempest run.
Then the list will be used to run 'tempest cleanup' to clean only
the resources in the list.

Also, enable the dry cleanup with record_resources in tempest-extra-tests
job.

Change-Id: Ia64a1c09d4b5e9815ff5926161d550b56433ec64
2024-05-20 13:05:15 +00:00
Katarina Strenkova
f999b15bd4 Implement purge list for tempest cleanup
This patch adds an option to create purge list that logs every
resource created by Tempest. When used with tempest cleanup
command, it creates a new method of deleting resources created
during one or multiple Tempest runs.

This method solves the problem of accidentally deleting
resources which were not created by Tempest, but by users.

Change-Id: Ide81e6a41799bace211669951b4ceab8635b56ab
2024-05-20 12:35:13 +00:00