Commit Graph

14131 Commits (73268fb6b3cd8b3f06401e2c85c94cb468f9dd1e)

Author SHA1 Message Date
Zuul 73268fb6b3 Merge "Set default value of --concurrency to 2" 2022-01-16 18:14:16 +00:00
Ghanshyam Mann 0de0ebf098 Make centos8 stream job non voting for bug#1957941
Two test_network_basic_ops tests are failing consistently in
centos-8-stream jobs (nova side tempest-integrated-compute-centos-8-stream
and tempest tempest-full-py3-centos-8-stream jobs).

1. tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_hotplug_nic
2. tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops


This is blocking nova and tempest gateso making the centos8 stream job
non voting until bug is fixed.


Change-Id: Ia8c575b1accf4fa2a25b903bf9bf5a614752e344
2022-01-14 11:08:05 -06:00
lpiwowar bd722d366e Set default value of --concurrency to 2
There is a non-negligible number of tests in tempest that need accounts
generated by account-generator with a concurrency of at least 2. Running
these tests with accounts generated with the current default value for
concurrency makes them therefore fail.

This change sets the default value for concurrency to 2 and updates
the documentation for --concurrency parameter.

Closes-Bug: #1948935
Change-Id: Iada980beff9db3c8cd02c84d0d7602264b66ddf8
2022-01-14 09:25:12 +01:00
Zuul fe0ac89a5a Merge "Test Network QoS minimum packet rate scenarios" 2022-01-12 10:38:38 +00:00
Zuul 3d4e888f31 Merge "Add flavor extra spec validation tests" 2022-01-10 12:02:03 +00:00
Zuul fd00bffb96 Merge "Remove stable/train jobs from master gate" 2022-01-06 03:28:41 +00:00
Rajat Dhasmana 81c91f0ec2 Fix: Schema validation of volume list detail
When doing the attachment of volume with glance host, the
"server_id" field of volume attachment response is null which is
not handled in the schema validation of list volume with detail.
This caused a failure in one of the tempest volume test
"test_unmanage_manage_volume" where we do a list volume with
detail request and one volume (probably from other test running
in parallel) existed with an active attachment to the glance host[2].
We can see that the "server_id" field of the attached volume is null[3].
The "server_id" field is only present when doing the attachment
with nova.
This patch allows the "server_id" to be "string" as well as "null" type
to handle both nova and glance usecase.


[2] Body: b'{"volumes": [{"id": "e11beb8b-e170-4c5c-945b-e854c01f85ab",
"status": "in-use",...
, "attachments":
[{"id": "e11beb8b-e170-4c5c-945b-e854c01f85ab",
"attachment_id": "5132d152-54c3-4aa6-90e8-f13d2d1d0028",
"volume_id": "e11beb8b-e170-4c5c-945b-e854c01f85ab",
"server_id": null,
"host_name": "ubuntu-focal-inmotion-iad3-0027876140",
"device": "glance_store",...

[3] "server_id": null

Closes-Bug: #1956340
Change-Id: I92d4d49bf5fe52f3417555260e0771397f18334d
2022-01-04 05:53:03 -05:00
Zuul c2f5a47cfb Merge "Add --libpath argv option to fix unittest failure" 2021-12-23 15:03:59 +00:00
Zuul 3557e96e71 Merge "Revert "Skip 3.19 test_reset_group_snapshot_status"" 2021-12-21 18:52:55 +00:00
Alex Yefimov 09428b8780 Add --libpath argv option to fix unittest failure
Fixes intermittent tempest unittest failure of "test_fix_argument_yes".
The bug was in and not in the test itself. As part of
the fix and backward compatibility, enabled to run a
validation of a py module from any dir by adding --libpath parameter to


Change-Id: If5d3a3852320e1d3b26af433f7a66be7d42e2b84
2021-12-21 16:15:08 +00:00
Ghanshyam Mann 59f6aa6a90 Remove stable/train jobs from master gate
stable/train is in EM state and tempest master
does not support stable/train. depends on patch
also cap the tempest on stable/train testing.


Change-Id: Ia298e20d1db77f307c850f90741d5fb46cb87ae0
2021-12-16 23:59:04 +00:00
James Parker ef0da21010 Add flavor extra spec validation tests
Tests cover the addition of flavor extra spec validation [1,2]. Test
validates the ability to create a flavor with extra specs using a custom
namespace. This change was introduced in 2.86 [3].


Change-Id: I20267054af04da3753795f7008abcf1118a31bdd
2021-12-16 11:22:24 -05:00
Zuul 24864bac27 Merge "Deprecate the old API microversion fixture" 2021-12-14 04:40:41 +00:00
Zuul 34432dc970 Merge "Modify the response example in test_subnetpools_client" 2021-12-13 14:44:25 +00:00
linanbj 226a123352 Modify the response example in test_subnetpools_client
Because some response parameters are missing,
modify the response example in test_subnetpools_client.
Please refer to:

Change-Id: I34ac81d19a38bdf3c5fbc58b9938e04ed8cde6df
2021-12-13 10:46:30 +00:00
linanbj bb1d5d04d2 add the test of router test client
add the tests:
    * show_router
    * add_router_interface
    * remove_router_interface

Change-Id: I6bc5fdbccc5fdaf880bc4da9b2783e47ab93c6a4
2021-12-13 10:46:12 +00:00
Ghanshyam Mann 18b45d7285 Moving API microversion fixture in resource_setup
API microversion fixture is used to set the API
microversion on service client and reset it back
after test execution. That is done in setUp()
method and due to that API microversion is not
set on service client during resource_setup()
method and any API call will be requested on base

To sync the complete test execution of test class
with requested API microversion, this commit moves
the API microversion setting in resource_setup()

Closes-Bug: #1881863

Change-Id: Ia4b884a79cc0e50057dd57090737332bd76da37e
2021-12-11 09:20:55 -06:00
Ghanshyam Mann 24554b0e10 Deprecate the old API microversion fixture
We have moved the API microversion fixture to
tempest.lib.common.api_microversion_fixture location.

This commit deprecates the old fixture so that we can
remove them in Z cycle.

Change-Id: If38aa21a4cd99d2a5fe4a5c3b41214cd54f97f8d
2021-12-07 21:02:07 -06:00
Zuul 93a902072f Merge "Take domain_id from config in some tests." 2021-12-03 15:14:56 +00:00
Zuul 7facea86e6 Merge "Test delete security group will clear its associated rules" 2021-12-03 03:55:02 +00:00
Zuul 79d34ca59a Merge "Don't override images client in compute admin tests" 2021-12-02 19:11:21 +00:00
Zuul 12ecd4aa17 Merge "Add openstacksdk-functional-devstack in integrated gates" 2021-12-02 09:12:06 +00:00
Artom Lifshitz b0ee03e568 Don't override images client in compute admin tests
Tests should be explicit about their use of admin credentials. The
base compute admin tests class overrode self.image_client with the
admin version. Stop doing that, and introduce a new
self.admin_image_client client that tests can explicitly use.

Change-Id: I1a0c84b41b1b77d3a618a8f15448909bd12a0742
2021-12-01 16:38:32 -05:00
Zuul 322b60153b Merge "Define default OS_TEST_TIMEOUT for every tempest tox env" 2021-12-01 20:14:23 +00:00
Zuul 94e2f8fdf2 Merge "Replace deprecated assertDictContainsSubset" 2021-12-01 15:32:23 +00:00
Zuul 74b037fabf Merge "hacking: Ignore H405" 2021-11-30 15:07:26 +00:00
Takashi Kajinami bbe4f8c305 Replace deprecated assertDictContainsSubset
The method is deprecated since Python 3.2[1] and shows the following

/usr/lib/python3.9/unittest/ DeprecationWarning:
assertDictContainsSubset is deprecated
  warnings.warn('assertDictContainsSubset is deprecated',


Closes-Bug: #1938103
Change-Id: I2e868d13d52a2d3c6081a8b756fbe83f8b57cf66
2021-11-30 13:29:18 +09:00
Brian Rosmaita 06bf0186b6 Revert "Skip 3.19 test_reset_group_snapshot_status"
This reverts commit 5b91aea1c6.

Reason for revert: Investigating whether this is still an issue.  There is an extremely similar test (GroupsV320Test.test_reset_group_status) that was reported to intermittently fail (Bug #1783566); it is not currently skipped and I haven't seen failures reported for that one in a long time.

Change-Id: I2d252be140bd728ea01460a61a3097c6f3a2dc82
2021-11-29 20:09:18 +00:00
Balazs Gibizer f294b0d8dc Test Network QoS minimum packet rate scenarios

blueprint: qos-minimum-guaranteed-packet-rate

Change-Id: I4cb12a23f33d4feef6c800d23a0501d1aebb4f17
2021-11-29 15:17:25 +00:00
Ghanshyam Mann 17082ad2c9 Add openstacksdk-functional-devstack in integrated gates
openstacksdk-functional-devstack should be part of
integrated gate so that cross service-sdk testing
can be covered to avoid any regression.

Change-Id: Idaab1b0952b2d6d9c0e2b9b255ec401d2e315b19
2021-11-29 13:26:56 +00:00
Soniya Vyas c08dfd2014 This patch creates the network v2.0 floating-ips-port-forwarding client.
Signed-off by: Soniya Vyas<>

Change-Id: Icac4495c8a3fae877746652d0c9e00225b0a879d
2021-11-29 18:15:24 +05:30
Zuul 79da6961ed Merge "Test all supported python version for stable branch" 2021-11-25 05:33:05 +00:00
Zuul db4066912b Merge "Add floating IP waiter" 2021-11-23 18:03:52 +00:00
Mitya_Eremeev aca819b796 Take domain_id from config in some tests.
tempest.api.identity.admin.v3.test_tokens.TokensV3TestJSON.test_rescope_token fails
if not used default value for CONF.identity.default_domain_id

Closes-Bug: 1951446
Change-Id: Ie08d570907ddf9102c1297f717355a7f772aabb8
2021-11-18 16:36:11 +00:00
Zuul ad8f599b32 Merge "Remove race from wait_for_interface_detach waiter" 2021-11-15 14:14:11 +00:00
Zuul 56bafba712 Merge "add delete group type testcase" 2021-11-15 13:37:23 +00:00
Zuul 49ddec9241 Merge "Change extra_size from hardcoded 1 to CONF.volume.volume_size_extend" 2021-11-15 13:17:30 +00:00
Sam Wan 0bacf98431 Change extra_size from hardcoded 1 to CONF.volume.volume_size_extend
test_volume_from_snapshot has extra_size hardcoded to 1 and it expects
the returned size increased by 1GB. This does not work with PowerFlex
cinder driver because PowerFlex/VxFlex OS requires volumes to be sized
in multiples of 8GB. Even if 1GB is given, 8GB will be actually used
when powerflex_round_volume_capacity = True.

Closes-Bug: #1949927
Change-Id: I04c3d6145fbc201355d38a7a058a37791227f733
2021-11-15 12:33:30 +08:00
Zuul 8d365d4d09 Merge "Add microversion schemas for os-instance-actions" 2021-11-12 18:52:05 +00:00
Zuul daeae9c8a5 Merge "Update Interop doc" 2021-11-11 21:02:18 +00:00
wangzhiguang a27e6b41a8 add delete group type testcase
add delete group type api testcase for cinder module

Change-Id: I7e1e30a1832f292b6c405e4d23c0fe3818a07cdb
2021-11-11 08:28:11 +08:00
Lee Yarwood ed89c77222 zuul: Limit tempest-integrated-compute-centos-8-stream to >= stable/wallaby
Full support for CentOS8Stream in devstack didn't land until
I39ccefbd06f46adf5077f8d8001f37d3b190f040 fixed is_fedora to include the
newly introduced name.

As such the recently introduced
tempest-integrated-compute-centos-8-stream job within tempest that forms
part of the integrated-gate-compute template needs to be restricted to
branches >= stable/wallaby.

Closes-Bug: 1950296
Change-Id: I802c0cdb3c8875e33819aed335877f1caef39fef
2021-11-09 10:23:24 +00:00
Zuul d27a543fc9 Merge "Reactivate image before deletion" 2021-11-09 05:04:28 +00:00
Zuul 815798ada3 Merge "zuul: Add a CentOS 8 stream job to integrated-gate-compute" 2021-11-09 04:36:47 +00:00
Martin Kopec 425b486d9b Update Interop doc
The commit replaces DefCore committee (a former name) by
Interop Working Group (the current name) and updates a few
more old interop references.

Change-Id: I8bd05246e42c0e98a9825a4621ac9c3ed714d1dc
2021-11-08 10:41:24 +00:00
Balazs Gibizer 55414580c2 Remove race from wait_for_interface_detach waiter
Nova list the interfaces attached to a server based on list of ports
bound to the server. However during detach interface nova unbounds the
port first and then deallocates the resources used by that port in
placement. The current detach waiter only waits until the interface
disappears from the interface list. This can cause that waiter returns
before the resource allocation is removed from placement cause a race in
the test asserting such allocation.

So this patch changes the waiter to wait for the successful detach
os-instance-action event for the server as that is only recorded after
the port is fully deallocated.

blueprint: qos-minimum-guaranteed-packet-rate
Change-Id: I8740f8e0cc18ffea31a9a068bccee50bf4e6fe28
2021-11-04 13:32:55 +01:00
Balazs Gibizer f46bcdf5e4 Add microversion schemas for os-instance-actions
I need to use os-instance-actions API in a waiter that is called from
multiple microversion tests in a later patch. So this patch adds the
microversion schemas for this API.

blueprint: qos-minimum-guaranteed-packet-rate
Change-Id: I010fbb4236ccaedb3de663e32eb22f89931d53c7
2021-11-04 13:32:55 +01:00
Balazs Gibizer efa21d3bb9 Add QoS minimum packet rate rule client
As a preparation to test Network QoS minimum bandwidth and minimum
packet rate rules together this patch the necessary packet rate API
client to tempest lib.

blueprint: qos-minimum-guaranteed-packet-rate

Change-Id: I1c5c82e8178462652c36533093958c82b5130a55
2021-11-04 13:32:15 +01:00
Lee Yarwood 0dba41c17a zuul: Add a CentOS 8 stream job to integrated-gate-compute
As set out in the governance repo for Xena CentOS 8 stream with py36 is
a supported platform and runtime for the release:

As a result the Nova team want to run CentOS 8 stream based jobs within
the integrated-gate-compute template.

An additional tempest-full-py3-centos-8-stream job is added to Tempest's
check and gate queues to ensure coverage here.

Both jobs are given additional swap to workaround bug #1949606, a
behaviour change in QEMU >= 5.0.0 when using [libvirt]virt_type=qemu
that causes additional memory to be consumed by each running instance.

This workaround of additional swap will be removed in the future once
Nova is able to workaround this itself through a new libvirt domain

Change-Id: I4b074dca58960b2622dde15ad7d9a91b3ba0c096
2021-11-04 09:21:49 +00:00
Ghanshyam Mann 1aac05c7b2 Test all supported python version for stable branch
As Tempest is branchless and needs to support older
supported stable branches, let's test it with all the
python version supported in those supported stable branches.
For that, we need to explicitly dd the py jobs instead of using
the template. This way, we will explicitly know that we are testing
all supported python versions when the new release template bumps the
min python version in the template.

In Yoga testing, we are making py3.9 job to run as voting, so
adding py3.9 job as voting.

Change-Id: I422da8da06509e529f4091e21cdc3d392d3cf910
2021-11-03 15:08:44 -05:00