14145 Commits

Author SHA1 Message Date
Zuul
42bf51c989 Merge "Revert "Revert "Make centos8 stream job non voting for bug#1957941""" 2022-01-21 10:39:13 +00:00
Ghanshyam
5eb51dc061 Revert "Revert "Make centos8 stream job non voting for bug#1957941""
This reverts commit 1e2fe4fb33cd1ef8f0067a3aa2ef8c10c0ba0d2a.

Reason for revert: they started failing again with RETRY_LIMIT  

https://zuul.openstack.org/builds?job_name=tempest-integrated-compute-centos-8-stream&job_name=tempest+tempest-full-py3-centos-8-stream&skip=0

Change-Id: I42f4991d786e74512a666cc12b7901f5effcf10b
2022-01-21 05:56:22 +00:00
Zuul
c676a1a993 Merge "Add test coverage for bug 1943724" 2022-01-20 22:11:17 +00:00
Zuul
c545cb1c7c Merge "Add support for ecdsa keys" 2022-01-19 03:30:16 +00:00
Zuul
d373b9a176 Merge "Revert "Make centos8 stream job non voting for bug#1957941"" 2022-01-18 22:45:54 +00:00
Ade Lee
6ded070b51 Add support for ecdsa keys
In FIPS mode, using RSA keys for ssh is fine as long as SHA-1 is
not used for the signature algorithm.  Unfortunately, the version
of cirros used in OpenStack CI does not have a version of dropbear
that supports SHA-2 signatures.  So, any connections from a FIPS
enabled machine will fail as the cirros instance will only support
ssh-rsa (SHA-1 signatures).

To get around this, we add a new option to specify the key type
(validation.ssh_key_type).  This will allow the addition of other
key types in future if needed.

Tempest now supports 'rsa' and 'ecdsa' key types.

We also add a fips job to the experimental queue to test the usage
of the new key type.

Change-Id: Ib59eb8432fa1a2813b3047955157d1b3d24a55f8
2022-01-18 15:25:38 +00:00
Ghanshyam
1e2fe4fb33 Revert "Make centos8 stream job non voting for bug#1957941"
This reverts commit 0de0ebf0987c2cd92a3a880de822f3616480d2d5.

Reason for revert: Try with workaround merged in https://review.opendev.org/c/openstack/devstack/+/824862

Change-Id: Iafff24bf829da1d399fed4ca16a62f24196cd4af
2022-01-17 22:09:52 +00:00
Zuul
268606a720 Merge "Add fields in hypervisor schema for 2.33 and 2.53" 2022-01-17 02:53:57 +00:00
Zuul
207a045619 Merge "Clean up wait_for_resource_deletion message" 2022-01-16 23:31:39 +00:00
Zuul
e414221c32 Merge "wait_for_server_status(): report original request ID if failure" 2022-01-16 21:07:14 +00:00
Zuul
73268fb6b3 Merge "Set default value of --concurrency to 2" 2022-01-16 18:14:16 +00:00
Ghanshyam Mann
0de0ebf098 Make centos8 stream job non voting for bug#1957941
Two test_network_basic_ops tests are failing consistently in
centos-8-stream jobs (nova side tempest-integrated-compute-centos-8-stream
and tempest tempest-full-py3-centos-8-stream jobs).

1. tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_hotplug_nic
2. tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops

Failure: https://zuul.opendev.org/t/openstack/build/e0db6a9a7ba04e66b0781ba7d259357d/logs

This is blocking nova and tempest gateso making the centos8 stream job
non voting until bug is fixed.

Related-Bug#1957941

Change-Id: Ia8c575b1accf4fa2a25b903bf9bf5a614752e344
2022-01-14 11:08:05 -06:00
Balazs Gibizer
770dc0060f Add test coverage for bug 1943724
Now that bug 1943724 is fixed in neutron we can extend the tempest test
coverage to show that changing the direction of the QoS minimum
guaranteed bandwidth rule on a bound port is supported.

Related-Bug: #1943724

Change-Id: I09e773baedcffc8af5a88e0be1df38d14633ed74
2022-01-14 17:57:40 +01:00
lpiwowar
bd722d366e Set default value of --concurrency to 2
There is a non-negligible number of tests in tempest that need accounts
generated by account-generator with a concurrency of at least 2. Running
these tests with accounts generated with the current default value for
concurrency makes them therefore fail.

This change sets the default value for concurrency to 2 and updates
the documentation for --concurrency parameter.

Closes-Bug: #1948935
Change-Id: Iada980beff9db3c8cd02c84d0d7602264b66ddf8
2022-01-14 09:25:12 +01:00
Artom Lifshitz
da48e4ee3d wait_for_server_status(): report original request ID if failure
If waiting for a server to reach a particular status fails - for
example, a server never reaches ACTIVE after boot - the most useful
piece of information when debugging the failure is the orignal request
ID - in our example, the request ID of the original POST /servers
request.

This patch makes create_server() remember the original server boot
request ID, and wires that value up into wait_for_server_status(), so
that the latter can log it if the wait fails.

Because we have to remain compatible with calls to
wait_for_server_status() that do not pass a request_id, there's some
conditional logic to only log it if it was passed in.

Similar mechanics can, in the future, be added to other areas where
tests can fail, for example for live migration or resizing, or
attaching a port to an server.

Change-Id: I3d5aa41d96f7fa4fc860ed9d1076a247d5fa7bf6
2022-01-13 16:11:05 -05:00
Zuul
fe0ac89a5a Merge "Test Network QoS minimum packet rate scenarios" 2022-01-12 10:38:38 +00:00
Zuul
3d4e888f31 Merge "Add flavor extra spec validation tests" 2022-01-10 12:02:03 +00:00
Eric Harney
941043fcc7 Clean up wait_for_resource_deletion message
Add missing space and punctuation to make this
message look cleaner.

Change-Id: I595291b68d4fef884888668d3e3c2d5d73b0c4d9
2022-01-07 14:22:09 -05:00
Zuul
fd00bffb96 Merge "Remove stable/train jobs from master gate" 2022-01-06 03:28:41 +00:00
Rajat Dhasmana
81c91f0ec2 Fix: Schema validation of volume list detail
When doing the attachment of volume with glance host, the
"server_id" field of volume attachment response is null which is
not handled in the schema validation of list volume with detail.
This caused a failure in one of the tempest volume test
"test_unmanage_manage_volume" where we do a list volume with
detail request and one volume (probably from other test running
in parallel) existed with an active attachment to the glance host[2].
We can see that the "server_id" field of the attached volume is null[3].
The "server_id" field is only present when doing the attachment
with nova.
This patch allows the "server_id" to be "string" as well as "null" type
to handle both nova and glance usecase.

[1] https://86aa517b6cb393144dd6-d78b0c94e26e635eac828273888f290f.ssl.cf5.rackcdn.com/822731/1/check/glance-multistore-cinder-import/e52281e/testr_results.html

[2] Body: b'{"volumes": [{"id": "e11beb8b-e170-4c5c-945b-e854c01f85ab",
"status": "in-use",...
, "attachments":
[{"id": "e11beb8b-e170-4c5c-945b-e854c01f85ab",
"attachment_id": "5132d152-54c3-4aa6-90e8-f13d2d1d0028",
"volume_id": "e11beb8b-e170-4c5c-945b-e854c01f85ab",
"server_id": null,
"host_name": "ubuntu-focal-inmotion-iad3-0027876140",
"device": "glance_store",...

[3] "server_id": null

Closes-Bug: #1956340
Change-Id: I92d4d49bf5fe52f3417555260e0771397f18334d
2022-01-04 05:53:03 -05:00
Zuul
c2f5a47cfb Merge "Add --libpath argv option to fix unittest failure" 2021-12-23 15:03:59 +00:00
Zuul
3557e96e71 Merge "Revert "Skip 3.19 test_reset_group_snapshot_status"" 2021-12-21 18:52:55 +00:00
Alex Yefimov
09428b8780 Add --libpath argv option to fix unittest failure
Fixes intermittent tempest unittest failure of "test_fix_argument_yes".
The bug was in check_uuid.py and not in the test itself. As part of
the fix and backward compatibility, enabled check_uuid.py to run a
validation of a py module from any dir by adding --libpath parameter to
argv.

Closes-Bug:#1918316

Change-Id: If5d3a3852320e1d3b26af433f7a66be7d42e2b84
2021-12-21 16:15:08 +00:00
zhufl
6bc98ccfaa Add fields in hypervisor schema for 2.33 and 2.53
1. For microversion 2.33
   hypervisor_links is added to the response body for the following APIs:
     - GET /os-hypervisors
     - GET /os-hypervisors/detail

2. For microversion 2.53
   servers is added to the response body for the following APIs:
     - GET /os-hypervisor
     - GET /os-hypervisors
     - GET /os-hypervisors/detail

This is to fix the hypervisor schema for microversion 2.33 and 2.53.

Partially Implements: blueprint fix-microversion-gap

Co-authored-by: Ghanshyam Mann <gmann@ghanshyammann.com>

Change-Id: Ifeb26a50b604d257e9ab00cceed7cd2f34621419
2021-12-17 00:45:04 +00:00
Ghanshyam Mann
59f6aa6a90 Remove stable/train jobs from master gate
stable/train is in EM state and tempest master
does not support stable/train. depends on patch
also cap the tempest on stable/train testing.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/816549
Depends-On: https://review.opendev.org/c/openstack/stackviz/+/822056

Change-Id: Ia298e20d1db77f307c850f90741d5fb46cb87ae0
2021-12-16 23:59:04 +00:00
James Parker
ef0da21010 Add flavor extra spec validation tests
Tests cover the addition of flavor extra spec validation [1,2]. Test
validates the ability to create a flavor with extra specs using a custom
namespace. This change was introduced in 2.86 [3].

[1] https://blueprints.launchpad.net/nova/+spec/flavor-extra-spec-image-property-validation-extended
[2] https://review.opendev.org/c/openstack/nova-specs/+/682655/
[3] https://docs.openstack.org/nova/latest/reference/api-microversion-history.html#id79

Change-Id: I20267054af04da3753795f7008abcf1118a31bdd
2021-12-16 11:22:24 -05:00
Zuul
24864bac27 Merge "Deprecate the old API microversion fixture" 2021-12-14 04:40:41 +00:00
Zuul
34432dc970 Merge "Modify the response example in test_subnetpools_client" 2021-12-13 14:44:25 +00:00
linanbj
226a123352 Modify the response example in test_subnetpools_client
Because some response parameters are missing,
modify the response example in test_subnetpools_client.
Please refer to:
https://docs.openstack.org/api-ref/network/v2/index.html#list-subnet-pools


Change-Id: I34ac81d19a38bdf3c5fbc58b9938e04ed8cde6df
2021-12-13 10:46:30 +00:00
linanbj
bb1d5d04d2 add the test of router test client
add the tests:
    * show_router
    * add_router_interface
    * remove_router_interface

Change-Id: I6bc5fdbccc5fdaf880bc4da9b2783e47ab93c6a4
2021-12-13 10:46:12 +00:00
Ghanshyam Mann
18b45d7285 Moving API microversion fixture in resource_setup
API microversion fixture is used to set the API
microversion on service client and reset it back
after test execution. That is done in setUp()
method and due to that API microversion is not
set on service client during resource_setup()
method and any API call will be requested on base
version.

To sync the complete test execution of test class
with requested API microversion, this commit moves
the API microversion setting in resource_setup()
method.

Closes-Bug: #1881863

Change-Id: Ia4b884a79cc0e50057dd57090737332bd76da37e
2021-12-11 09:20:55 -06:00
Ghanshyam Mann
24554b0e10 Deprecate the old API microversion fixture
We have moved the API microversion fixture to
tempest.lib.common.api_microversion_fixture location.

This commit deprecates the old fixture so that we can
remove them in Z cycle.

Change-Id: If38aa21a4cd99d2a5fe4a5c3b41214cd54f97f8d
2021-12-07 21:02:07 -06:00
Zuul
93a902072f Merge "Take domain_id from config in some tests." 2021-12-03 15:14:56 +00:00
Zuul
7facea86e6 Merge "Test delete security group will clear its associated rules" 2021-12-03 03:55:02 +00:00
Zuul
79d34ca59a Merge "Don't override images client in compute admin tests" 2021-12-02 19:11:21 +00:00
Zuul
12ecd4aa17 Merge "Add openstacksdk-functional-devstack in integrated gates" 2021-12-02 09:12:06 +00:00
Artom Lifshitz
b0ee03e568 Don't override images client in compute admin tests
Tests should be explicit about their use of admin credentials. The
base compute admin tests class overrode self.image_client with the
admin version. Stop doing that, and introduce a new
self.admin_image_client client that tests can explicitly use.

Needed-by: https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/805300
Change-Id: I1a0c84b41b1b77d3a618a8f15448909bd12a0742
2021-12-01 16:38:32 -05:00
Zuul
322b60153b Merge "Define default OS_TEST_TIMEOUT for every tempest tox env" 2021-12-01 20:14:23 +00:00
Zuul
94e2f8fdf2 Merge "Replace deprecated assertDictContainsSubset" 2021-12-01 15:32:23 +00:00
Zuul
74b037fabf Merge "hacking: Ignore H405" 2021-11-30 15:07:26 +00:00
Takashi Kajinami
bbe4f8c305 Replace deprecated assertDictContainsSubset
The method is deprecated since Python 3.2[1] and shows the following
DeprecationWarning.

/usr/lib/python3.9/unittest/case.py:1134: DeprecationWarning:
assertDictContainsSubset is deprecated
  warnings.warn('assertDictContainsSubset is deprecated',

[1] https://docs.python.org/3/whatsnew/3.2.html#unittest

Closes-Bug: #1938103
Change-Id: I2e868d13d52a2d3c6081a8b756fbe83f8b57cf66
2021-11-30 13:29:18 +09:00
Brian Rosmaita
06bf0186b6 Revert "Skip 3.19 test_reset_group_snapshot_status"
This reverts commit 5b91aea1c618c1b14da7165f656c783ba4d9816e.

Reason for revert: Investigating whether this is still an issue.  There is an extremely similar test (GroupsV320Test.test_reset_group_status) that was reported to intermittently fail (Bug #1783566); it is not currently skipped and I haven't seen failures reported for that one in a long time.

Change-Id: I2d252be140bd728ea01460a61a3097c6f3a2dc82
2021-11-29 20:09:18 +00:00
Balazs Gibizer
f294b0d8dc Test Network QoS minimum packet rate scenarios
Depends-On: https://review.opendev.org/c/openstack/neutron/+/805391
Depens-On: https://review.opendev.org/c/openstack/nova/+/811396

blueprint: qos-minimum-guaranteed-packet-rate

Change-Id: I4cb12a23f33d4feef6c800d23a0501d1aebb4f17
2021-11-29 15:17:25 +00:00
Ghanshyam Mann
17082ad2c9 Add openstacksdk-functional-devstack in integrated gates
openstacksdk-functional-devstack should be part of
integrated gate so that cross service-sdk testing
can be covered to avoid any regression.

Change-Id: Idaab1b0952b2d6d9c0e2b9b255ec401d2e315b19
2021-11-29 13:26:56 +00:00
Soniya Vyas
c08dfd2014 This patch creates the network v2.0 floating-ips-port-forwarding client.
https://docs.openstack.org/api-ref/network/v2/index.html#create-port-forwarding
Signed-off by: Soniya Vyas<svyas@redhat.com>

Change-Id: Icac4495c8a3fae877746652d0c9e00225b0a879d
2021-11-29 18:15:24 +05:30
Zuul
79da6961ed Merge "Test all supported python version for stable branch" 2021-11-25 05:33:05 +00:00
Zuul
db4066912b Merge "Add floating IP waiter" 2021-11-23 18:03:52 +00:00
Mitya_Eremeev
aca819b796 Take domain_id from config in some tests.
tempest.api.identity.admin.v3.test_tokens.TokensV3TestJSON.test_rescope_token fails
if not used default value for CONF.identity.default_domain_id

Closes-Bug: 1951446
Change-Id: Ie08d570907ddf9102c1297f717355a7f772aabb8
2021-11-18 16:36:11 +00:00
Zuul
ad8f599b32 Merge "Remove race from wait_for_interface_detach waiter" 2021-11-15 14:14:11 +00:00
Zuul
56bafba712 Merge "add delete group type testcase" 2021-11-15 13:37:23 +00:00