Commit Graph

13270 Commits

Author SHA1 Message Date
Ghanshyam Mann
6726b74f43 Use the master constraint again in tox.ini
WHile releasing the new tag for Tempest, we modified the
constraint in tox to be used of stable/ussuri
- https://review.opendev.org/#/c/720578/

Now new tag is released and we can bring back the master
constraint in tox.ini so that Tempest master us master constraint.

Change-Id: Ie17d4830cac1902371123c8acb4d3106ba2fd300
2020-04-21 15:15:02 -05:00
Ghanshyam Mann
b5b0cf4904 Use stable constraint in tox to release new tag for Ussuri
We are going to releease Tempest new tag to declare the start of
support for stable/ussuri. So that new tag use stable/ussuri
constraint in the tox env.

For example: if anyone use Tempest 24.0.0 in future say 1 year later then
tox env also should use the ussuri contstraint for compatibility instead
master.

These need to be move back to master constraint once release is done.

By using master constraint in tox for all the old tag is problem and
we faced the issue of constraint incompatibility due to that and we
have to work around it all over the devstack, tempest role, grenade to
set the stable constraint cia env var.

- I4268049ff91e5527e4b95fd8a70fa53ba27d56ed

Change-Id: I39e3e23a85a9abc1eda6848a6f4af77540cb81b6
2020-04-21 20:05:05 +00:00
Zuul
8f3e503413 Merge "Adding description for testcases - compute part1" 2020-04-15 08:19:01 +00:00
Dmitry Tantsur
5c191faae7 Explicitly handle baremetal ports when checking if they are active
Currently we rely on [service_available]ironic which
1) will give incorrect results in a mixed environment
2) doesn't work in grenade jobs

This change only allows ports to be DOWN when they have VNIC type
of baremetal.

Change-Id: If24913b7097c5252a214bb780fc786aa0c3f983b
2020-04-14 17:10:20 +02:00
zhufl
2a6dcdbd0c Adding description for testcases - compute part1
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, however, we can extract info
from tempest code to create one, but, some testcases don't have
descriptions about what the testcases are testing, so, we can add
descrption for each testcase.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: Id90d6fedccc84aa9548fba62b5926a75050ab443
partially-implements: blueprint testcase-description
2020-04-14 07:46:39 +08:00
Zuul
3d13f07ed6 Merge "Fix deletion of network quotas" 2020-04-13 17:01:14 +00:00
Zuul
26062e4ac9 Merge "Add glare and taas to blacklist" 2020-04-13 04:43:50 +00:00
Zuul
fe28c849d8 Merge "Pass clients to compute base's create_test_server" 2020-04-13 04:43:48 +00:00
Masayuki Igawa
14d66b6a26
Add glare and taas to blacklist
This commit adds x/glare and x/tap-as-a-service to the BLACKLIST to
avoid sanity-job failures like following.

 Failed Plugins: x/glare, x/tap-as-a-service,
 + [[ -n x/glare, x/tap-as-a-service,  ]]
 + exit 1

It looks the root cause is related to pg_config installation but not
sure. So, this commit just blacklists them as a workaround.

 Error: pg_config executable not found.

Change-Id: I03c6f01593b8e414b5e111d0e0c971ae156da715
2020-04-13 09:32:11 +09:00
Zuul
91f0e00882 Merge "Keystone - List user groups 'membership_expires_at' attribute" 2020-04-10 00:18:33 +00:00
Kristi Nikolla
30638b53a4 Keystone - List user groups 'membership_expires_at' attribute
With the introduction of expiring group memberships, there is a
new attribute `membership_expires_at` when listing user groups.
This patch updates the test to check the attribute and then
ignore it for group dict comparison.

Change-Id: I4294a879071dde07e5eb1da4df133de8032e1059
Partial-Bug: 1809116
2020-04-09 11:56:46 -04:00
Zuul
329247f3ec Merge "add unittest for create and list resource types association" 2020-04-09 11:40:14 +00:00
Zuul
d46b7f988e Merge "Fixed test related to tag-ext" 2020-04-09 11:40:12 +00:00
Zuul
9647e473b7 Merge "compute: Use valid extra specs to test 'os-extra_specs' API" 2020-04-08 21:15:42 +00:00
Zuul
08711d3daa Merge "compute: Add negative volume update multiattach test" 2020-04-08 19:50:11 +00:00
Zuul
baecb1e674 Merge "Modify the incorrect fake data" 2020-04-07 20:04:19 +00:00
Zuul
f1bc111116 Merge "Update hacking for Python3" 2020-04-07 10:27:47 +00:00
Lee Yarwood
4b1085233f compute: Add negative volume update multiattach test
The introduction of Icd7fcb87a09c35a13e4e14235feb30a289d22778 blocks
attempting to update or swap a volume that is currently attached to
multiple instances. This change adds a simple test to assert that a
BadRequest is raised when this is attempted directly against the compute
API.

Future work will also cover this failure when part of a wider volume
retype or migration flow.

Change-Id: I931a810901cf7847a8259e44a30b0150aad859f2
2020-04-07 09:49:06 +00:00
Artom Lifshitz
68f1e5e8cd Pass clients to compute base's create_test_server
Previously, create_test_server() in the base compute test class did
not provide a way to create a server with admin privileges. This can
be necessary when using APIs that are admin-only by default, for
example the `host` parameter when creating a server in Nova
microversion 2.74. This patch adds a clients kwarg to
create_test_server(). This kwarg is then passed to compute.common's
create_test_server() instead of the cls.os_primary clients that was
harcoded previously.

Change-Id: Ic47e6a4ced54739de9325bb14e332ba15cdb210f
2020-04-06 22:08:42 -04:00
Andreas Jaeger
b8435b27ac Remove universal wheel building
- Remove obsolete sections from setup.cfg:
  * Wheel is not needed for python 3 only repo

Change-Id: I95a717b873c8c21eeec4617b66c42cd6dbf226b2
2020-04-04 17:36:03 +02:00
Andreas Jaeger
f27a334e21 Update hacking for Python3
The repo is Python 3 now, so update hacking to version 3.0 which
supports Python 3.

Fix problems found.

Update local hacking checks for new flake8, remove vi check, it's now in
hacking as H106.

The tempest plugin is used on older branches as well.
We really only need hacking on this repo anyways,
where we no longer support python 2, so here we
make the requirement specific to python 3.

Change-Id: I3f4216f66606fbc450a46c93de306399b7f3cd65
2020-04-04 10:33:23 +02:00
Zuul
6e376b6eed Merge "Check no specific group present in group list" 2020-04-03 20:22:49 +00:00
Zuul
41f48727af Merge "Support force-deletion of servers." 2020-04-03 20:19:09 +00:00
Zuul
94e83edb27 Merge "Replace old requires-python with python-requires" 2020-04-02 02:44:16 +00:00
Andrey Volkov
8b29792f43 Check no specific group present in group list
Let's check no specific group present instead of list is empty
in test_group_snapshot_create_show_list_delete.
This maybe a reason of failed test due to some inconsistency.

Closes-Bug: #1869852
Change-Id: I41884567ae07b4d6a28667d2a3a792b63e1a6cfa
2020-03-31 11:27:02 +03:00
Martin Kopec
e743e5d394 Blacklist x/kingbird project from sanity-check
x/kingbird doens't seem to be compatible with tempest anymore
which is breaking our tempest-tox-plugin-sanity-check gate job.

Change-Id: Icdaff49bbc2ba0e59cd528d55cad6c35014b7ad0
2020-03-30 13:50:15 +00:00
Zuul
b47d1d2b8a Merge "Fixes race condition in test_add_remove_fixed_ip" 2020-03-27 22:19:38 +00:00
Ghanshyam Mann
7cd0186dbe Replace old requires-python with python-requires
requires-python is old value and does not work, python-requires
is right metadata.

'python-requires' is introduced from PEP440 and requires-python was old value
in PEP345.
- https://packaging.python.org/guides/distributing-packages-using-setuptools/#python-requires
- https://www.python.org/dev/peps/pep-0345/#requires-python

Change-Id: Id4a5197ec5dcaab419304e9244f4c6d319e8b5c6
2020-03-27 13:40:35 -05:00
David Sedlák
61a3c8efa4 Fixes race condition in test_add_remove_fixed_ip
Currently race condition can occure in
tempest.api.compute.servers.test_attach_interfaces.
AttachInterfacesUnderV243Test.test_add_remove_fixed_ip
when floating IP added during resource preparation doesn't appear in
the list of original IPs that is created at the beggining of the test,
which then confuses the test
and floating ip is later recognized as fixed IP added in the test.
more details including log:
https://bugzilla.redhat.com/show_bug.cgi?id=1752416

This change ensures possible floating IP added during server
creation is always present in the set of original IPs and also
during every comparasion of IPs.

Closes-Bug: #1866179

Change-Id: Ic3a3e0708714b6d6c9c226e641e1c520e5ebde9d
Signed-off-by: David Sedlák <dsedlak@redhat.com>
2020-03-27 02:42:37 +00:00
Lukas Piwowarski
97b841130d Fix deletion of network quotas
Network quotas could be deleted after deletion of project. This
caused the cleanup to fail as network quotas have to be deleted
before the deletion of project.

This fix makes sure that network quotas are deleted before the
deletion of project.

Change-Id: I8576e2c6f1ae6dc90850dd3d8eade7c10942e413
2020-03-26 14:01:20 +00:00
Zuul
348fa311fe Merge "Create default network for compute volume and negative metadata tests" 2020-03-25 23:18:45 +00:00
wangzhiguang
33e0e069fe add unittest for create and list resource types association
add unittest for create and list resource types association
interface of metadata in glance module

Change-Id: I3f7bff1fcad32450b71f4ddd16e579cd53961fe9
2020-03-25 17:26:19 +00:00
Zuul
e5a2ad484a Merge "Make tempest-multinode-full py2 job on py2" 2020-03-24 13:55:17 +00:00
Zuul
c8058d0c13 Merge "add unittest for delete resource types association" 2020-03-22 01:50:47 +00:00
Zuul
6e79824135 Merge "services: Introduce a cinder v3 attachments client" 2020-03-22 01:50:45 +00:00
Zuul
8ec57b51d5 Merge "Add subnet_id option" 2020-03-19 21:17:04 +00:00
Ghanshyam Mann
7d91b69081 Create default network for compute volume and negative metadata tests
server metadata and volume tests also create server without passing
the network to nova which further fail if more than one test network exists.

http://eavesdrop.openstack.org/irclogs/%23openstack-qa/%23openstack-qa.2020-03-03.log.html#t2020-03-03T15:57:34

Partial-Bug: #1844568
Change-Id: I9956946a4309b9a013fd53b0db06718372a9213c
2020-03-19 14:05:28 +00:00
Zuul
1eda90cf06 Merge "Modify the application credentials fake data" 2020-03-19 11:23:51 +00:00
Zuul
ccd16f7a49 Merge "Cleanup images properly" 2020-03-19 11:23:49 +00:00
AbhishekJ
61b9fd2310 Fixed test related to tag-ext
according to bug https://bugs.launchpad.net/neutron/+bug/1682775
tag-ext renamed to standard-attr-tag, after Stein release.
Related-Bug: #1682775

Change-Id: I6f16829a2430e428d80138d25137bd8263f9c15e
2020-03-19 09:19:15 +00:00
Zuul
a09c82023b Merge "Update README for run-tempest role" 2020-03-19 03:11:22 +00:00
Lukas Piwowarski
2385e0417b Add subnet_id option
When tested network contained more than one subnet then test failed
due to assert call.

Subnet_id option specifies which subnet should be used for testing
when more than one subnet in network is present. If subnet_id is
specified then each created VM is assigned a floating IP within
the range of the subnet.

Closes-Bug: 1856671
Change-Id: Ie4d44b16595055201e12f10982fc78683a12d41a
2020-03-18 10:15:55 +00:00
Zuul
4bc12aad2e Merge "modify status code according to the latest API documentation" 2020-03-17 13:13:24 +00:00
Zuul
51fe1ae61b Merge "Add response schema validation for volume quota classes" 2020-03-16 02:21:32 +00:00
Zuul
3a326062e8 Merge "Add response schema validation for volume types" 2020-03-16 02:15:56 +00:00
Zuul
c34a0599fd Merge "Delete network quotas" 2020-03-16 02:15:54 +00:00
Ghanshyam Mann
0fb306f2e0 Make tempest-multinode-full py2 job on py2
tempest-multinode-full is python2 version
of mutlinode testing for stable branches and
supposed to run on python 2 but it was left during
- I75868d5c9b6630fe78958ff89e58a0aced09a6b3

Change-Id: Ibec72b578424cb278006ac810bdd0359ec23de3f
2020-03-15 14:43:44 -05:00
Zuul
714c607a36 Merge "Prevent SSH client proxy loops" 2020-03-13 16:13:32 +00:00
Lukas Piwowarski
2c83124392 Cleanup images properly
Images weren't deleted properly due to bad request sent to
glance API. Also ImageService ignored 'next' parameter returned from
glance API when listing images which is required when more images
are present.

The fix lists all images properly. If 'next' parameter is present
in the glance API response then the API is asked to send next part
of image list.

Closes-Bug: 1866988
Change-Id: I9ebeccb545576e43ef0fc96c29169ae16f261f34
2020-03-12 10:19:04 +00:00
wangzhiguang
65e37a2bf5 add unittest for delete resource types association
add unittest for delete resource types association interface
of metadata in glance module

Change-Id: I22e62f33b67002b8a0e1bd24f311df367500c32b
2020-03-07 12:23:54 +08:00