When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.
There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.
Change-Id: I8577ceddcc99f77cfa091519d1466f075de54e43
partially-implements: blueprint testcase-description
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.
There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.
Change-Id: Id3e49c09116c08b6a017b6bb9d016bb31cad9fcd
partially-implements: blueprint testcase-description
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.
There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.
Change-Id: I5f4cd174a3dc2f23188b72ff856ec4e8f4b51414
partially-implements: blueprint testcase-description
This adds an initial test for glance image interoperable import
that uses the glance-direct method. It will skip if the server
does not support glance-direct.
Adding feature flag to enable the import tests as devstack on
stable branches cannot support image import feature.
Change-Id: I09e7fb4e7758edd5256ae70ceeea6f143466c3e3
is_resource_deleted method of v3 volumes_client was wrongly accessing
id value of a volume causing KeyError - in case the being deleted
volume was in error_deleting state.
Closes-Bug: #1887980
Change-Id: I6cea9917c248ceaa8b7cd60d0a20a2bf7540d9b9
Replace legacy-tempest-dsvm-lvm-multibackend with its native version,
cinder-tempest-lvm-multibackend.
Remove legacy-tempest-dsvm-neutron-dvr-multinode-full, which was defined
as an experimental job in neutron and removed during the ussuri lifecycle.
See https://review.opendev.org/#/c/693630/
It seems neutron-tempest-dvr-ha-multinode-full should cover its use case.
Change-Id: I6edfd00f0c43cd0bfe688db5e43768288dd4c1c1
This is to add response schema validation for volume backups.
Change-Id: I2ab6ecfeb0c48c7ef4a0fc94e670d43dbc3f6650
partially-implements: blueprint volume-response-schema-validation
This has been observed recently that block level live
migration started failing with micro version 2.24 if the
user doesn't mention the "block_migration_for_live_migration"
it adds none in the api and thus tries to run it as shared
storage live migration and thus the test failed.
Change-Id: I4a3c1b83ee51a03a49f96b83e020419a306a15b3
Closes-Bug: 1884832
We replaced usage of third party mock by the standard library in:
https://review.opendev.org/#/c/721021/
There are 2 forgotten occurrences where we still use the third
party mock, the patch fixes that.
Change-Id: I7d00be25bb0b70ce55e27790df33d9134c2a52ae
Some tests fail when Accept-Range header is not present in the
response of the API. This is not necesseary as the Accept-Range
header is not mandatory according to RFC [1].
[2] https://tools.ietf.org/html/rfc7233#section-2.3
Closes-Bug: #1885723
Change-Id: I521eb4a332937328b5010df53ddab2af76090202
As discussed in Victoria PTG[1], we need to start pining
the constraint in tox.ini on Tempest new release so that our
tox.ini can match with compatible constraints with Tempest version.
[1] https://etherpad.opendev.org/p/qa-victoria-ptg
Change-Id: Ib705f59ef3aea93b2778cc87fc44d390b5a62c94
Let's remove deprecated scenario image options which have been
deprecated for more than 4 years.
From now on CONF.scenario.img_file will need a full path for the image.
CONF.scenario.img_dir was deprecated and will be removed in the next
release. Till Tempest 25.0.0, old behavior is maintained and keep working
but starting Tempest 26.0.0, you need to specify the full path
in CONF.scenario.img_file config option.
Change-Id: I96d26ad3889f55d867fdea016953cce522a6fbdf
Related-Bug: #1393881
As explained in [1] it is not legitimate to require a Transfer-Encoding
header in Swift responses. That prevents running some tests
successfully in the case where Swift is behind a proxy/load-balancer
that does not use any Transfer-Encoding in its responses.
This change hence removes the checks for the presence of a
"Transfer-Encoding" header, and replaces them by the use
of the existing check methods, after modifying the
custom_matcher checks on which these methods rely on to accept
either a Content-Length or a Transfer-Encoding header.
Some adaptation was also required to avoid trying to process 'etag'
for DELETE requests.
A side-effect of this change is a code simplification and
cleanup since the specific header checks in the corresponding
tests are replaced by the generic check methods.
[1] https://bugs.launchpad.net/tempest/+bug/1819851/comments/3
Closes-Bug: 1819851
Change-Id: Iaccea41640a53b564f72cee73981e2e61d3e80ae
* adding a patch
* applying a patch
* adding uuid to test - with and without decorator
* adding import line to tests with uuid
Closes-Bug: #1878171
Change-Id: I59e2cb3bd0ee9a8b525b5904fd39eba446205efd
This patch increases test coverage of verify_tempest_config
partially-implements: blueprint tempest-cli-unit-test-coverage
Change-Id: I87966469df42f0fbabfa2b265398a101af414c9f
The bug which was the reason for skipping the test is considered
resolved. To make sure the test works, let's mark it unstable
for a while.
Change-Id: I7f02d82f5758bc2e32b06234652f755512a74787
Related-Bug: #1317133
The bug which was the reason for skipping the bug has got expired
which suggests that the test is no longer causing problems.
Just to make sure the test works, let's mark the test as unstable
for a while.
Change-Id: I4c68caa693744e06de6be89a8f09d8f7e8ce8ba0
Related-Bug: #1836595
tempest-tox-plugin-sanity-check job is failing due to missing virtualenv.
As the job is running on master only and we don't support python2 anymore,
this patch edits the tempest-plugin-sanity.sh script so that it uses
python3 venv module to create a venv.
Change-Id: I3f711ec97ad9006c715bb45db9d8dd9d951bb6a1
From nova microversion 2.75, additional parameters of list_services
are not allowed, so test_get_service_by_invalid_params should be
skipped for microversion >= 2.75.
Change-Id: Iba870f077203d3f0d154aeb24de491a7534290af
Concurrency parameter for account-generator command was accepting
negative values and zero.
This patch makes sure that when the account-generator is passed
a negative value or zero, it ends with an error.
Closes-Bug: #1811349
Partially-Implements: blueprint tempest-cli-unit-test-coverage
Change-Id: I4d7de89b2ad3ee91d113da3746fe393d8cce2aa2
'Member' role has been deprecated and replaced by 'member'.
The patch replaces the leftover occurrences of 'Member' by 'member'.
Change-Id: I857655b8568eb2df1bb9bc263117119388d42f01
Closes-Bug: #1330132
In delete_group() method the group is deleted first and
then the volume information is fetched which internally
trys to find all the related groups. As group delete request
was placed earlier than volume list and the group might be
deleted before volume list try to find the group
information, it returns 404.
This is race condition based on group is finish its deletion
before list volume requests or not.
Better is to fetch the information of volumes first and then
delete the group. And use that volume info later
to cleanup the volume also if requested.
Change-Id: I5b52ebac2f325bfeda51773c90cb40e7f7e02c67
Closes-Bug: #1882116
