13545 Commits

Author SHA1 Message Date
Lukas Piwowarski
a9055010fc Create documentation for tests
Generate documentation for each test from its docstring.

The sphinx-apidoc tool is used to generate the .rst
files necessary for the generation of the documentation.

When the documentation is being build only functions that
start with "test" are passed to the resulting documentation.

Change-Id: I1878f67e10df9bb1f8289beda8e59a56b5057fe4
2020-09-02 09:46:00 +02:00
Lucas Alvares Gomes
0976ae4ee2 Skip test_qos_min_bw_allocation_basic when not supported
The test_qos_min_bw_allocation_basic relies on a feature [0] which is
not supported by all Neutron backends. This test for example will fail
for OVN until [0] is implemented for it.

This patch makes the test skippable instead of failing when the backend
does not support it.

[0]
https://specs.openstack.org/openstack/neutron-specs/specs/rocky/minimum-bandwidth-allocation-placement-api.html

Change-Id: I608c123e69b2e1b34fa0783d03ee5603d901351d
Signed-off-by: Lucas Alvares Gomes <lucasagomes@gmail.com>
2020-09-01 10:09:29 +01:00
Hemachandra Reddy
e866da9a11 Wait until dependent resource is deleted
This makes network cleanup to wait until its
ports are cleanedup.

Change-Id: Ied4e1e02973942f421afc257f201bbdba3aa879d
Closes-bug: #1893487
2020-08-31 18:21:46 +00:00
Zuul
c9643dc3f5 Merge "Use of single interface for creating image" 2020-08-28 21:05:42 +00:00
Zuul
198c3e05dc Merge "Add new tests for check-uuid tool" 2020-08-28 11:12:07 +00:00
Soniya Vyas
be8d510958 Use of single interface for creating image
Within scenario manager, we had two methods for creating image
those are as follows:
1. _image_create() - private interface which creates image
2. glance_image_create() - public interface which uses the above
   method eventually to create image

Hence, let's have single method for single work. Thus, we need to
replace '_image_create()' with 'image_create()'.

Implements: blueprint tempest-scenario-manager-stable
Signed-off by: Soniya Vyas<svyas@redhat.com>
Change-Id: I33e6abd416bbe5964a279f7969615ffd2974b4dd
2020-08-28 12:14:25 +05:30
Ghanshyam Mann
ff145e61ce Use the networking-l2gw project new location
networking-l2gw and networking-l2gw-tempest-plugin are
imported to new location now and supposed to be retired from
openstack/namespace[1].

-https://review.opendev.org/#/c/744110/

[1] http://lists.openstack.org/pipermail/openstack-discuss/2020-June/015647.html

Change-Id: If00bffe2b6d303686e15060f6b03400ad5a3089f
2020-08-27 22:25:41 +00:00
Zuul
4792d42d41 Merge "Fix and unskip test_list_servers_filtered_by_ip_regex" 2020-08-21 08:23:00 +00:00
Zuul
2321f00e84 Merge "Improve unit tests for subunit_describe_calls" 2020-08-20 04:59:16 +00:00
zhufl
0539a64d1b Adding description for testcases - swift part2
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: Id8f747c0eb018847bd9dc5bc3801ee973704da4b
partially-implements: blueprint testcase-description
2020-08-20 11:06:16 +08:00
Doug Schveninger
6aa733e0f3 Improve unit tests for subunit_describe_calls
in order to enhance the cmd to support kubernetes url based
routing over port based routing.  Once this is merged I will
submit another patch set to subunit_describe_calls to support
-u --urls (Optional) The path to a JSON file describing the urls
  being used by different services. Note Can not be used with -p.

Added test cases for cliff subprocess and found a bug with the
-v. The standard -v --verbose of cliff conflict with this command
 so I changed the -v --verbose to -a --all for print header
with printing to stdout I am also getting ready to add test cases
for cliff subprocess support for different options. Bug #1890060

Correct os join in test cases to avoid a conflict with
https://review.opendev.org/#/c/683026

Closes-bug: #1890060
Change-Id: I9459db0dbeda721187ea5f4802c7453c2092dac3
2020-08-18 17:25:21 -05:00
zhufl
85535164b7 Adding description for testcases - swift part3
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: I60d39b91ae064300347a789aa1b72a3115afae76
partially-implements: blueprint testcase-description
2020-08-18 16:59:41 +08:00
Martin Kopec
0a07a0e51f Fix and unskip test_list_servers_filtered_by_ip_regex
The test assumes that all ip addresses will be allocated in a very
specific and static way. The patch improves the calculation of the
ip regex.

Change-Id: Icb871c2b106ee0b9770b89d15c54bef65297977c
Closes-Bug: #1540645
2020-08-17 09:30:25 +00:00
zhufl
067bcd0708 Adding description for testcases - volume part5
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: I7d082da0ad581b5bdd5cdce0a91c629e198f820b
partially-implements: blueprint testcase-description
2020-08-14 16:56:34 +08:00
zhufl
a56823734b Adding description for testcases - volume part4
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: I42bdbf251b2618d8c2de7bd0fd404467576be6fb
partially-implements: blueprint testcase-description
2020-08-14 14:56:57 +08:00
Zuul
25ec807af3 Merge "Adding description for testcases - identity part2" 2020-08-14 05:32:25 +00:00
Zuul
8c277fcad0 Merge "Add response schema validation for volumes" 2020-08-14 05:32:22 +00:00
zhufl
2480d2f919 Adding description for testcases - volume part3
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: I0628019dc0ea7302115aa83af33091d70a3db050
partially-implements: blueprint testcase-description
2020-08-14 11:16:39 +08:00
Zuul
c23e0b4e53 Merge "Add skip flags for block level live migration" 2020-08-14 02:18:46 +00:00
zhufl
735e169ff5 Adding description for testcases - compute part12
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: I5564ff0b71f56445977a79c2c813b2e3e31000c9
partially-implements: blueprint testcase-description
2020-08-13 16:46:50 +08:00
zhufl
ef323632da Adding description for testcases - compute part10
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: I0ca6cbed5b2f8517096ed95e40c5e5766862c012
partially-implements: blueprint testcase-description
2020-08-13 10:38:40 +08:00
zhufl
e354fa7675 Adding description for testcases - compute part9
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: Iffbaa7489d219ae4138874fe6c5702e858417573
partially-implements: blueprint testcase-description
2020-08-12 17:07:50 +08:00
zhufl
e4fb4229c9 Adding description for testcases - compute part8
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: I858158cf4fb5e75208177f2c49b4e7f350f09a1e
partially-implements: blueprint testcase-description
2020-08-12 15:36:31 +08:00
zhufl
36ef089e18 Adding description for testcases - compute part7
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: I26f0b5dc72c3b1943e913e63b36e2beb4af1cede
partially-implements: blueprint testcase-description
2020-08-12 13:49:43 +08:00
zhufl
4e726a6691 Adding description for testcases - compute part6
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: I1469ad5a34bac75203b2eb063326eded096706a5
partially-implements: blueprint testcase-description
2020-08-10 16:30:28 +08:00
Zuul
24961f6244 Merge "Adding description for testcases - compute part3" 2020-08-07 19:30:22 +00:00
zhufl
8e3aacd7e9 Adding description for testcases - identity part2
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: Ifd23fd4cc442a3188a5a19b506694abffadea610
partially-implements: blueprint testcase-description
2020-08-07 17:03:53 +00:00
Zuul
0a4161558d Merge "Add default headers to the volume show_version request" 2020-08-05 05:54:11 +00:00
Zuul
b652e78103 Merge "Enable xindy for PDF build" 2020-08-04 10:05:45 +00:00
Zuul
b18d7dda30 Merge "Add glance image import web-download tests" 2020-07-31 08:05:39 +00:00
Zuul
00041e686f Merge "Add response schema validation for volume group snapshots" 2020-07-31 02:03:31 +00:00
Zuul
f2727fa6b4 Merge "Adding description for testcases - identity part5" 2020-07-30 18:28:05 +00:00
Zuul
82697e9253 Merge "Adding description for testcases - compute part5" 2020-07-30 18:08:58 +00:00
Zuul
4237716010 Merge "Fix KeyError exc in volumes_client" 2020-07-30 13:56:29 +00:00
Zuul
c02aa28390 Merge "Adding description for testcases - compute part4" 2020-07-30 11:47:54 +00:00
Zuul
c1d71ca445 Merge "Adding description for testcases - network part3" 2020-07-30 10:58:50 +00:00
Zuul
40ed7ac833 Merge "Adding description for testcases - identity part3" 2020-07-30 10:58:48 +00:00
zhufl
a7635d7175 Adding description for testcases - identity part5
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: I47fc64ac84b4d0ea3da0a9469efec7bd6e0b0f3d
partially-implements: blueprint testcase-description
2020-07-30 09:01:44 +00:00
zhufl
b5603bc4f8 Adding description for testcases - compute part5
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: I20744e4957fbd5b039fdd52ac530f11ac6d72319
partially-implements: blueprint testcase-description
2020-07-30 10:05:37 +08:00
zhufl
67b3d38934 Adding description for testcases - compute part4
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: If14b4ec678355c850275ef38f9ed70cc0c877946
partially-implements: blueprint testcase-description
2020-07-30 09:00:34 +08:00
Zuul
3b9f03ec6d Merge "Adding description for testcases - network part1" 2020-07-29 18:47:32 +00:00
Zuul
2ff32b34b2 Merge "Adding description for testcases - volume part2" 2020-07-29 18:19:03 +00:00
Zuul
10b4af0ade Merge "Adding description for testcases - network part2" 2020-07-29 16:10:06 +00:00
Zuul
bb31c0c497 Merge "Adding description for testcases - identity part4" 2020-07-29 15:34:26 +00:00
Gayathri Devi Kathiri
fe7a983a3d Add default headers to the volume show_version request
When openstack is deployed with kubernetes and openstack-helm
and when tempest test suite is run against that lab, 
test_versions.VersionsTest.test_show_version tempest test case
is failing. This issue is not reproducible on all the labs 
deployed with kubernetes and helm but only on one of the lab. 
There is nothing inconsistent found in the cinder functionality 
on that lab except this test case failure.

Adding 'Openstack-Api-Version' header to the "show_version" request 
as that of "list_versions" request solves the above issue.
'Openstack-Api-Version' header is included in default headers.
So, modifying "show_version" request to include default headers
as there will be no negative impacts.

Change-Id: I2f1970d4595c1b32c05f27c5c0eb3e28a75d7052

Closes-Bug: #1887789
2020-07-29 12:34:50 +00:00
Ghanshyam Mann
1425ecd42e Add glance image import web-download tests
Glance image can be imported with web-download
import method
- https://docs.openstack.org/api-ref/image/v2/index.html#interoperable-image-import

Depends-On: https://review.opendev.org/#/c/742574/
Change-Id: I6f30f6fd0e63d83a7abac4eccc2a8ad57365a7ce
2020-07-28 13:02:54 +00:00
Zuul
118b03cbe8 Merge "Stop to use the __future__ module." 2020-07-28 13:01:46 +00:00
Lukas Piwowarski
a9af3ead37 Add new tests for check-uuid tool
Create tests to check whether the --fix and --package arguments
of check-uuid utility work correctly.

Partially-Implements: blueprint tempest-cli-unit-test-coverage

Change-Id: Iadab5b1f0e0b61de3f5686c964c691dfe8c7ecd5
2020-07-28 09:39:15 +02:00
Zuul
03b20d858a Merge "Add response schema validation for show_default_group_type" 2020-07-28 04:58:59 +00:00
zhufl
b9358201c7 Adding description for testcases - identity part3
When Tempest is used in customer site, often we are required to
provide a testcase list including testcase names and descriptions.
Now no this kind of doc is available, so we can add descriptions
with the format of doc string for every testcase, so later we
can generata such a testcase description list.

There are hundreds of testcases missing descriptions, so we can
add them gradually, and limit the modified files in one patch
for the convenience of reviewing.

Change-Id: I6d8fd63c7a473b498cde35ed53d83270b9e526c3
partially-implements: blueprint testcase-description
2020-07-27 14:26:34 +08:00