12706 Commits

Author SHA1 Message Date
Zuul
d69c11044f Merge "Remove LOG in misc.py" 2019-03-15 02:49:24 +00:00
Zuul
36ed3a8721 Merge "Set ENABLE_VOLUME_MULTIATTACH=true on tempest-slow subnode localrc" 2019-03-15 01:40:19 +00:00
Matt Riedemann
3858ced89c Set ENABLE_VOLUME_MULTIATTACH=true on tempest-slow subnode localrc
Before change Icb971831c8d4fe5f940d9e7993d53f1c3765e30f in devstack
in Rocky, the ENABLE_VOLUME_MULTIATTACH variable is used to control
whether or not the UCA is enabled on the node and defaults to False.
The tempest-slow job is multi-node and runs on stable branches since
change Ie5492603a12ca4ae56baa744bf650ae4d8036256 and as a result
is configuring the UCA on the subnode but not the controller, so
nova-compute on each node is running with different versions of QEMU
which can cause live migration failures if trying to live migrate
from a newer version of QEMU to an older version.

This fixes the issue by configuring the subnode with the correct
localrc value for ENABLE_VOLUME_MULTIATTACH.

Change-Id: Idea94dde6973805995c1678fcfb6b0e93025492a
Closes-Bug: #1819910
2019-03-13 10:18:08 -04:00
Alfredo Moralejo
3e7752c93f Make type decorator compatible with unicode strings
When importing unicode_literals from __future__ in tempest plugins as in
watcher, type is set as unicode instead of string when running in
python2, so the type is not properly detected. This is making that only
3 tests are detected as smoke in watcher tests plugins with python2 (other
may be affected) instead of 52 which are discovered as smoke with python3.

This patch uses six to make this compatible with both string and unicode
in python2.

Change-Id: Ibba9d8217f543fae0c232757ddb18c4fdf957aff
Co-Authored-By: yatin <ykarel@redhat.com>
2019-03-13 11:28:41 +01:00
zhufl
19cb7836dc Remove LOG in misc.py
LOG is not used in misc.py, so this is to remove it.

Change-Id: I5c1e3b675d770bbeaeece676880c56d840646284
2019-03-13 01:00:05 +00:00
Zuul
4d32506c71 Merge "Fix openstack-dev ML ref in test removal process." 2019-03-11 12:41:28 +00:00
Zuul
31db1f6f39 Merge "Update json module to jsonutils" 2019-03-09 07:59:44 +00:00
Zuul
6ab0a8f3cf Merge "Set concurrency default value" 2019-03-09 03:32:44 +00:00
Zuul
e7924e4c7c Merge "Remove admin test_l3_agent_scheduler API test module" 2019-03-08 21:18:45 +00:00
Zuul
c975f08e9b Merge "Make tempest-slow run on stable branch also" 2019-03-07 22:41:37 +00:00
ghanshyam
59a93d1bba Fix openstack-dev ML ref in test removal process.
Change-Id: I281ab52bc714e6b6dc1529f13b700d23caaf6f41
2019-03-07 17:25:29 +00:00
Slawek Kaplonski
edcc172db3 Remove admin test_l3_agent_scheduler API test module
Tests from this module are duplicated by same tests in
neutron-tempest-plugin repo.
Tests are in [1] module in this repo.

Both removed tests got 0% failure rate according to status.openstack.org
page.

It was discussed with QA PTL and he confirmed that those tests can
be removed from tempest. See [2] for details. Also ML thread about
this test removal notification[3].

[1] http://git.openstack.org/cgit/openstack/neutron-tempest-plugin/tree/neutron_tempest_plugin/api/admin/test_l3_agent_scheduler.py
[2] http://eavesdrop.openstack.org/irclogs/%23openstack-qa/%23openstack-qa.2019-03-01.log.html#t2019-03-01T16:18:32
[3] http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003574.html

Change-Id: I28f3bab54c25463d584db5398920d467a04bccf0
2019-03-07 05:01:46 +00:00
zhulingjie
92b87a5a43 Update json module to jsonutils
oslo project provide jsonutils, and we use it in many place[1],
this PS to update the remained json moudule to oslo jsonutils for
consistency.

[1]: 9594233ffd/tempest/lib/services/volume/v1/quotas_client.py (L15)

Change-Id: Ib8d9f49a1fdfa0f5e0cfb05a193dffb83e4cfe69
2019-03-06 22:54:51 +08:00
Zuul
ae046a31a3 Merge "Improved tempest plugin sanity check script" 2019-03-06 13:45:06 +00:00
Masayuki Igawa
13c588373c
Set concurrency default value
This commit sets the default value 0 for tempest run command.
Because stestr's run_command() requires an int value for that, but we
passes `None` if users don't specify a concurrency value. We found that
behavior with recent stestr change[0]. But we also have the bug in
tempest side.

[0] https://github.com/mtreinish/stestr/issues/231

Change-Id: I83f76acb6a106f7401904a910a5dced47c2db839
2019-03-06 22:01:37 +09:00
Zuul
57491eaa7e Merge "no force_tenant_isolation in DefaultDomainTestJSON" 2019-03-06 04:25:54 +00:00
Zuul
6ffd90691b Merge "Update neutron quota_driver path" 2019-03-05 02:24:00 +00:00
Trevor McCasland
8d94885df0 no force_tenant_isolation in DefaultDomainTestJSON
No need for dynamic credentials to test showing the default domain.

By setting this value to False, consumers with an immutable user source
can execute this test.

Depends-On: I83a9b8af775580d36a1141be55e9c1cc283a75b6
Partial-Bug: #1714277
Change-Id: Ib85691ae3f7b5a4d4a9da620b6ec46c44380ef03
2019-03-04 18:34:02 +00:00
Tony Breeds
a7c4c14493 stestr expects --concurrency to be an int
Change-Id: Ia56c182287510ffbaee412b6e2a3b1eb5ad510e0
Related: https://github.com/mtreinish/stestr/issues/231
2019-03-04 11:34:33 +11:00
Zuul
155aee98ca Merge "doc: fix compute API microversion list format" 2019-03-03 16:45:49 +00:00
Matt Riedemann
f786405da0 doc: fix compute API microversion list format
Change-Id: I5737b2c906b9e85e7cac3a3abd0746db608bc79d
2019-03-02 12:50:52 -05:00
Zuul
d819399bdb Merge "Make tempest-multinode-full job for stable branch" 2019-03-02 03:51:22 +00:00
Brian Haley
c2a0eb986f Update neutron quota_driver path
It is now at neutron.db.quota.driver.DbQuotaDriver

Change-Id: Ie57e27ffa89508381c86083a8c6a9d36ee95a674
2019-03-01 14:45:01 +00:00
Zuul
2cc8de817d Merge "Use rand_password() for password when creating user" 2019-03-01 06:45:45 +00:00
Zuul
474fa3fa9e Merge "Add NetworkSubnetPools to tempest cleanup" 2019-03-01 06:45:43 +00:00
Zuul
6fc72aaa25 Merge "add python 3.7 unit test job" 2019-02-26 09:57:29 +00:00
ghanshyam
00945fb93e Make tempest-slow run on stable branch also
tempest-slow has been added for stable branches also
- I5cb829beebcc59de682cba927f5b01793ec70d00

let's make this job definition to allow to run on stable branches also.

Change-Id: Ie5492603a12ca4ae56baa744bf650ae4d8036256
2019-02-25 12:32:51 +00:00
ghanshyam
42c9a8d00f Make tempest-multinode-full job for stable branch
tempest-multinode-full should be available to run on
all stable branch not just master. All the devstack
changes are backported already.

tempest-multinode-full will use Bionic node from
stein onwards and xenial for all other stable branches.

Change-Id: I94f66028df58a69aa7c26e8a03428bf48596d25c
2019-02-25 12:28:27 +00:00
zhufl
00e4777295 Use rand_password() for password when creating user
Some systems require strong passwords, so we'd better
use data_utils.rand_password() to create password when
creating user, to avoid password strength validation error.

Change-Id: I503ba6e068b6f7c8487b7077637ee21a9c104595
2019-02-25 07:56:54 +00:00
Chandan Kumar
97b1ad78ac
Improved tempest plugin sanity check script
* To use a fresh venv, use `--clear` option when creating a virtualenv
* Removes the project as the script fails to uninstall the dependencies.
* Added missing tempest plugins
* Log the stdout of each plugin in a file
* Adds some plugins to BLACKLIST to avoid errors

Change-Id: I5068d96105a22cbfd33f5900f4bdc21b47a65c06
2019-02-25 13:09:08 +09:00
Zuul
1a4b619110 Merge "Conditionally mark test_attach_detach_volume as slow" 2019-02-23 06:15:23 +00:00
Zuul
787ca5edca Merge "Allow decorators.attr to be conditional" 2019-02-23 06:15:20 +00:00
Zuul
517b6fc8e3 Merge "Mark test_server_connectivity_reboot as slow" 2019-02-23 06:15:18 +00:00
Pallav Gupta
1f6cc860ff Fix typo
Change-Id: Ie5ac0576459ffa9ae06251e56c7bcdd3f715efd5
2019-02-22 01:17:35 +05:30
Zuul
8688554660 Merge "Add unit tests for tempest cleanup" 2019-02-21 03:14:04 +00:00
Zuul
66158e6e09 Merge "Fix tempest cleanup" 2019-02-21 03:14:02 +00:00
Martin Kopec
e681998023 Add NetworkSubnetPools to tempest cleanup
The review adds support for NetworkSubnetPools service,
so if there are leftover subnet pools, tempest cleanup
is able to detect them and remove eventually.

Change-Id: Ieecde490d5eb20e1a894a7bdf3bcf0e7a54c08e2
Related-Bug: #1812660
2019-02-19 17:48:31 +00:00
ZhongShengping
f83799a7fe add python 3.7 unit test job
This is a mechanically generated patch to add a unit test job running
under Python 3.7.

See ML discussion here [1] for context.

[1] http://lists.openstack.org/pipermail/openstack-dev/2018-October/135626.html

Change-Id: I13a6f591cd43331a2690d7f08f73c28692f6886a
Story: #2004073
Task: #27445
2019-02-19 17:06:20 +08:00
Zuul
83e12b67c1 Merge "Update v3 identity group tests to work w/ pre-prov" 2019-02-19 08:56:09 +00:00
Zuul
69104c80a3 Merge "Remove deprecated services from cleanup" 2019-02-18 11:57:02 +00:00
Martin Kopec
470aca738c Add unit tests for tempest cleanup
In the previous patches, tempest cleanup got improved
and new methods were implemented. This review adds
more unit tests to exercise those changes and to
improve tempest cleanup test coverage.

Change-Id: Ibf30162e49a8cf87accdbe7f0a6cc38941873d5e
Related-Bug: #1812660
2019-02-18 10:51:57 +00:00
Martin Kopec
5a884bfbb0 Fix tempest cleanup
Edit service classes so that they discover initial
state of resources before deleting any.

Unify service names - f.e. if a service returns resources
in a list named server_groups, server_groups should be
the key of initial resources in the saved_state.json.

When is_preserve is True, security groups in
NetworkSecGroupService were filtered by networks present
in tempest.conf, however, these groups are associated
with a project_id, therefore it should be filtered
against projects present in tempest.conf.

Change-Id: I97d0115bbb43a089b33602df7c98e153984ceaf1
Related-Bug: #1812660
2019-02-17 23:52:51 +00:00
Trevor McCasland
4986d0da54 Update v3 identity group tests to work w/ pre-prov
I don't see any limitations by using pre-provisioned
credentials for these tests:

* test_group_create_update_get
* test_group_users_add_list_delete
* test_list_user_groups
* test_list_groups

Change-Id: Id22911035ce880ab1faa9b37b238b9372ae98087
2019-02-15 18:38:42 +00:00
Matt Riedemann
9968315d43 Conditionally mark test_attach_detach_volume as slow
Based on average test times from the last 300 runs
of the tempest-full job [1] this change marks the
test_attach_detach_volume test as slow but only if
SSH validation is enabled, which it is in tempest-full
but might not be in other jobs that run it, for example
in refstack which uses this test for interoperability
certification.

[1] http://paste.openstack.org/show/745114/

Change-Id: I47710321d8dfb0345c793e66bd09a5dd1933557b
Related-Bug: #1783405
2019-02-15 09:01:30 -05:00
Matt Riedemann
2999963ff8 Allow decorators.attr to be conditional
There are cases where we want to conditionally apply an
attribute to a test function, for example, if SSH validation
is enabled then a test may run much slower than if it is not.

This adds a 'condition' kwarg to the attr() decorator which
behaves similarly to the 'condition' kwarg on the skip_because()
decorator.

Change-Id: I83233854a217b6961e7614d7d9df1b4fc8d5a640
2019-02-15 09:01:26 -05:00
Matt Riedemann
b4763ef57e Mark test_server_connectivity_reboot as slow
Based on average test run times from the last 300 runs of
the tempest-full job [1] the test_server_connectivity_reboot
test is third slowest at about 200 seconds. This should not
be a surprise given all of the other tests in the same class
are already marked slow.

This change marks that test slow like the others which means
it will be run in the tempest-slow job.

[1] http://paste.openstack.org/show/745114/

Change-Id: Ie8ea1555cc4512bf29dff1e7df592dedfab28c61
Related-Bug: #1783405
2019-02-14 14:09:11 -05:00
Matt Riedemann
4b8a7b8638 Mark test_volume_boot_pattern as slow
Based on the average test times taken from the last 300 runs
of the tempest-full job [1] the test_volume_boot_pattern
scenario test is the slowest test that is not marked slow at
208 seconds.

This change marks that test as slow which means it will still
be run in the tempest-slow job.

[1] paste.openstack.org/show/745114/

Change-Id: Ibc5e5ecaa997744aecea8aff07e7a7e06178f5f3
Related-Bug: #1783405
2019-02-14 14:07:11 -05:00
Martin Kopec
9e43fd8bbe Remove deprecated services from cleanup
The patch removes deprecated services from
cleanup_service.py:
 * NetworkVipService
 * NetworkMemberService
 * NetworkHealthMonitorService
 * NetworkPoolService
 * FloatingIpService
 * SecurityGroupService
The above services are not used by the cleanup tool, they
call clients which were already removed from Tempest or
the clients are marked as deprecated ones.

Change-Id: I55ddbce64404c67688600dc6b1231d0bd8ff7006
Related-Bug: #1812660
2019-02-13 15:20:20 +00:00
Colleen Murphy
8b9980b497 Normalize endpoint path in oauth client
oauthlib uses the request URI as input for generating an oauth
signature and matching it against the incoming oauth_signature request
attribute. tempest also uses the URI to generate this signature, which
means the URIs must match exactly.

If the keystone catalog contains an endpoint with a trailing slash, such
as https://keystone.example.org/v3/, then the URI that tempest uses for
the signature generation will be
https://keystone.example.org/v3//OS-OAUTH1/request_token. The incoming
request URI that oauthlib sees will not have the duplicate slash and so
the resulting signature will differ, and the auth request will be
rejected due to mismatching HMAC-SHA1 signatures.

This patch corrects the issue for deployments that use a trailing slash
in their keystone catalogs (which is valid) by normalizing the path
before generating the signature.

Change-Id: Ie827b1af7b23c6d6eaf2c2894cc2629d0e252108
2019-02-12 15:43:59 +01:00
Zuul
00b8a6c204 Merge "Update v3 project tests to work w/ pre-prov" 2019-02-12 08:46:51 +00:00