12746 Commits

Author SHA1 Message Date
Martin Kopec
598b1ae854 Improve router deletion logging in tempest cleanup
Improve logging in tempest cleanup when a router and
its interfaces are being deleted. The review adds a
try except block for every attempt to remove a port.
By that addition any port error will not be hidden
behind the router error the port is attached to.
It will provide more precise error logging.

Change-Id: I475deec7b29600627f68ff07c5546e55cdab100f
2019-04-02 12:51:44 +00:00
Martin Kopec
fd01fe9445 Improve logging in tempest cleanup
Add id or name of the resource which failed to delete
to the logging.

Change-Id: I04b04406e3917a63332199adf5c15b8e4ed6ca5a
2019-04-01 14:31:43 +00:00
Zuul
db2fbc9268 Merge "Remove sys unused" 2019-03-28 13:07:18 +00:00
Zuul
89733c6ac3 Merge "Remove the Ocata stable branch jobs from master gate" 2019-03-27 20:09:06 +00:00
Zuul
35ed1a80bc Merge "Use base.delete_server in test_servers.py" 2019-03-27 09:13:47 +00:00
Zuul
cf75dba44e Merge "Add release notes page for version 20.0.0" 2019-03-27 07:44:56 +00:00
Zuul
1a2f37013a Merge "Use nova zuulv3 job for nova v2 API" 2019-03-26 22:38:51 +00:00
Zuul
25f5d28f3c Merge "Fix potential issue with adding a fixed ip" 2019-03-26 15:12:13 +00:00
Zuul
84062c9b89 Merge "Replace openstack.org git:// URLs with https://" 2019-03-26 09:06:02 +00:00
ghanshyam
1546211874 Add release notes page for version 20.0.0
Tempest 20.0.0 has been released [1].
This commit adds a new page for 20.0.0 release notes.

[1] https://review.openstack.org/#/c/645867/

Change-Id: Ic946b84e0003cc4cca85c1922816b8a0a3b8a3bf
2019-03-25 23:37:44 +00:00
Ian Wienand
ff3851b593 Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: Iff8f93426925a3480cedfb899216e443b12cd826
2019-03-24 20:36:15 +00:00
ghanshyam
787e694269 Remove the Ocata stable branch jobs from master gate
Tempest 20.0.0 is released now, which marks the end of support
for Ocata release - https://review.openstack.org/#/c/645867/

We do not need to run the Ocata stable job om master gate now.
Depends-On: https://review.openstack.org/#/c/645867

Change-Id: I883f3c98201631acdadeaab6678a796a85662e44
2019-03-22 21:12:51 +00:00
ghanshyam
a955095f83 Add releasenote to tag the Tempest for Stein release
This commit adds the releasenote to tag Tempest for Stein
and needed for version 20.0.0 to release.

This relesenote also mark end of support for Ocata release as
ocata is in EM state.

Once we release the Tempest 20.0.0, we will remove the ocata job
from master gate.

Change-Id: I93bf37e31497881536b85783dc3cff70a56b04cb
20.0.0
2019-03-22 05:02:49 +00:00
Zuul
a511109572 Merge "Checking config file actually exist or not in tempest run" 2019-03-21 21:38:08 +00:00
Zuul
e83940d21a Merge "Remove unused and duplicate nodeset defined in Tempest" 2019-03-21 04:41:16 +00:00
Paul Belanger
4c7b79ac3f Default gabbi_tempest_path to empty string
Seems this variable is setup from gabbi-tempest, but other jobs also use
devstack-tempest.

Change-Id: I45c582d9d9b34a1c5ab75455e42077902cbb850e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-19 19:26:41 -04:00
Zuul
3ad7f19e1a Merge "immutable user source: v3 test_roles" 2019-03-19 11:02:28 +00:00
Manik Bindlish
21491dff81 Checking config file actually exist or not in tempest run
This PS will check config file passed from command line is actually
existing or not in tempest run command. If file exists, only then it
will go for set config path otherwise will fail with value error.
Also adding and modifying unit test cases for this change.

Partially-Implements: blueprint tempest-cli-unit-test-coverage

Change-Id: I09d756be69cb3a9be8d0638c41d45a089d62b238
Closes-Bug: #1808473
2019-03-18 10:17:10 +00:00
Zuul
2fc8547672 Merge "Update v3 identity inherits tests to work w/ pre-prov" 2019-03-17 21:49:00 +00:00
Zuul
a63313ea0a Merge "Add profiler support into Tempest" 2019-03-17 21:46:15 +00:00
Zuul
7bb845524d Merge "Use credentials domain instead of creating new one" 2019-03-17 21:42:16 +00:00
Zuul
4cc8d770f3 Merge "allow create_server with vnic_type and port_profile from kwargs" 2019-03-16 06:30:03 +00:00
Zuul
a2a2b56894 Merge "Immutable user source: v3 test_inherits" 2019-03-16 06:28:41 +00:00
Zuul
baceb5ef9d Merge "Move tempest-tox-plugin-sanity-check to Bionic" 2019-03-16 05:27:36 +00:00
Zuul
67e0778618 Merge "Add autopep8 to tox.ini" 2019-03-16 02:12:07 +00:00
Matthew Treinish
c68546f06d Fix potential issue with adding a fixed ip
In test_add_remove_fixed_ip there is a potential issue where the user
running the test does not have the ability to create a server with a
fixed ip. As pointed out by zhufl (in review of change
I10a34fb12b595400fc15d935070f130c8e3d3963) This commit fixes the issue
so that we properly skip if tempest is not configured in a way where it
can create a server with the fixed ip.

Change-Id: Idcd66ac87cf156bc5c2b38178262c4686238bcd4
2019-03-15 22:47:09 +00:00
Trevor McCasland
bd89841dc6 Update v3 identity inherits tests to work w/ pre-prov
I don't see any limitations by using pre-provisioned credentials
for the tests:

* test_inherit_assign_list_check_revoke_roles_on_domains_group
* test_inherit_assign_check_revoke_roles_on_projects_group
* test_inherit_assign_list_check_revoke_roles_on_domains_user
* test_inherit_assign_list_check_revoke_roles_on_domains_group
* test_inherit_assign_check_revoke_roles_on_projects_user
* test_inherit_assign_list_revoke_user_roles_on_domain
* test_inherit_assign_list_revoke_user_roles_on_project_tree

By setting force_tenant_isolation=False these tests now be
can executed with backends that don't allow user creation
(immutable user source) like LDAP.

Partial-Bug: #1714277

Change-Id: I6b7bfbaef3355afede2adba56f342d5bfcbe3975
2019-03-15 16:51:46 +00:00
Zuul
2ebd32d533 Merge "Add py37 tox env" 2019-03-15 02:52:46 +00:00
Zuul
d69c11044f Merge "Remove LOG in misc.py" 2019-03-15 02:49:24 +00:00
Zuul
36ed3a8721 Merge "Set ENABLE_VOLUME_MULTIATTACH=true on tempest-slow subnode localrc" 2019-03-15 01:40:19 +00:00
ghanshyam
ac6224ee63 Use nova zuulv3 job for nova v2 API
Nova has migrated the legacy-tempest-dsvm-nova-v20-api
job to zuulv3 native - "nova-tempest-v2-api"

This commit use the new job in tempest gate.

Change-Id: I81a07d8fbb529b0ac55ce40c50a6e5348e1f43df
2019-03-15 00:13:47 +00:00
Trevor McCasland
c44eadc7b7 immutable user source: v3 test_roles
If the keystone user source is immutable, such as an LDAP
active directory implementation, tempest tests that try
to create or delete a user will fail. Instead of failing,
we would like them to skip. This change uses a testtools
decorator to avoid unnecessary modifications and allow those tests
to skip.

Change-Id: Iba39c971468759d9b7b3f0382dfcb881cbb1801d
2019-03-14 18:30:10 +00:00
Trevor McCasland
c3f07b441f Immutable user source: v3 test_inherits
If the keystone user source is immutable, such as an LDAP
active directory implementation, tempest tests that try
to create or delete a user will fail. Instead of failing,
we would like them to skip. This change uses a testtools
decorator to avoid unnecessary modifications and allow those tests
to skip.

Parital-Bug: #1777047

Change-Id: I1d8105c24eb9b20e563de962f9e4d5776937126a
2019-03-14 18:27:56 +00:00
Ghanshyam Mann
ea5efd5c35 Use credentials domain instead of creating new one
test_list_projects tests create a new domain and try to test the
list projects operation based on new domain-id. Keystone is
implementing the domain roles functionality for projects resource
- https://review.openstack.org/#/c/624218/

Which means listing the projects with authorized domain only.

This commit modify the tests to use the same domain as requester and
create project with that domain only not new one.

Also add the debug log.

Change-Id: I401815b4a0d3f7ad90801d5580897be870d33013
2019-03-13 16:42:39 +00:00
Matt Riedemann
3858ced89c Set ENABLE_VOLUME_MULTIATTACH=true on tempest-slow subnode localrc
Before change Icb971831c8d4fe5f940d9e7993d53f1c3765e30f in devstack
in Rocky, the ENABLE_VOLUME_MULTIATTACH variable is used to control
whether or not the UCA is enabled on the node and defaults to False.
The tempest-slow job is multi-node and runs on stable branches since
change Ie5492603a12ca4ae56baa744bf650ae4d8036256 and as a result
is configuring the UCA on the subnode but not the controller, so
nova-compute on each node is running with different versions of QEMU
which can cause live migration failures if trying to live migrate
from a newer version of QEMU to an older version.

This fixes the issue by configuring the subnode with the correct
localrc value for ENABLE_VOLUME_MULTIATTACH.

Change-Id: Idea94dde6973805995c1678fcfb6b0e93025492a
Closes-Bug: #1819910
2019-03-13 10:18:08 -04:00
Alfredo Moralejo
3e7752c93f Make type decorator compatible with unicode strings
When importing unicode_literals from __future__ in tempest plugins as in
watcher, type is set as unicode instead of string when running in
python2, so the type is not properly detected. This is making that only
3 tests are detected as smoke in watcher tests plugins with python2 (other
may be affected) instead of 52 which are discovered as smoke with python3.

This patch uses six to make this compatible with both string and unicode
in python2.

Change-Id: Ibba9d8217f543fae0c232757ddb18c4fdf957aff
Co-Authored-By: yatin <ykarel@redhat.com>
2019-03-13 11:28:41 +01:00
zhufl
19cb7836dc Remove LOG in misc.py
LOG is not used in misc.py, so this is to remove it.

Change-Id: I5c1e3b675d770bbeaeece676880c56d840646284
2019-03-13 01:00:05 +00:00
Noam Angel
6e30995bc0 allow create_server with vnic_type and port_profile from kwargs
the purpose of this change is to enable creating advance network
scenarios like checking connectivity from VM with port type "direct" to
VM with port type "normal".

with this change scenario planer can overwrite tempest.conf vnic_type
and port_profile paramters in scenario (ex. connectivty between VM
"direct" and VM "normal").

Change-Id: I5b9a4bd5350809d6b295dfede0c5059d01455404
2019-03-12 10:07:59 +00:00
Zuul
4d32506c71 Merge "Fix openstack-dev ML ref in test removal process." 2019-03-11 12:41:28 +00:00
Zuul
31db1f6f39 Merge "Update json module to jsonutils" 2019-03-09 07:59:44 +00:00
Zuul
6ab0a8f3cf Merge "Set concurrency default value" 2019-03-09 03:32:44 +00:00
Zuul
e7924e4c7c Merge "Remove admin test_l3_agent_scheduler API test module" 2019-03-08 21:18:45 +00:00
afazekas
40fcb9ba28 Add autopep8 to tox.ini
autopep8 is an automated code formatting tool for python,
it does not know everything, also not super fast,
but it is faster than I can manually reformat the code.

tools/format.sh will call the formatting,
the tox will check did you called it.

Also adding a tox -eautopep8 way to use it.

autopep8 formats the lines in one way,
where tempest used a another way it was changed.

Change-Id: I6d51b14a5a5b87761071d0927fca23ba1651aa41
2019-03-08 16:04:05 +01:00
Manik Bindlish
aa6f7df0be Add py37 tox env
With python3.7 jobs added to the Zuul jobs, it makes sense to add this to the tox config too.

Change-Id: I8217e0e311b62e21b3ef2f935b11a7e077ea1023
2019-03-08 06:49:05 +00:00
ghanshyam
a066fcdc26 Remove unused and duplicate nodeset defined in Tempest
Below nodesets defined in Tempest are removed now:

- openstack-bionic-node This is unused after I5a24c697103090f6712d6e9168abe6c86f7c380c
- openstack-opensuse150-node is duplicate of devstack-single-node-opensuse-150

Depends-On: https://review.openstack.org/#/c/641746/

Change-Id: I39c03bfa52191a0b1acf6a73fa31b3c071ee60c1
2019-03-07 23:11:52 +00:00
Zuul
c975f08e9b Merge "Make tempest-slow run on stable branch also" 2019-03-07 22:41:37 +00:00
ghanshyam
28edda63f2 Move tempest-tox-plugin-sanity-check to Bionic
This commit makes tempest-tox-plugin-sanity-check job
to run on Bionic. This job only run on master Tempest gate
so no need to worry about its xenial version.

Change-Id: I6d8c63a62416b35e9d203cbeabc9868aa6a95f44
2019-03-07 17:46:11 +00:00
ghanshyam
59a93d1bba Fix openstack-dev ML ref in test removal process.
Change-Id: I281ab52bc714e6b6dc1529f13b700d23caaf6f41
2019-03-07 17:25:29 +00:00
Slawek Kaplonski
edcc172db3 Remove admin test_l3_agent_scheduler API test module
Tests from this module are duplicated by same tests in
neutron-tempest-plugin repo.
Tests are in [1] module in this repo.

Both removed tests got 0% failure rate according to status.openstack.org
page.

It was discussed with QA PTL and he confirmed that those tests can
be removed from tempest. See [2] for details. Also ML thread about
this test removal notification[3].

[1] http://git.openstack.org/cgit/openstack/neutron-tempest-plugin/tree/neutron_tempest_plugin/api/admin/test_l3_agent_scheduler.py
[2] http://eavesdrop.openstack.org/irclogs/%23openstack-qa/%23openstack-qa.2019-03-01.log.html#t2019-03-01T16:18:32
[3] http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003574.html

Change-Id: I28f3bab54c25463d584db5398920d467a04bccf0
2019-03-07 05:01:46 +00:00
zhulingjie
92b87a5a43 Update json module to jsonutils
oslo project provide jsonutils, and we use it in many place[1],
this PS to update the remained json moudule to oslo jsonutils for
consistency.

[1]: 9594233ffd/tempest/lib/services/volume/v1/quotas_client.py (L15)

Change-Id: Ib8d9f49a1fdfa0f5e0cfb05a193dffb83e4cfe69
2019-03-06 22:54:51 +08:00