12911 Commits

Author SHA1 Message Date
Zuul
3c5b61396d Merge "Run integration jobs for requirements.txt changes" 2019-04-09 05:53:41 +00:00
Zuul
e1bc201c57 Merge "Improve router deletion logging in tempest cleanup" 2019-04-08 22:05:42 +00:00
Zuul
13bbcdd6bf Merge "Improve logging in tempest cleanup" 2019-04-07 02:52:37 +00:00
ghanshyam
77a1933bd3 Run integration jobs for requirements.txt changes
currently we do not run the gate jobs if any change is for
test|requirements.txt only which can break the things.
Example- https://review.openstack.org/#/c/649804/

Because Tempest does not have functional testing which might
be enough for teting the requirement change, we start running
the all gate jobs for such change.

Change-Id: I54384f5c664673ef32937cd1d7c4a46c10c18f9b
2019-04-06 17:55:21 +00:00
Tony Breeds
a7f16b291d Uncap jsonschema
We have jsonschema capped at a fairly old version. Other than some
specific releases, it looks like keeping it below 3.0 was added in
I943fd68b9fab3bce1764305a5058df5339470757 without really any explanation
why.

In order to update to a 3.x release we need to:
1. Remove the cap from global-requirements.txt (see Depends-On), leaving
   upper-constraints.txt at a 2.x release
2. Remove the cap from all consumers (this change)
3. Release a new version of consumers that are published to pypi
4. Update upper-constraints.txt with those new releases
5. Update jsonschema in upper-constraints.txt to a 3.X release
   (See: https://review.openstack.org/649789)
6. Test consumers with the change from 5.
7. [Optional] fix issues in consumers that arise from 6.
8. Merge the change from 5.

Change-Id: I95b5520ca0e8da7b2a7663a272bc740b8c809592
Co-Authored-by: Sean McGinnis <sean.mcginnis@gmail.com>
Depends-On: https://review.openstack.org/649669
2019-04-04 14:01:16 +11:00
Matt Riedemann
1bbfa121b3 Fix test_volume_swap_with_multiattach
Nova change https://review.openstack.org/572790/ is fixing
a bug such that the compute API would allow people to
swap from a multiattach volume with multiple read/write
attachments, which could lead to data loss if the
secondary attachment is writing to the source volume while
it's being copied to the target volume.

As a result, test_volume_swap_with_multiattach needs to be
changed such that the volume we're swapping from has only
read-only attachments.

Change-Id: Ida387c600016b451e01118bc2c76662b46670288
Related-Bug: #1775418
2019-04-03 08:17:04 +00:00
Martin Kopec
598b1ae854 Improve router deletion logging in tempest cleanup
Improve logging in tempest cleanup when a router and
its interfaces are being deleted. The review adds a
try except block for every attempt to remove a port.
By that addition any port error will not be hidden
behind the router error the port is attached to.
It will provide more precise error logging.

Change-Id: I475deec7b29600627f68ff07c5546e55cdab100f
2019-04-02 12:51:44 +00:00
Zuul
3639f91c36 Merge "Add missing validation for the compute/positive" 2019-04-02 09:55:36 +00:00
Zuul
b3a16b5d4f Merge "Init placement client in tempest Manager object" 2019-04-02 01:32:31 +00:00
Zuul
a415f6b1cc Merge "Add Tempest gate job for stable/stein" 2019-04-02 00:30:25 +00:00
Zuul
49e9de05ec Merge "Mention autopep8 in Hacking.rst" 2019-04-01 14:50:50 +00:00
Martin Kopec
fd01fe9445 Improve logging in tempest cleanup
Add id or name of the resource which failed to delete
to the logging.

Change-Id: I04b04406e3917a63332199adf5c15b8e4ed6ca5a
2019-04-01 14:31:43 +00:00
Archit Modi
a8cb701cc0 Init placement client in tempest Manager object
Placement client is not yet added/initialized in
the tempest/clients.py Manager object.

Change-Id: I19224b178e2860ee29c56546340cee36cd71b0e8
2019-04-01 09:35:42 -04:00
Attila Fazekas
c07edb5f80 Mention autopep8 in Hacking.rst
The scripts in the tools now is able to distinguish,
the autopep8 error codes better.

Change-Id: I9ea19009118ed418e3666fad45d2e0eb676204c8
2019-03-29 20:50:23 +00:00
Zuul
db2fbc9268 Merge "Remove sys unused" 2019-03-28 13:07:18 +00:00
Zuul
89733c6ac3 Merge "Remove the Ocata stable branch jobs from master gate" 2019-03-27 20:09:06 +00:00
Zuul
35ed1a80bc Merge "Use base.delete_server in test_servers.py" 2019-03-27 09:13:47 +00:00
Zuul
cf75dba44e Merge "Add release notes page for version 20.0.0" 2019-03-27 07:44:56 +00:00
Zuul
1a2f37013a Merge "Use nova zuulv3 job for nova v2 API" 2019-03-26 22:38:51 +00:00
ghanshyam
5b98592b9a Add Tempest gate job for stable/stein
Now we have stable/stein branch ready for devstack
and so does for all service projects.

This commit adds the Tempest testing for stable/stein
by adding new jobs running on stable/stein version of
openstack.
Depends-On: https://review.openstack.org/#/c/647867/

Change-Id: Ia22988821b5c786a0b25a980cb4ca329dac54bac
2019-03-26 19:58:50 +00:00
Zuul
25f5d28f3c Merge "Fix potential issue with adding a fixed ip" 2019-03-26 15:12:13 +00:00
Zuul
84062c9b89 Merge "Replace openstack.org git:// URLs with https://" 2019-03-26 09:06:02 +00:00
ghanshyam
1546211874 Add release notes page for version 20.0.0
Tempest 20.0.0 has been released [1].
This commit adds a new page for 20.0.0 release notes.

[1] https://review.openstack.org/#/c/645867/

Change-Id: Ic946b84e0003cc4cca85c1922816b8a0a3b8a3bf
2019-03-25 23:37:44 +00:00
afazekas
5d06623dae Add missing validation for the compute/positive
Similarly to the interfaces, the volume detach can
fail if the vm is not ready for processing the acpi
signals. The ssh daemon allow to login around the same
time so it will helps to avoid detach failures.

Change-Id: Ic43ae3b76467a5cbeb6c2fe128435d64ab7743b5
2019-03-25 18:35:36 +01:00
Ian Wienand
ff3851b593 Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: Iff8f93426925a3480cedfb899216e443b12cd826
2019-03-24 20:36:15 +00:00
ghanshyam
787e694269 Remove the Ocata stable branch jobs from master gate
Tempest 20.0.0 is released now, which marks the end of support
for Ocata release - https://review.openstack.org/#/c/645867/

We do not need to run the Ocata stable job om master gate now.
Depends-On: https://review.openstack.org/#/c/645867

Change-Id: I883f3c98201631acdadeaab6678a796a85662e44
2019-03-22 21:12:51 +00:00
ghanshyam
a955095f83 Add releasenote to tag the Tempest for Stein release
This commit adds the releasenote to tag Tempest for Stein
and needed for version 20.0.0 to release.

This relesenote also mark end of support for Ocata release as
ocata is in EM state.

Once we release the Tempest 20.0.0, we will remove the ocata job
from master gate.

Change-Id: I93bf37e31497881536b85783dc3cff70a56b04cb
20.0.0
2019-03-22 05:02:49 +00:00
Zuul
a511109572 Merge "Checking config file actually exist or not in tempest run" 2019-03-21 21:38:08 +00:00
Zuul
e83940d21a Merge "Remove unused and duplicate nodeset defined in Tempest" 2019-03-21 04:41:16 +00:00
Paul Belanger
4c7b79ac3f Default gabbi_tempest_path to empty string
Seems this variable is setup from gabbi-tempest, but other jobs also use
devstack-tempest.

Change-Id: I45c582d9d9b34a1c5ab75455e42077902cbb850e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-19 19:26:41 -04:00
Zuul
3ad7f19e1a Merge "immutable user source: v3 test_roles" 2019-03-19 11:02:28 +00:00
Manik Bindlish
21491dff81 Checking config file actually exist or not in tempest run
This PS will check config file passed from command line is actually
existing or not in tempest run command. If file exists, only then it
will go for set config path otherwise will fail with value error.
Also adding and modifying unit test cases for this change.

Partially-Implements: blueprint tempest-cli-unit-test-coverage

Change-Id: I09d756be69cb3a9be8d0638c41d45a089d62b238
Closes-Bug: #1808473
2019-03-18 10:17:10 +00:00
Zuul
2fc8547672 Merge "Update v3 identity inherits tests to work w/ pre-prov" 2019-03-17 21:49:00 +00:00
Zuul
a63313ea0a Merge "Add profiler support into Tempest" 2019-03-17 21:46:15 +00:00
Zuul
7bb845524d Merge "Use credentials domain instead of creating new one" 2019-03-17 21:42:16 +00:00
Zuul
4cc8d770f3 Merge "allow create_server with vnic_type and port_profile from kwargs" 2019-03-16 06:30:03 +00:00
Zuul
a2a2b56894 Merge "Immutable user source: v3 test_inherits" 2019-03-16 06:28:41 +00:00
Zuul
baceb5ef9d Merge "Move tempest-tox-plugin-sanity-check to Bionic" 2019-03-16 05:27:36 +00:00
Zuul
67e0778618 Merge "Add autopep8 to tox.ini" 2019-03-16 02:12:07 +00:00
Matthew Treinish
c68546f06d Fix potential issue with adding a fixed ip
In test_add_remove_fixed_ip there is a potential issue where the user
running the test does not have the ability to create a server with a
fixed ip. As pointed out by zhufl (in review of change
I10a34fb12b595400fc15d935070f130c8e3d3963) This commit fixes the issue
so that we properly skip if tempest is not configured in a way where it
can create a server with the fixed ip.

Change-Id: Idcd66ac87cf156bc5c2b38178262c4686238bcd4
2019-03-15 22:47:09 +00:00
Trevor McCasland
bd89841dc6 Update v3 identity inherits tests to work w/ pre-prov
I don't see any limitations by using pre-provisioned credentials
for the tests:

* test_inherit_assign_list_check_revoke_roles_on_domains_group
* test_inherit_assign_check_revoke_roles_on_projects_group
* test_inherit_assign_list_check_revoke_roles_on_domains_user
* test_inherit_assign_list_check_revoke_roles_on_domains_group
* test_inherit_assign_check_revoke_roles_on_projects_user
* test_inherit_assign_list_revoke_user_roles_on_domain
* test_inherit_assign_list_revoke_user_roles_on_project_tree

By setting force_tenant_isolation=False these tests now be
can executed with backends that don't allow user creation
(immutable user source) like LDAP.

Partial-Bug: #1714277

Change-Id: I6b7bfbaef3355afede2adba56f342d5bfcbe3975
2019-03-15 16:51:46 +00:00
Zuul
2ebd32d533 Merge "Add py37 tox env" 2019-03-15 02:52:46 +00:00
Zuul
d69c11044f Merge "Remove LOG in misc.py" 2019-03-15 02:49:24 +00:00
Zuul
36ed3a8721 Merge "Set ENABLE_VOLUME_MULTIATTACH=true on tempest-slow subnode localrc" 2019-03-15 01:40:19 +00:00
ghanshyam
ac6224ee63 Use nova zuulv3 job for nova v2 API
Nova has migrated the legacy-tempest-dsvm-nova-v20-api
job to zuulv3 native - "nova-tempest-v2-api"

This commit use the new job in tempest gate.

Change-Id: I81a07d8fbb529b0ac55ce40c50a6e5348e1f43df
2019-03-15 00:13:47 +00:00
Trevor McCasland
c44eadc7b7 immutable user source: v3 test_roles
If the keystone user source is immutable, such as an LDAP
active directory implementation, tempest tests that try
to create or delete a user will fail. Instead of failing,
we would like them to skip. This change uses a testtools
decorator to avoid unnecessary modifications and allow those tests
to skip.

Change-Id: Iba39c971468759d9b7b3f0382dfcb881cbb1801d
2019-03-14 18:30:10 +00:00
Trevor McCasland
c3f07b441f Immutable user source: v3 test_inherits
If the keystone user source is immutable, such as an LDAP
active directory implementation, tempest tests that try
to create or delete a user will fail. Instead of failing,
we would like them to skip. This change uses a testtools
decorator to avoid unnecessary modifications and allow those tests
to skip.

Parital-Bug: #1777047

Change-Id: I1d8105c24eb9b20e563de962f9e4d5776937126a
2019-03-14 18:27:56 +00:00
Ghanshyam Mann
ea5efd5c35 Use credentials domain instead of creating new one
test_list_projects tests create a new domain and try to test the
list projects operation based on new domain-id. Keystone is
implementing the domain roles functionality for projects resource
- https://review.openstack.org/#/c/624218/

Which means listing the projects with authorized domain only.

This commit modify the tests to use the same domain as requester and
create project with that domain only not new one.

Also add the debug log.

Change-Id: I401815b4a0d3f7ad90801d5580897be870d33013
2019-03-13 16:42:39 +00:00
Matt Riedemann
3858ced89c Set ENABLE_VOLUME_MULTIATTACH=true on tempest-slow subnode localrc
Before change Icb971831c8d4fe5f940d9e7993d53f1c3765e30f in devstack
in Rocky, the ENABLE_VOLUME_MULTIATTACH variable is used to control
whether or not the UCA is enabled on the node and defaults to False.
The tempest-slow job is multi-node and runs on stable branches since
change Ie5492603a12ca4ae56baa744bf650ae4d8036256 and as a result
is configuring the UCA on the subnode but not the controller, so
nova-compute on each node is running with different versions of QEMU
which can cause live migration failures if trying to live migrate
from a newer version of QEMU to an older version.

This fixes the issue by configuring the subnode with the correct
localrc value for ENABLE_VOLUME_MULTIATTACH.

Change-Id: Idea94dde6973805995c1678fcfb6b0e93025492a
Closes-Bug: #1819910
2019-03-13 10:18:08 -04:00
Alfredo Moralejo
3e7752c93f Make type decorator compatible with unicode strings
When importing unicode_literals from __future__ in tempest plugins as in
watcher, type is set as unicode instead of string when running in
python2, so the type is not properly detected. This is making that only
3 tests are detected as smoke in watcher tests plugins with python2 (other
may be affected) instead of 52 which are discovered as smoke with python3.

This patch uses six to make this compatible with both string and unicode
in python2.

Change-Id: Ibba9d8217f543fae0c232757ddb18c4fdf957aff
Co-Authored-By: yatin <ykarel@redhat.com>
2019-03-13 11:28:41 +01:00