13730 Commits

Author SHA1 Message Date
Zuul
cd147631f8 Merge "Add system scope for admin auth" 2021-01-21 05:18:24 +00:00
Zuul
3e05a15d9c Merge "Fix memory explosion in multi-store image tests" 2021-01-18 22:19:21 +00:00
Dan Smith
8dfefcebee Fix memory explosion in multi-store image tests
For some reason, the MultiStoresImportImages test was causing the
test runner to balloon to ~1.5G, which generates spurious OOMs in
the gate, resulting in worker death and failure.

This test was generating 10M of data with data_utils.random_bytes(),
instead of the default of 1K, for no apparent reason. We are still
not sure why, but this results in the memory ballooning, potentially
because of BytesIO, or request.put() mishandling.

Regardless, this is unnecessary, and causing failures in the gate,
so this patch switches it back to the default, which works fine.

Change-Id: I9f1ea0114531a735bd38ad54da7ce15fb2bf7f7c
2021-01-14 12:15:45 -08:00
Hironori Shiina
a811f44b55 Delete wrong argument from creating HTTP connection
HTTPConnection() doesn't take the argument 'context' while
HTTPSConnection() accepts it at creating a connection in an object
client. HTTP connection doesn't require an SSL context.

Change-Id: I51ffc8cd04fe90493e23b0f0ca9b0420c5a24cd5
2021-01-13 13:45:43 -05:00
Zuul
d8904d0aee Merge "Pass custom args to create_port through create_server" 2021-01-13 02:59:42 +00:00
Zuul
1a05b1c12e Merge "Use proper kwargs in rebuild_server" 2021-01-13 02:55:57 +00:00
Zuul
7965029571 Merge "Use CONF.identity.disable_ssl_certificate_validation in object_client" 2021-01-12 18:39:34 +00:00
zhufl
8464cefbf1 Use CONF.identity.disable_ssl_certificate_validation in object_client
create_object_continue interface in object_client doesn't use
CONF.identity.disable_ssl_certificate_validation, so even if we set
disable_ssl_certificate_validation=true in tempest.conf, sometimes
we will still get "ssl.SSLCertVerificationError:
[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed:
unable to get local issuer certificate (_ssl.c:1108)"

So create_object_continue should judge whether to check ssl
certification according to
CONF.identity.disable_ssl_certificate_validation.

Change-Id: I38f4416641e396caf88d16e3b418f0fc7577179d
Closes-Bug: #1907554
2021-01-12 01:20:58 +00:00
Colleen Murphy
cd0bbbdad3 Add system scope for admin auth
Keystone is moving away from using either project-scope or domain-scope
for the main cloud administrator user, and instead moving toward the
admin user having a role assignment on the "system" scope[1]. This will
mean that no particular project or domain is special, and instead the
cloud administrator scopes to the system in order to make
deployment-wide changes. Keystone has now migrated all of its policies
to understand system scope[2], and if a deployment sets
[oslo_policy]/enforce_scope=true in keystone.conf and uses the new
policies, an admin user scoped to the admin project will not be able to
create dynamic credentials for tempest.

This patch adds a new parameter ``[auth]/admin_system`` to indicate that
neither the ``admin_project`` or ``admin_domain`` parameters apply to
the admin user and that the user should instead authenticate with the
system scope. This also adds ``admin_user_domain_name`` so that the
admin user can be found in its domain (namespace) without setting
``domain_name``, and for completeness also adds
``admin_project_domain_name`` so that ``domain_name`` could be omitted
even if using project scope.

[1] http://specs.openstack.org/openstack/keystone-specs/specs/keystone/queens/system-scope.html
[2] https://bugs.launchpad.net/keystone/+bugs?field.status%3Alist=FIXRELEASED&field.tag=system-scope

Depends-on: https://review.opendev.org/739262

Change-Id: I840b273c37ca7cc4592c43813abfb424337e2836
2021-01-11 19:11:45 +00:00
Martin Kopec
9c87441724 Pass custom args to create_port through create_server
Allow consumers of create_server to pass custom arguments to
create_port method which is called from create_server one.

Fix namestart var usage in create_port - as the name of the var
suggests, it should be used to generate a name from. Therefore
the patch also adds rand_name call which we accidentaly removed
recently.

Implements: blueprint tempest-scenario-manager-stable
Change-Id: I724e0f37d4381a493217a077492046f7a4b0a2a2
2020-12-28 16:37:53 +00:00
Zuul
fec2c93cdc Merge "Remove stable/stein testing jobs" 2020-12-25 20:43:07 +00:00
Zuul
009827766b Merge "Add release notes page for version 26.0.0" 2020-12-22 15:44:20 +00:00
Ghanshyam Mann
f8625f0de5 Remove stable/stein testing jobs
stable/stein is not suported in Tempest now, so
let's remove their jobs from master gate.

Also, update doc to reflect it.

Depends-On: https://review.opendev.org/c/openstack/stackviz/+/768212

Change-Id: I0cbc2883e1cfdb3b1d6b10a7ecea83a4bae32afb
2020-12-22 14:46:23 +00:00
Zuul
38b167537a Merge "scenario: Use wait_for_volume_attachment_remove_from_server in nova_volume_detach" 2020-12-22 00:34:50 +00:00
Zuul
172d71e51e Merge "Also calculate external subnets when check cidr whether in use" 2020-12-21 22:55:44 +00:00
Lee Yarwood
5423c53095 scenario: Use wait_for_volume_attachment_remove_from_server in nova_volume_detach
Detaching a volume from an instance in Nova is an asynchronous
operation. While the request can be accepted the underlying act of
detaching the device from the instance, disconnecting the volume from
the host, updating cinder and deleting records in Nova can take some
considerable time.

As such when detaching a volume callers should continue to poll the
os-volume_attachments Nova API to determine when the underlying volume
attachment, also known as a Block Device Mapping or BDM, is removed.

Bug #1908399 outlines an issue where the scenario helper method
nova_volume_detach was being called multiple times during tests and
cleanup while only waiting for the volume status to change to available.
This allowed for a race to occur where additional requests could be made
to detach the volume while the volume attachment still remained in Nova
resulting in a 400 error being returned by n-api.

This change addresses this by switching between the volume resource
status and the volume attachment removal waiters.

Closes-Bug: #1908399
Change-Id: Ib6ae2c30be65eb444976b0330fd23d9457146284
2020-12-21 16:05:35 +00:00
Ghanshyam Mann
77f2291c81 Add release notes page for version 26.0.0
Change-Id: I0973b24dd006b8a96ddd2c11302e9b79ca7c4876
2020-12-18 19:06:25 -06:00
Zuul
7d775d6d1c Merge "Revert "Use victoria stable constraint in tox to release 26.0.0"" 2020-12-18 21:29:03 +00:00
Martin Kopec
be8ba2c27a Use proper kwargs in rebuild_server
Use proper kwargs arg instead of the named arg in rebuild_server.
The method is not used anywhere with the rebuild_kwargs set so this
change should affect anybody.

Implements: blueprint tempest-scenario-manager-stable
Change-Id: Id445d3f1daee4dec1f771580667a35baffa18e62
2020-12-18 11:21:55 +00:00
Zuul
0e0264636f Merge "Remove slow tag from test_minbw test" 2020-12-16 16:38:50 +00:00
Ghanshyam
cb4aff1a2b Revert "Use victoria stable constraint in tox to release 26.0.0"
This reverts commit f9d31f2c46204abbbef53d3c0ae0f80125878fc9.

Reason for revert: Tempest 26.0.0 is released so we need to switch to master constraints now.

Change-Id: I78780ef88c5f8394ec11b144f148f30b060ed657
2020-12-16 16:10:15 +00:00
Ghanshyam Mann
f9d31f2c46 Use victoria stable constraint in tox to release 26.0.0
We are going to release Tempest new tag 26.0.0 to declare
the end of support for stable/stein. So that new tag use
stable/victoria constraint in the tox env as victoria constraints
for sure will work with tag. It did not use wallaby constraints
as wallaby dev cycle is in progress and so does their constraints.

Further information:
 https://docs.openstack.org/tempest/latest/requirement_upper_constraint_for_tempest.html

Change-Id: I31433c15984e38e5651b2f3d10c8769f59e30cc1
2020-12-15 10:36:14 -06:00
Ghanshyam Mann
2c3da54a82 Add releasenote to tag the end of support for Stein
This relesenote also mark end of support for Stein release
in Tempest as it is in EM state[1].

[1] https://releases.openstack.org/

Change-Id: If51b24b630e440abc13f68d68f32af13351f535f
2020-12-14 23:57:51 +00:00
yangjianfeng
4ad346e649 Also calculate external subnets when check cidr whether in use
The external network be shared by all tenant. When it associated
to a tenant router the cidr of it's subnets cannot overlap with
tenant subnets', otherwise it will lead to bug #1903433. The related
fix patch: https://review.opendev.org/761829

So, in tempest, the external subnets need was considered when check
cidr whether in use.

Related-Bug: #1903433
Change-Id: Ief84251adb0368533570d9e9f6630de92e27c5c3
2020-12-14 00:45:29 +00:00
Zuul
5364a9a789 Merge "Stabilize _create_loginable_secgroup_rule" 2020-12-09 18:44:19 +00:00
Zuul
dd84940a81 Merge "Remove unused LOG var in test_stamp_pattern.py" 2020-12-09 12:18:41 +00:00
Zuul
60258abc19 Merge "Need to add kwargs for the api" 2020-12-09 01:15:11 +00:00
Zuul
d76d371e1d Merge "compute: Skip AttachVolumeShelveTestJSON when cross_az_attach unavailable" 2020-12-08 16:59:33 +00:00
Martin Kopec
b0b480c386 Remove unused LOG var in test_stamp_pattern.py
A global var LOG is set in the tempest/scenario/test_stamp_pattern.py
however it's not used. The patch removes that together with logging
import.

Change-Id: I01e634f7595247cddbf8e391281bfe7e045abeaa
2020-12-08 14:24:06 +00:00
Zuul
97cd23b1b1 Merge "New minimum guaranteed bandwidth tests" 2020-12-08 14:20:22 +00:00
Zuul
6386312186 Merge "Remove race due to 1907084" 2020-12-08 14:20:04 +00:00
Zuul
8be61fe745 Merge "Fix indentation for the example code in documentation." 2020-12-08 09:38:06 +00:00
Zuul
07a3cfdb66 Merge "Allow kwargs in get_timestamp" 2020-12-08 03:29:15 +00:00
Zuul
2262cced38 Merge "Fix TypeError when there exists image with size None" 2020-12-07 22:25:00 +00:00
elajkat
23b57fdded Remove slow tag from test_minbw test
test_qos_min_bw_allocation_basic usually execute in less than 60 secs,
so let's remove slow tag from it.
This patch removes the following config options from tempest-slow job:
* bridge_mappings and resource_provider_bandwidths from
neutron_core_plugin_conf
* qos_placement_physnet from network-feature-enabled in tempest.conf

Change-Id: I03c97edb9d7a177f5face046d1c9f60e4f1eeefa
2020-12-07 20:03:17 +00:00
Zuul
3ca2dcf4c5 Merge "Added apis to scenario manager" 2020-12-07 18:07:34 +00:00
Balazs Gibizer
2e515fe596 Remove race due to 1907084
The test_attach_scsi_disk_with_config_drive test cases is racy at volume
detach. Nova first detach the volume in cinder then later deletes the
BlockDeviceMapping from the nova DB. Test waits for the volume to become
available and then checks the list of volume attachments in the nova API
then it can see that the attachment is still there.

Closes-Bug: #1907084
Change-Id: I814ae3215f39d1e8407c4ca1c7117a314941c80b
2020-12-07 16:41:16 +01:00
Zuul
7b9db954bb Merge "Allow additional port_vnic_type" 2020-12-07 15:07:13 +00:00
elajkat
064a340dcc New minimum guaranteed bandwidth tests
New tests for MinBwAllocationPlacementTest: server resize and migration.

Blueprint: support-move-ops-with-qos-ports-ussuri
Change-Id: I8c573c4a11a76932057d8415d76114a03269b9f3
2020-12-07 14:57:28 +00:00
Roman Dobosz
edda62ab35 Fix indentation for the example code in documentation.
Change-Id: I454c22aaf1ffa56c37c0105ab76aa70d28983f43
2020-12-07 10:18:42 +01:00
Soniya Vyas
a078ddd7c3 Need to add kwargs for the api
Added kwargs parameter for create_security_group() api

Implements: blueprint tempest-scenario-manager-stable
Signed-off by: Soniya Vyas<svyas@redhat.com>
Change-Id: Ia01153c84ccb6a085231753aba7caaa22a8f2535
2020-12-04 18:43:53 +05:30
Zuul
44869eddc0 Merge "Allow kwargs in create_volume_from_image" 2020-12-04 11:11:10 +00:00
Zuul
400459c7d7 Merge "Allow kwargs in create_server_snapshot" 2020-12-04 10:29:35 +00:00
Zuul
32e71b0620 Merge "Add tag in compute interfaces schema for microversion 2.70" 2020-12-04 07:19:23 +00:00
Zuul
c340dbffe3 Merge "Need to have stable implementation of apis" 2020-12-03 20:44:47 +00:00
Zuul
44ad4ac04d Merge "Allow kwargs in image_create" 2020-12-03 20:40:40 +00:00
Lukas Piwowarski
9ad9ca2771 Allow kwargs in create_server_snapshot
As a part of the scenario/manager.py stabilization tracked by
the below BP the patch adds kwargs argument for create_server_snapshot
method so that the consumers are able to pass additional
parameters if needed.

Implements: blueprint tempest-scenario-manager-stable

Change-Id: I0ae3f86c546be6b3f5b1d427568cfdf2d26e37e0
2020-12-03 15:34:52 +00:00
Lukas Piwowarski
2c230eb21a Allow kwargs in get_timestamp
As a part of the scenario/manager.py stabilization tracked by
the below BP the patch adds kwargs argument to support
username parameter of get_remote_client() method.

Change-Id: I8e0da8b19b2b0b147b36c392fa4e161115325cd7
Implements: blueprint tempest-scenario-manager-stable
2020-12-03 15:27:12 +00:00
Tom Stappaerts
27fd5cb386 Allow additional port_vnic_type
Also allow port_vnic_type direct-physical, baremetal and
virtio-forwarder.
Closes-Bug: #1905714

Change-Id: I31b18d1d815cafc8a327f611591fba84c6b5aeaf
2020-12-03 16:07:17 +01:00
Zuul
cd0d7a23e0 Merge "Change help string to use openstack instead of neutron" 2020-12-03 01:26:41 +00:00