Tempest support from stable/yoga to stable/2023.1 and
till python 3.11 but it seems like doc is not updated
for the same.
Change-Id: I7bb5c7b0a39bb833219ed7b0947b88980b4e9f79
We have a bug in dynamic creds creation where project creds
with different roles are created under a new projects. Creds
of different role of projects must be created within the same
project.
Fixing the creation of 'project_admin', 'project_member',
'project_reader', 'primary' creds in same projects. All the alt
creds will be created under same projects. but main and alt creds
will use different project, for example, 'project_alt_member'
and 'project_member' creds will be created in different project.
'admin' creds will continue be in new project as many test
use it as legacy admin.
Closes-Bug: #1964509
Change-Id: I9af005e2900195c42ecbbf7434facae2d3952f30
Tempest provides a LockFixture to avoid two potentially interfering
tests to run in parallel. However, this solution does not scale when
we want to separate a set of tests from many other test cases. For
example, host aggregate and availability zone testing needs compute
hosts without any nova servers to be able to test moving computes
between aggregates but a lot of other tests are creating nova
servers. To fully separate these aggregate tests from the rest of
the tempest test cases, this patch proposes a @serial class decorator
to mark a test class to be run totally independently of any other test
classes.
Under the hood, the @serial decorator is implemented with a tempest-wide
interprocess read-write lock. The serial test classes always take the
write lock, while the non-serial classes take the read lock. The lock
allows in many readers OR a single writer. So the serial tests are run
independently from the rest.
To minimize the time a serial test blocks other tempest tests run in
parallel, this patch also introduced a serial_tests test directory to
store the serial tests. The current test ordering in a fresh env
uses alphabetical order so the serial tests will run at the end of
the execution not randomly in the middle. The gate uses fresh VMs
for every run so we can rely on this optimization there. In local
envs where tests are re-run, the subsequent runs will be ordered at
runtime by stestr. Therfore, a longer runtime might be observed due to
locking, but the correctness of the test execution is still kept.
Related-Bug: #821732
Change-Id: I0181517edab75f586464a38c4811417f888783b1
This commit fixes the python version which is supported officially. We
dropped Python 3.6 in the past commit[1] already and Python 2.7 is not
no longer supported. So we should be able to drop and replace the tox
job in the document.
[1] Ie844887a798a006794729e733748ceaa5e06d2db
Change-Id: If2998dd984aeb7d93bd49659d08a7212e16069c0
With latest Tempest 32.0.0, Tempest master started supporting
Zed and vistoria is not supported as that is in EM state.
Change-Id: I70303bcc8322da1ed9dfcfc1ea0865a70d287237
The 'all-plugin' tox environment was deprecated by this patch [1].
Instead of the 'all-plugin' it is recommended to use the 'all' tox
environment.
This patch removes any reference to 'all-plugin' tox environment and
updates the documentation so that the installation steps work with
the 'all' tox venv.
[1] https://review.opendev.org/c/openstack/tempest/+/543974
Related-Bug: 1862240
Change-Id: I0a86d9cf33bff6576a6337967d6b663ab7d9f4a6
Our documentation showed that Victoria, Ussuri and Train are the
supported releases by tempest's master, which wasn't the case.
It also showed that tempest is compatible with python 3.6, 3.7
and 3.8. We dropped py 3.6 and 3.7 support by [1].
[1] https://review.opendev.org/c/openstack/tempest/+/843182
Closes-Bug: #1976282
Change-Id: I0ccfa824f08cbdf58f26a142dac3a0881605ef08
For Compute microversion 2.50:
1. fixed_ips, floating_ips, security_group_rules and security_groups
are removed from:
* GET /os-quota-class-sets/{id}
* PUT /os-quota-class-sets/{id}
2. server_groups and server_group_members are added to:
* GET /os-quota-class-sets/{id}
* PUT /os-quota-class-sets/{id}
For Compute microversion 2.57:
1. injected_file_content_bytes, injected_file_path_bytes, injected_files
are removed from:
* GET /os-quota-class-sets/{id}
* PUT /os-quota-class-sets/{id}
Partially Implements: blueprint fix-microversion-gap
Co-authored-by: Ghanshyam Mann <gmann@ghanshyammann.com>
Change-Id: I2a9dcb20251d9682fbcafd706ac60325a60e35ef
For Compute microversion 2.64:
1. change policies to policy in:
* GET /os-server-groups
* POST /os-server-groups
* GET /os-server-groups/{server_group_id}
2. add rules in:
* GET /os-server-groups
* POST /os-server-groups
* GET /os-server-groups/{server_group_id}
3. remove metadata from:
* GET /os-server-groups
* POST /os-server-groups
* GET /os-server-groups/{server_group_id}
The testcases of create_server_group should also be modified.
Co-authored-by: Ghanshyam Mann <gmann@ghanshyammann.com>
Change-Id: I8fc37415c968eb64380b8bd66b713aa6b733578f
1. For microversion 2.33
hypervisor_links is added to the response body for the following APIs:
- GET /os-hypervisors
- GET /os-hypervisors/detail
2. For microversion 2.53
servers is added to the response body for the following APIs:
- GET /os-hypervisor
- GET /os-hypervisors
- GET /os-hypervisors/detail
This is to fix the hypervisor schema for microversion 2.33 and 2.53.
Partially Implements: blueprint fix-microversion-gap
Co-authored-by: Ghanshyam Mann <gmann@ghanshyammann.com>
Change-Id: Ifeb26a50b604d257e9ab00cceed7cd2f34621419
The commit replaces DefCore committee (a former name) by
Interop Working Group (the current name) and updates a few
more old interop references.
Change-Id: I8bd05246e42c0e98a9825a4621ac9c3ed714d1dc
In python 3, all strings are considered as unicode string.
This patch drops the explicit unicode literal (u'...')
or (u"..") appearances from the unicode strings.
Change-Id: I64af1c7c7415cd4ab99b6a913fb84fecbc0a3bf1
This adds delete_on_termination field for the compute API response schema
for the 2.79 microversion in the following APIs:
- GET /servers/{server_id}/os-volume_attachments (list)
- GET /servers/{server_id}/os-volume_attachments/{volume_id} (show)
- POST /servers/{server_id}/os-volume_attachments (attach)
Change-Id: I7a9b22477b800c6d60acb67c27aff5dcb61d7875
As Tempest support the keystone's scope and new default roles
like reader, this commit document that how those can be
requested and used in Tempest or its plugins tests.
Change-Id: Iebacbeda231f82d6d16dbdcde635f19ae862181f
Now a days, Tempest does not have much active core reviewers due
to that merging the incoming code change is taking too much time.
As you can see we have lot of backlogs in open review ~400
If situation improve in future and we have more Core review
then we can change the policy back to two +2 requirement.
Discussion in QA office hour:
- http://eavesdrop.openstack.org/meetings/qa/2021/qa.2021-01-26-14.00.log.html#l-147
Change-Id: Ic005de3e56cb4fde9cfce183ee598c7e9f77f464
Following stestr's example where arguments such as --blacklist-file,
--black-regex and --whitelist-file are deprecated since its
3.1.0 release, let's do the change here as well in order to
get tempest consumers some time for the transition.
This change deprecates the following arguments and replaces them
by new ones which are functionally equivavelnt:
* --black-regex is replaced by --exclude-regex
* --blacklist-file is replaced by --exclude-list
* --whitelist-file is replaced by --include-list
For now, Tempest will accept both (new and old) arguments to make
the transition smoother for all consumers.
The patch also bumps min version of tox to 3.18.0 in order to
replace tox's whitelist_externals by allowlist_externals option:
https://github.com/tox-dev/tox/blob/master/docs/changelog.rst#v3180-2020-07-23
Change-Id: I3e09b31f63d2cd7ea41c48e62432bd3bc54fcf44
compute microversion 2.3 schema is already covered in
I2f36a51fa47b28df1afada5396dec3ce7dc43d78
This commit update the doc for the same.
Change-Id: I58160cc2bd42cabce1abc482dd769e2323c90026
stable/stein is not suported in Tempest now, so
let's remove their jobs from master gate.
Also, update doc to reflect it.
Depends-On: https://review.opendev.org/c/openstack/stackviz/+/768212
Change-Id: I0cbc2883e1cfdb3b1d6b10a7ecea83a4bae32afb
Generate documentation for each test from its docstring.
The sphinx-apidoc tool is used to generate the .rst
files necessary for the generation of the documentation.
When the documentation is being build only functions that
start with "test" are passed to the resulting documentation.
Change-Id: I1878f67e10df9bb1f8289beda8e59a56b5057fe4
As discussed in Victoria PTG[1], we need to start pining
the constraint in tox.ini on Tempest new release so that our
tox.ini can match with compatible constraints with Tempest version.
[1] https://etherpad.opendev.org/p/qa-victoria-ptg
Change-Id: Ib705f59ef3aea93b2778cc87fc44d390b5a62c94
Let's remove deprecated scenario image options which have been
deprecated for more than 4 years.
From now on CONF.scenario.img_file will need a full path for the image.
CONF.scenario.img_dir was deprecated and will be removed in the next
release. Till Tempest 25.0.0, old behavior is maintained and keep working
but starting Tempest 26.0.0, you need to specify the full path
in CONF.scenario.img_file config option.
Change-Id: I96d26ad3889f55d867fdea016953cce522a6fbdf
Related-Bug: #1393881
Switch to openstackdocstheme 2.2.0 and reno 3.1.0 versions. Using
these versions will allow especially:
* Linking from HTML to PDF document
* parallelizing building of documents
Update Sphinx version as well.
openstackdocstheme renames some variables, so follow the renames
before the next release removes them. A couple of variables are also
not needed anymore, remove them.
Set openstackdocs_pdf_link to link to PDF file.
Depends-On: https://review.opendev.org/728938
Change-Id: Ia31f69f00eb24771bf700b4e25ae73a09c1c8aed
