After I2601433585740030ab61433f0e8ca1a919275d9f is merged,
the exception description of auth_version is no longer
true, this is to remove it.
Change-Id: I5f9d8fb852faa92708158fca7d7bc7f5ac2fd933
Read-only property 'os' has moved to 'os_primary' in version 'Pike'
and will be removed in version 'Queens', so this is to replace
the usage of 'os' with 'os_primary'.
Change-Id: I9f7c13da05a8c4a63529c11aa6213a7269abee6d
This commit updates the document theme. It is clear, simple, up-to-date
and beautiful. And this commit also updates section headers to fix the
document index.
Change-Id: Ia1e8e16e5f5ddb06e4c4ccb4979b0750b88a4db4
It could be confusing to new comers that the variables
cls.os and cls.os_primary or cls.alt_manager and cls.os_alt
actually are aliases. Besides we are not consistent in their usage.
This patch normalizes the usage around os_admin, os_primary and
os_alt. We keep the old aliases for compatibility but we should not
use them anymore.
This fix a long standing TODO item.
Change-Id: I5f7164f7a7ec5d4380ca22885000caa0183a0bf7
During ATL PTG, we discussed about the testing
of API microversions in Tempest and what all
tests can be implemented on Tempest side.
This patch adds those consensus in doc to clarify
about microversion testing scope.
Change-Id: Ifbaa66dba932a7472010bddf11545d66b95ba42e
This commit adds documentation on how to interact with clients, client
managers, and credentials objects. These are critical pieces of
information for anyone writing tempest tests, so making sure the guide
includes this information is equally important.
Change-Id: I89e2c137068eea8aeaff0561fe078eccd3a23f0e
This commit fixes the top level header for the write_tests doc.
Previously, the doc title was set as the same as the section. This
caused things like table of contents to confuse the hierarchy of the
sections in the docs. This commit fixes that by setting the doc title
to be a higher lever in the hierarchy.
Change-Id: I2ecb110c766a71e1dc2d9e663ca38ece76dc327d
All other rst files don't contain "-" in the file names instead of '_'.
This patch renames test-removal.rst for consistent format on rst files.
TrivialFix
Change-Id: I229870baa1954e1f6b2277318ae5bae332f660ad
This commit is the start of a new doc guide for helping people figure
out how to write good tempest tests. This is just a starting point for
the document and doesn't cover every aspect of writing a test case in
tempest. Right now it just covers the setupClass phase for writing
TestCases. It will be expanded upon in future commits to give a complete
guide to writing tests in Tempest.
Change-Id: Ie0db2079163f536ae72668c8fc9129ae4c6389e2
With pbr 2.0 and Sphinx 1.5, the setting for treat sphinx warnings as
errors is setting warning-is-error in build_sphinx section. Migrate
the setting from the old warnerrors one.
There are a couple of small items to be cleaned up.
Change-Id: I01b1ac49c69d001ea25a475d903311d0b592656e
Tempest doesn't build docs in any format except for HTML. We can remove
all of the cruft for other builders.
Change-Id: I0011e4bfdf6fdeb560e5f8a39a8077c80501c79e
Below patch implemented Cinder microversion 3.3 test case.
- I3d9b3fe288333721bf3b2c6c988949f2f253bfcc
Thsi commit adds the information about tested microversion
in doc.
Change-Id: I17e66b3732657a5606e300b504bbf474abc073fa
Tests that target and API which does not provide a version discovery
mechanism, and which introduces backward incompatibilites cannot
live in Tempest due to its branchless nature.
With this commit I propose to extend the list of exceptions from
the standard removal procedure to include this group of tests.
Example: I84626976ca729f65b0ee0ea6afe5c9a6a408eecc
Change-Id: I209b0b3d470bd284949a77d9c266d78e7c5a5c13
servers_client is most useful client for testing, but the docstring was
not enabled on the site. So this patch makes it enabled.
Change-Id: I031de923deab74bc0f84cff52f470ab233b7dbba
This just runs the 2.32 test against the 2.42 microversion.
The content is the same. The issue with tags is due to a bug
where block device tags only work for the 2.32 microversion
specifically, and network tags only worked for 2.32->2.36
microversions. Network tags were broken in the 2.37 microversion.
The 2.42 microversion re-introduces block device and network
tags when creating a server.
Depends-On: Ia0869dc6f7f5bd347ccbd0930d1d668d37695a22
Related-Bug: #1658571
Part of blueprint fix-tag-attribute-disappearing
Change-Id: Ide579744f4b2c768f622f1f3d928e9e2b02f1051
This adds an API test that tests device role tagging. It boots an
instance with tagged network interfaces and block devices and makes
sure that the tags appear correctly in the metadata, both via the API
and in the configdrive.
Change-Id: Ica92b771fc04891ad231967470f8b0ade7d2dead
Implements blueprint virt-device-role-tagging
It's not used anymore. There was general consensus in Feb 2016
to deprecate it (see [1]) and remove it in Newton.
[1] [qa] deprecating Tempest stress framework
Change-Id: Ib229985ea2a1fee495c9492c9ce1781e6bac1dc6
When building packages if git is absent, then we should not set
html_last_updated_fmt. It can still be set via the -D switch
when building with sphinx-build.
Change-Id: Icfeb9354fff36776f5c83d3da3ab39ce2bb1dfb3
Closes-Bug: #1552251
Every few weeks we get people filing bugs because they're using creds
with pre-existing resources created in an accounts.yaml and list tests
start randomly failing. This adds documentation to say don't do that
because it breaks the isolation expectation of tests.
Change-Id: I6d31a8309d17c72748c4c6283fb6d014f7493463
This adds the tests for the 2.37 microversion in nova
that handles automatic allocation of network resources
for a server via neutron's auto-allocated-topology extension
when there are no networks already available to the tenant.
This also adds the 2.26 microversion json response schema
since that's what's coming back for GET and LIST operations
on servers when testing the 2.37 microversion.
Tests for nova blueprint get-me-a-network
Change-Id: Ia8538e20ba52c85cfabbf9e44a959b2821995eab
Migrate the service_clients module to tempest.lib.services.clients.
Migrate related unit tests as well.
The clients module atm imports plugin.py from Tempest which is not
allowed via hacking to avoid cirtular dependencies.
If there is no way around this, I will have to remove the self
registration of the service clients from plugins, and ask the
plugins to do the registration themselves - which is a pity. Ideas?
Change-Id: I40e3478f69af62a7cdc14fa65ed21dcfbbe10e72
Javelin CLI utilities has been deprecated in Jan 2016
- Ie4ab5258946271a16e96a070abeedfafa5423714
which is over 6 months of Tempest deprecation period.
This patch removes the javelin CLI and corresponding doc/sample
files etc.
Change-Id: Ia59d3e81f245f29a7bf0f56b690586dfc55f16a0
This commit fixes some typos in the Tempest Test Removal Procedure
document. The document was introduced by just copying from the wiki page
to this repo[1]. So we didn't paying attention at that time.
[1] I5f2322a5de7b73252e0162165eeaec120ec94948
Change-Id: Ia3b4f255cc688ddd4007cf80753923cb18799b98
Before Tempest had three different methods of providing authentication,
dynamic credentials, locking test accounts and non-locking test
accounts, currently only the first two are supported. This commit
updates a section on the configuration guide where it still mentions
three methods.
Change-Id: I532aff27a803b9fd34e994153f4183de48d91d00
Closes-Bug: 1600319
This commit adds details for using tempest run to execute tempest tests
to the quickstart guide in the readme.
Partially-implements: bp tempest-run-cmd
Change-Id: I7c5b51e4f055424fa62b1b262b2d1c96918e46eb
This commit adds running the plugin registry generation script to the
sphinx build. This ensure that every time we build the docs we'll have
an up-to-date plugin registry. This comes at the cost of increased
build time since the script will query openstack's git server to get
the plugin list. Also, the plugin-registry source file was added to
.gitignore since it is autogenerated now.
Change-Id: Ib26124c5d5d5ef4617e4e702e594ce7f1795ce23
This commit tidies up the tempest document index page. The tempest docs
are increasing day by day. It's really good however I feel it's a little
messy these days. So let's tidy up :)
Change-Id: I4d34934b8d1a157bf38a8f2cafe5de1ba0e6098c
Adds new command subunit-describe-calls, documentation,
and unittests.
subunit-describe-calls is a parser for subunit v1 & v2 streams to
determine what REST API calls are made inside of a test and in what
order they are called.
Later commits will add additional functionality relating to request
& response headers & body data along with a stdout output option and
stdin input.
Change-Id: I468d0d3e3b6098da95a81cc86d9bdd1b47ee1f03
This commit moves the oslo config generator config file from living as
a data file, which makes it very difficult to rely on, to just living
in the package. By including it in the package we have a guaranteed
relative path we can rely on for building utilities on it, like the
tempest init command.
Change-Id: I5b9deae733f42fe3ed39418103304f71b43dccb3
Partially-implements: bp tempest-run-cmd
This commit copies the Tempest test removal procedure doc from wiki[1]
to the tempest repo. Because this document is tightly coupled with
tempest so we don't need to manage it in the wiki. And we can see and
review this through the gerrit when we would like to update it.
And I'll update the wiki page to be just a link after merging this.
[1] https://wiki.openstack.org/wiki/QA/Tempest-test-removal
Change-Id: I5f2322a5de7b73252e0162165eeaec120ec94948