This commit fixes some typos in the Tempest Test Removal Procedure
document. The document was introduced by just copying from the wiki page
to this repo[1]. So we didn't paying attention at that time.
[1] I5f2322a5de7b73252e0162165eeaec120ec94948
Change-Id: Ia3b4f255cc688ddd4007cf80753923cb18799b98
This commit adds details for using tempest run to execute tempest tests
to the quickstart guide in the readme.
Partially-implements: bp tempest-run-cmd
Change-Id: I7c5b51e4f055424fa62b1b262b2d1c96918e46eb
This commit adds running the plugin registry generation script to the
sphinx build. This ensure that every time we build the docs we'll have
an up-to-date plugin registry. This comes at the cost of increased
build time since the script will query openstack's git server to get
the plugin list. Also, the plugin-registry source file was added to
.gitignore since it is autogenerated now.
Change-Id: Ib26124c5d5d5ef4617e4e702e594ce7f1795ce23
This commit tidies up the tempest document index page. The tempest docs
are increasing day by day. It's really good however I feel it's a little
messy these days. So let's tidy up :)
Change-Id: I4d34934b8d1a157bf38a8f2cafe5de1ba0e6098c
Adds new command subunit-describe-calls, documentation,
and unittests.
subunit-describe-calls is a parser for subunit v1 & v2 streams to
determine what REST API calls are made inside of a test and in what
order they are called.
Later commits will add additional functionality relating to request
& response headers & body data along with a stdout output option and
stdin input.
Change-Id: I468d0d3e3b6098da95a81cc86d9bdd1b47ee1f03
This commit moves the oslo config generator config file from living as
a data file, which makes it very difficult to rely on, to just living
in the package. By including it in the package we have a guaranteed
relative path we can rely on for building utilities on it, like the
tempest init command.
Change-Id: I5b9deae733f42fe3ed39418103304f71b43dccb3
Partially-implements: bp tempest-run-cmd
This commit copies the Tempest test removal procedure doc from wiki[1]
to the tempest repo. Because this document is tightly coupled with
tempest so we don't need to manage it in the wiki. And we can see and
review this through the gerrit when we would like to update it.
And I'll update the wiki page to be just a link after merging this.
[1] https://wiki.openstack.org/wiki/QA/Tempest-test-removal
Change-Id: I5f2322a5de7b73252e0162165eeaec120ec94948
This commit disables SmartyPants feature for docs because it renders
'--' to '–'(–) but it's not good for command options.
Change-Id: Ic5ef2c648e9e888dc8ce19c4038c39842b66cfd9
This commit adds a new run command to the unified cli endpoint. The
intent here is for tempest to control it's own run story. This
implements the basic runner and selection functionality to use the
command, however it's not necessarily the end state of the command.
The functionality in this patch is just a starting point to add the
command and the basic functionality needed. It is starting with a
limited feature set with the intent to add additional, more complex
functionality in self contained patches after the command exists.
Co-Authored-by: David Paterson <davpat2112@yahoo.com>
Co-Authored-by: Stephen Lowrie <stephen.lowrie@rackspace.com>
Partially-Implements bp tempest-run-cmd
Depends-On: I09299043e536521d48dbe10632621138e3a366e0
Change-Id: I24588b5c00d005320e8719cf82b5dd95662572cf
Certain identity v3 API calls require a domain scoped token when
policy.v3cloudsample.json is used.
Introduce a new config flag to tell Tempest that keystone in the
targe cloud requires domain scoped tokens for admin actions.
Modify the v3 client managers used to obtain v3 admin identity
clients to request the domain scope when the flag is turned on.
Co-authored by: Roxana Gherle <roxana.gherle@hp.com>
Change-Id: I91ca907992428a5a14fb8d48a4fad105d2906e27
Create a consistent means for creation and management of Tempest
workspaces.
Creates a file located at ~/.tempest/workspaces.yaml which stores existing
workspaces.
Available subcommands: list, register, rename, move, remove
bp centralized-workspaces
Change-Id: I9595e3ba809e457951a0ffdf4b15f641f2fec4f4
This commit updates the wording and section separation for the remote
access section of the tempest configuration guide. Previously, the
details about using the validation group felt tacked on and out of
place. This attempts to correct that and make it clear what the
validation group is used for and how that's combined with the network
allocation.
Change-Id: I2f65d25e8f66944347f669dac14d77057a10975a
This commit fixes docs errors and warnings. However, 'WARNING: nonlocal
image URI found' is still remaining because it needs an ugly workaround
that is replacing it to raw html.
Change-Id: I4524c1ff4126c87979301d0fb8ac7c9eb6f2f708
Adding the ability to select the scope of the authentication.
When using identity v3, this makes it possible to use either
project scope or domain scope regardless of whether a project
is included or not in the Credentials object.
The interface to auth for most tests is the AuthProvider.
The scope is defined in the constructor of the AuthProvider,
and it can also be changed at a later time via 'set_scope'.
In most cases a set of credentials will use the same scope.
Test credentials will use project scope. Admin test credentials
may use domain scope on identity API alls, or project scope on
other APIs. Since clients are initialised with an auth provider
by the client manager, we extend the client manager interface to
include the scope. Tests and Tempest parts that require a domain
scoped token will instanciate the relevant client manager with
scope == 'domain', or set the scope to domain on the 'auth_provider'.
The default scope in the v3 auth provider is 'projet;, which me must
do for backward compatibility reasons (besides it's what most tests
expects. We also filter the list of attributes based on scope, so
that tests or service clients may request a different scope.
The original behaviour of the token client is unchanged:
all fields passed to it towards the API server. This
maintains backward compatibility, and leaves full control
for test that want to define what is sent in the token
request.
Closes-bug: #1475359
Change-Id: I6fad6dd48a4d306f69da27c6793de687bbf72add
Plugin authors can have a hard time determining which APIs are acceptable
to use, and which are not. We should provide an explicit list on the
plugin interface doc page.
Change-Id: I475a8ccc568077a4824fda0ddc20606a0ffabbc7
This commit removes the legacy credential provider. It's been
deprecated for over a full cycle which has been sufficient time for
users to migrate off of it. Keeping this around just causes more
confusion by having a 3rd path to configuring credentials in tempest.
The credential provider was officially marked as deprecated in change
Ia5132c5cb32355d6f26b8acdd92a0e55a2c19f41
Change-Id: I8c24cd17f643083dde71ab2bd2a38417c54aeccb
Configuration docs are slightly dated now wrt admin credentials
and credential configurations in general. Fixing that.
Change-Id: Id176202d73683ef3adbcd93a77d90be6a5206f37
Compute 2.10 microversion test were implemented in
I5097a5669d0f3b7d9016d98da0fbb58a682cef8e.
Adding the info in microversion doc.
Change-Id: Id20b47012d77711a01803ba191fc8f343644277e
OpenStack has settled (a very long time ago) on project to represent
the container which has users. We should make tempest configs always
use project versions of these names. This deprecates the old tenant
versions of these names, and makes project version the prefered
option.
Change-Id: Ied68c0326cf891a4e6eb3db51dc5f43241e4b8d2
This is based on the devstack plugin detection code, modified
to check setup.cfg for a tempest_plugins string. It is to be
executed from a periodic proposal job, generating a list of
plugins in the same format.
Change-Id: I53d082319b6af6fb47083ea42c3ff6b109882e72
Patch I29ab6f625df59ba3732f9730a610e14dfe6094ea already fixed some
comments for the doc. But there are still some typos that need to
be fixed. This patch is to fix those.
Change-Id: I6ab6eabfb0faf28e175179c0097e196c4fa944ea
This commit adds the doc about how to implement microversion
tests in Tempest.
Also this doc will keep record of what all microversion tests
have been implemented in Tempest.
Partially implements blueprint api-microversions-testing-support
Change-Id: I68e6d2a4a681e6588e43e02378a111fd00391f08
This change updates to configuration documentation on ssh validation.
Partially implements: blueprint ssh-auth-strategy
Change-Id: Ie6521d77b8ab3b61e7dfa140c7b395c06cf16eeb
This commit adds a subsection to the creating a plugin section in the
plugin doc that tries to strongly advocate creating a separate python
package for tempest plugins for various reasons. This will hopefully
steer potential plugin authors towards doing this.
Change-Id: Id3c06381c0d8e79f59e50486a3c10b12bb977c51
Tempest implements the microversion testing support and
that framework and interfaces have been tested by implementing
the Compute 2.2 microversion as well as by their unit tests.
Those should be stable interfaces so that can be consumed by other
projects microversion testing either in tempest or outside tempest.
To make them as stable interface, this commit moving that framework and
its interfaces to tempest/lib folder.
Adding release notes and library doc for those interface.
Partially implements blueprint api-microversions-testing-support
Change-Id: Icbdcfb4cd5b7fb1029eec035b9e0024be59c8d1f
This commit adds documentation for the library interface, formerly
known as tempest-lib, and the release versioning.
Partially implements bp tempest-lib-reintegration
Change-Id: I623222a17fe3563bbe767fa803e8f771a21687a1
Updated documentation to include information about how to configure
Identity-v3-specific account settings using the Legacy Credentials
configuration options.
Change-Id: I55abf9629ed8f8436ce4497e9790feea05669407