Commit Graph

122 Commits

Author SHA1 Message Date
Masayuki Igawa
a8d3cae7c2 Fix typo in Test Removal Procedure doc
This commit fixes some typos in the Tempest Test Removal Procedure
document. The document was introduced by just copying from the wiki page
to this repo[1]. So we didn't paying attention at that time.

[1] I5f2322a5de7b73252e0162165eeaec120ec94948

Change-Id: Ia3b4f255cc688ddd4007cf80753923cb18799b98
2016-07-12 03:53:39 +00:00
Jenkins
68ab4d0a16 Merge "Add basic tempest run instructions to the quickstart" 2016-07-01 19:43:58 +00:00
Jenkins
0720ebc26b Merge "Tidy up document index page" 2016-07-01 08:37:34 +00:00
Matthew Treinish
85c8e3e60d
Add basic tempest run instructions to the quickstart
This commit adds details for using tempest run to execute tempest tests
to the quickstart guide in the readme.

Partially-implements: bp tempest-run-cmd

Change-Id: I7c5b51e4f055424fa62b1b262b2d1c96918e46eb
2016-06-30 19:41:36 -04:00
Matthew Treinish
fc46326854
Add plugin registry generation to sphinx build
This commit adds running the plugin registry generation script to the
sphinx build. This ensure that every time we build the docs we'll have
an up-to-date plugin registry. This comes at the cost of increased
build time since the script will query openstack's git server to get
the plugin list. Also, the plugin-registry source file was added to
.gitignore since it is autogenerated now.

Change-Id: Ib26124c5d5d5ef4617e4e702e594ce7f1795ce23
2016-06-29 10:58:39 -04:00
Masayuki Igawa
d787bc29e3 Tidy up document index page
This commit tidies up the tempest document index page. The tempest docs
are increasing day by day. It's really good however I feel it's a little
messy these days. So let's tidy up :)

Change-Id: I4d34934b8d1a157bf38a8f2cafe5de1ba0e6098c
2016-06-29 14:30:24 +09:00
Jenkins
396593432c Merge "Add subunit-describe-calls" 2016-06-27 18:26:45 +00:00
Jenkins
6dbc403f3d Merge "Add test removal procedure doc" 2016-06-24 07:02:36 +00:00
Stephen Lowrie
c8548fc93c Add subunit-describe-calls
Adds new command subunit-describe-calls, documentation,
and unittests.

subunit-describe-calls is a parser for subunit v1 & v2 streams to
determine what REST API calls are made inside of a test and in what
order they are called.

Later commits will add additional functionality relating to request
& response headers & body data along with a stdout output option and
stdin input.

Change-Id: I468d0d3e3b6098da95a81cc86d9bdd1b47ee1f03
2016-06-22 14:22:22 -05:00
Matthew Treinish
bdef1c77ab
Move oslo config generator config inside package
This commit moves the oslo config generator config file from living as
a data file, which makes it very difficult to rely on, to just living
in the package. By including it in the package we have a guaranteed
relative path we can rely on for building utilities on it, like the
tempest init command.

Change-Id: I5b9deae733f42fe3ed39418103304f71b43dccb3
Partially-implements: bp tempest-run-cmd
2016-06-22 14:39:42 -04:00
Masayuki Igawa
b8532432f8 Add test removal procedure doc
This commit copies the Tempest test removal procedure doc from wiki[1]
to the tempest repo. Because this document is tightly coupled with
tempest so we don't need to manage it in the wiki. And we can see and
review this through the gerrit when we would like to update it.
And I'll update the wiki page to be just a link after merging this.

[1] https://wiki.openstack.org/wiki/QA/Tempest-test-removal

Change-Id: I5f2322a5de7b73252e0162165eeaec120ec94948
2016-06-22 17:31:02 +09:00
Jenkins
b15c5d5649 Merge "Use scope in v3 identity client" 2016-06-10 18:12:09 +00:00
Jenkins
62a8c29b75 Merge "Fix docs warnings of auth" 2016-06-10 13:24:07 +00:00
Jenkins
552f9f7af5 Merge "Disable SmartyPants for docs" 2016-06-10 13:08:27 +00:00
Masayuki Igawa
eb11b259a7 Fix docs warnings of auth
This commit fixes some docs auth warnings[1] such as
 * Field list ends without a blank line; unexpected unindent
 * Unexpected indentation
 * Block quote ends without a blank line; unexpected unindent
 * document isn't included in any toctree
[1]:
http://logs.openstack.org/79/327579/1/check/gate-tempest-docs/fb1e2bd/console.html#_2016-06-09_22_25_45_335

Change-Id: I78b52a7c737c9fae12040321861aaeef2e3513cb
2016-06-10 10:40:02 +09:00
Masayuki Igawa
44ca9edd3b Disable SmartyPants for docs
This commit disables SmartyPants feature for docs because it renders
'--' to '–'(–) but it's not good for command options.

Change-Id: Ic5ef2c648e9e888dc8ce19c4038c39842b66cfd9
2016-06-10 09:25:48 +09:00
Matthew Treinish
a051c22ad0
Add tempest run command
This commit adds a new run command to the unified cli endpoint. The
intent here is for tempest to control it's own run story. This
implements the basic runner and selection functionality to use the
command, however it's not necessarily the end state of the command.
The functionality in this patch is just a starting point to add the
command and the basic functionality needed. It is starting with a
limited feature set with the intent to add additional, more complex
functionality in self contained patches after the command exists.

Co-Authored-by: David Paterson <davpat2112@yahoo.com>
Co-Authored-by: Stephen Lowrie <stephen.lowrie@rackspace.com>

Partially-Implements bp tempest-run-cmd

Depends-On: I09299043e536521d48dbe10632621138e3a366e0
Change-Id: I24588b5c00d005320e8719cf82b5dd95662572cf
2016-06-09 15:49:12 -04:00
Jenkins
10f32a5716 Merge "Cleanup some small issues in the microversion testing doc" 2016-06-09 05:51:31 +00:00
Jenkins
7ae7403e47 Merge "Centralized Workspaces" 2016-06-08 23:28:11 +00:00
Andrea Frittoli (andreaf)
100d18df69 Use scope in v3 identity client
Certain identity v3 API calls require a domain scoped token when
policy.v3cloudsample.json is used.
Introduce a new config flag to tell Tempest that keystone in the
targe cloud requires domain scoped tokens for admin actions.
Modify the v3 client managers used to obtain v3 admin identity
clients to request the domain scope when the flag is turned on.

Co-authored by: Roxana Gherle <roxana.gherle@hp.com>
Change-Id: I91ca907992428a5a14fb8d48a4fad105d2906e27
2016-06-09 00:24:09 +01:00
Matt Riedemann
3ea70c27a9 Cleanup some small issues in the microversion testing doc
Also adds the missing 2.20 microversion reference for
implemented tests.

Change-Id: I937161a17b4ea555869d49489d2a6f68afc8579c
2016-06-08 09:46:59 -04:00
step6829
80c14eca47 Centralized Workspaces
Create a consistent means for creation and management of Tempest
workspaces.

Creates a file located at ~/.tempest/workspaces.yaml which stores existing
workspaces.

Available subcommands: list, register, rename, move, remove

bp centralized-workspaces

Change-Id: I9595e3ba809e457951a0ffdf4b15f641f2fec4f4
2016-06-07 21:20:44 -05:00
Matthew Treinish
275f178ab9
Cleanup wording and section for remote access config doc
This commit updates the wording and section separation for the remote
access section of the tempest configuration guide. Previously, the
details about using the validation group felt tacked on and out of
place. This attempts to correct that and make it clear what the
validation group is used for and how that's combined with the network
allocation.

Change-Id: I2f65d25e8f66944347f669dac14d77057a10975a
2016-06-07 12:23:58 -04:00
Jenkins
9f92798fdb Merge "Fix docs errors and warnings" 2016-05-28 00:48:53 +00:00
Masayuki Igawa
e63cf0fedf Fix docs errors and warnings
This commit fixes docs errors and warnings. However, 'WARNING: nonlocal
image URI found' is still remaining because it needs an ugly workaround
that is replacing it to raw html.

Change-Id: I4524c1ff4126c87979301d0fb8ac7c9eb6f2f708
2016-05-25 10:25:21 +09:00
Andrea Frittoli (andreaf)
3e82af7f6c Introduce scope in the auth API
Adding the ability to select the scope of the authentication.
When using identity v3, this makes it possible to use either
project scope or domain scope regardless of whether a project
is included or not in the Credentials object.

The interface to auth for most tests is the AuthProvider.
The scope is defined in the constructor of the AuthProvider,
and it can also be changed at a later time via 'set_scope'.

In most cases a set of credentials will use the same scope.
Test credentials will use project scope. Admin test credentials
may use domain scope on identity API alls, or project scope on
other APIs. Since clients are initialised with an auth provider
by the client manager, we extend the client manager interface to
include the scope. Tests and Tempest parts that require a domain
scoped token will instanciate the relevant client manager with
scope == 'domain', or set the scope to domain on the 'auth_provider'.

The default scope in the v3 auth provider is 'projet;, which me must
do for backward compatibility reasons (besides it's what most tests
expects. We also filter the list of attributes based on scope, so
that tests or service clients may request a different scope.

The original behaviour of the token client is unchanged:
all fields passed to it towards the API server. This
maintains backward compatibility, and leaves full control
for test that want to define what is sent in the token
request.

Closes-bug: #1475359
Change-Id: I6fad6dd48a4d306f69da27c6793de687bbf72add
2016-05-24 14:11:14 +00:00
Jenkins
2855a18e75 Merge "Remove deprecated legacy credentials provider" 2016-05-24 09:08:50 +00:00
Kiall Mac Innes
9e6f974110 Document tempest APIs which plugins may use
Plugin authors can have a hard time determining which APIs are acceptable
to use, and which are not. We should provide an explicit list on the
plugin interface doc page.

Change-Id: I475a8ccc568077a4824fda0ddc20606a0ffabbc7
2016-05-23 16:20:55 +01:00
Matthew Treinish
40847ac308
Remove deprecated legacy credentials provider
This commit removes the legacy credential provider. It's been
deprecated for over a full cycle which has been sufficient time for
users to migrate off of it. Keeping this around just causes more
confusion by having a 3rd path to configuring credentials in tempest.
The credential provider was officially marked as deprecated in change
Ia5132c5cb32355d6f26b8acdd92a0e55a2c19f41

Change-Id: I8c24cd17f643083dde71ab2bd2a38417c54aeccb
2016-05-20 18:32:15 -04:00
Jenkins
2211ed8c9c Merge "Remove few refercences left to tempest-lib" 2016-04-30 19:10:19 +00:00
Andrea Frittoli (andreaf)
dd25070fb1 Update configuration docs wrt admin credentials
Configuration docs are slightly dated now wrt admin credentials
and credential configurations in general. Fixing that.

Change-Id: Id176202d73683ef3adbcd93a77d90be6a5206f37
2016-04-29 20:33:47 +00:00
Andrea Frittoli (andreaf)
1370bafda0 Remove few refercences left to tempest-lib
A few places in docs / comments still refer to tempest-lib.
Cleaning those up.

Change-Id: I6a15a6e7e58a49a39b3955c60e16d0c196ec154c
2016-04-29 20:30:34 +00:00
ghanshyam
ba48c9055c Add compute 2.10 microversion tests info in doc
Compute 2.10 microversion test were implemented in
I5097a5669d0f3b7d9016d98da0fbb58a682cef8e.

Adding the info in microversion doc.

Change-Id: Id20b47012d77711a01803ba191fc8f343644277e
2016-04-15 13:42:35 +09:00
Jenkins
438084d0cf Merge "Prepare for dynamic generation of tempest plugin registry" 2016-04-08 01:43:38 +00:00
Sean Dague
ed6e586b9f deprecate use of tenant in configs
OpenStack has settled (a very long time ago) on project to represent
the container which has users. We should make tempest configs always
use project versions of these names. This deprecates the old tenant
versions of these names, and makes project version the prefered
option.

Change-Id: Ied68c0326cf891a4e6eb3db51dc5f43241e4b8d2
2016-04-06 22:26:18 +01:00
Clint Adams
a413652c25 Prepare for dynamic generation of tempest plugin registry
This is based on the devstack plugin detection code, modified
to check setup.cfg for a tempest_plugins string.  It is to be
executed from a periodic proposal job, generating a list of
plugins in the same format.

Change-Id: I53d082319b6af6fb47083ea42c3ff6b109882e72
2016-03-28 20:11:23 -04:00
Tong Liu
e0a3b8ef77 Fix a few typos in microversion doc
Patch I29ab6f625df59ba3732f9730a610e14dfe6094ea already fixed some
comments for the doc. But there are still some typos that need to
be fixed. This patch is to fix those.

Change-Id: I6ab6eabfb0faf28e175179c0097e196c4fa944ea
2016-03-24 22:41:27 +00:00
ghanshyam
e560728a4e Fix comments in microversion doc
This fix some comments left in
I68e6d2a4a681e6588e43e02378a111fd00391f08 for microversion doc.

Change-Id: I29ab6f625df59ba3732f9730a610e14dfe6094ea
2016-03-24 17:22:10 +09:00
Jenkins
d27175b7ef Merge "Add microversion testing doc in tempest" 2016-03-24 08:02:10 +00:00
ghanshyam
bd460acdc7 Add microversion testing doc in tempest
This commit adds the doc about how to implement microversion
tests in Tempest.

Also this doc will keep record of what all microversion tests
have been implemented in Tempest.

Partially implements blueprint api-microversions-testing-support

Change-Id: I68e6d2a4a681e6588e43e02378a111fd00391f08
2016-03-23 10:49:53 +09:00
lanoux
63bb903ce9 Update the docs on ssh validation
This change updates to configuration documentation on ssh validation.

Partially implements: blueprint ssh-auth-strategy

Change-Id: Ie6521d77b8ab3b61e7dfa140c7b395c06cf16eeb
2016-03-22 08:58:58 +00:00
ghanshyam
c3b0b8b499 Trivial: Fix some document comments in microversion
This is follow up patch to fix doc comments left in
Icbdcfb4cd5b7fb1029eec035b9e0024be59c8d1f

Change-Id: Iebdbfd62d1db4088e7e356aae700b74c17888415
2016-03-17 02:44:45 +00:00
Jenkins
36521463de Merge "Add note a section to lib doc about where to put plugins" 2016-03-16 01:54:37 +00:00
Matthew Treinish
00686f2fda
Add note a section to lib doc about where to put plugins
This commit adds a subsection to the creating a plugin section in the
plugin doc that tries to strongly advocate creating a separate python
package for tempest plugins for various reasons. This will hopefully
steer potential plugin authors towards doing this.

Change-Id: Id3c06381c0d8e79f59e50486a3c10b12bb977c51
2016-03-11 18:15:07 -05:00
Ghanshyam
1f47cf976b Migrated microversion testing framework to tempest/lib
Tempest implements the microversion testing support and
that framework and interfaces have been tested by implementing
the Compute 2.2 microversion as well as by their unit tests.

Those should be stable interfaces so that can be consumed by other
projects microversion testing either in tempest or outside tempest.

To make them as stable interface, this commit moving that framework and
its interfaces to tempest/lib folder.

Adding release notes and library doc for those interface.

Partially implements blueprint api-microversions-testing-support

Change-Id: Icbdcfb4cd5b7fb1029eec035b9e0024be59c8d1f
2016-03-11 08:17:15 +00:00
Rodrigo Duarte
6af041a28d Fix typo in library doc title
Change-Id: I2b8ead582226046903116eac6a2594370017d036
2016-03-07 12:17:08 -03:00
Jenkins
fdf5cb791c Merge "Add documentation for the library interface" 2016-03-01 04:47:21 +00:00
Matthew Treinish
55511d98f1
Add documentation for the library interface
This commit adds documentation for the library interface, formerly
known as tempest-lib, and the release versioning.

Partially implements bp tempest-lib-reintegration

Change-Id: I623222a17fe3563bbe767fa803e8f771a21687a1
2016-02-29 15:35:26 -05:00
John Warren
c276478e8f Add Identity v3 account configuration information
Updated documentation to include information about how to configure
Identity-v3-specific account settings using the Legacy Credentials
configuration options.

Change-Id: I55abf9629ed8f8436ce4497e9790feea05669407
2016-02-26 14:32:09 -05:00
Jenkins
7731a59fb3 Merge "Typos and consistency in configuration.rst" 2016-01-12 22:20:29 +00:00