158 Commits

Author SHA1 Message Date
zhufl
cc0c048543 Remove the exception description of auth_version in doc
After I2601433585740030ab61433f0e8ca1a919275d9f is merged,
the exception description of auth_version is no longer
true, this is to remove it.

Change-Id: I5f9d8fb852faa92708158fca7d7bc7f5ac2fd933
2017-05-27 16:21:18 +08:00
zhufl
0419088f9d Replace the usage of 'os' with 'os_primary'
Read-only property 'os' has moved to 'os_primary' in version 'Pike'
and will be removed in version 'Queens', so this is to replace
the usage of 'os' with 'os_primary'.

Change-Id: I9f7c13da05a8c4a63529c11aa6213a7269abee6d
2017-05-23 10:45:48 +08:00
Masayuki Igawa
d2a657de0e
Update document theme and section headers
This commit updates the document theme. It is clear, simple, up-to-date
and beautiful. And this commit also updates section headers to fix the
document index.

Change-Id: Ia1e8e16e5f5ddb06e4c4ccb4979b0750b88a4db4
2017-05-09 15:34:45 -04:00
Jordan Pittier
8160d31e58 test.py: stop using aliases for creds manager
It could be confusing to new comers that the variables
cls.os and cls.os_primary or cls.alt_manager and cls.os_alt
actually are aliases. Besides we are not consistent in their usage.

This patch normalizes the usage around os_admin, os_primary and
os_alt. We keep the old aliases for compatibility but we should not
use them anymore.

This fix a long standing TODO item.

Change-Id: I5f7164f7a7ec5d4380ca22885000caa0183a0bf7
2017-04-26 10:34:56 +02:00
Jenkins
595887ba5e Merge "Improvement in API Microversion testing doc" 2017-04-24 05:35:12 +00:00
zhufl
2e644e6519 Fix the position of the dots in write_tests.rst
This is to move the dots to the end of the sentences.

Change-Id: I2f6906efc8f63f39737c73301e7239b1c7e18ea8
2017-04-21 14:14:54 +08:00
Jenkins
79a45702e9 Merge "Add write tests docs for using client managers and credentials" 2017-04-20 18:47:55 +00:00
ghanshyam
933d982f35 Improvement in API Microversion testing doc
During ATL PTG, we discussed about the testing
of API microversions in Tempest and what all
tests can be implemented on Tempest side.

This patch adds those consensus in doc to clarify
about microversion testing scope.

Change-Id: Ifbaa66dba932a7472010bddf11545d66b95ba42e
2017-04-19 06:19:08 +00:00
Matthew Treinish
19b7ba4229
Add write tests docs for using client managers and credentials
This commit adds documentation on how to interact with clients, client
managers, and credentials objects. These are critical pieces of
information for anyone writing tempest tests, so making sure the guide
includes this information is equally important.

Change-Id: I89e2c137068eea8aeaff0561fe078eccd3a23f0e
2017-04-17 10:08:31 -04:00
yuhui_inspur
cd420fb059 Add Apache License content in .py files
Change-Id: Iebd5844dc2b999f19264daf61d4b73dc85f42111
2017-04-11 01:47:43 -07:00
Matthew Treinish
8f28d1fff4
Fix heading levels in write_tests doc
This commit fixes the top level header for the write_tests doc.
Previously, the doc title was set as the same as the section. This
caused things like table of contents to confuse the hierarchy of the
sections in the docs. This commit fixes that by setting the doc title
to be a higher lever in the hierarchy.

Change-Id: I2ecb110c766a71e1dc2d9e663ca38ece76dc327d
2017-04-08 21:35:41 -04:00
Ken'ichi Ohmichi
d8386a3fb4 Rename test-removal.rst
All other rst files don't contain "-" in the file names instead of '_'.
This patch renames test-removal.rst for consistent format on rst files.

TrivialFix

Change-Id: I229870baa1954e1f6b2277318ae5bae332f660ad
2017-04-04 18:00:52 +00:00
Matthew Treinish
e8ab5f9b08
Add tempest test writing guide
This commit is the start of a new doc guide for helping people figure
out how to write good tempest tests. This is just a starting point for
the document and doesn't cover every aspect of writing a test case in
tempest. Right now it just covers the setupClass phase for writing
TestCases. It will be expanded upon in future commits to give a complete
guide to writing tests in Tempest.

Change-Id: Ie0db2079163f536ae72668c8fc9129ae4c6389e2
2017-04-03 11:53:35 -04:00
Stephen Finucane
d114804f1a Use Sphinx 1.5 warning-is-error
With pbr 2.0 and Sphinx 1.5, the setting for treat sphinx warnings as
errors is setting warning-is-error in build_sphinx section. Migrate
the setting from the old warnerrors one.

There are a couple of small items to be cleaned up.

Change-Id: I01b1ac49c69d001ea25a475d903311d0b592656e
2017-03-23 11:51:45 +00:00
Stephen Finucane
e3701dd534 doc: Remove config for unused builders
Tempest doesn't build docs in any format except for HTML. We can remove
all of the cruft for other builders.

Change-Id: I0011e4bfdf6fdeb560e5f8a39a8077c80501c79e
2017-03-22 12:41:12 +00:00
ghanshyam
58fbcd0071 Add Cinder microversion test info in doc
Below patch implemented Cinder microversion 3.3 test case.
- I3d9b3fe288333721bf3b2c6c988949f2f253bfcc

Thsi commit adds the information about tested microversion
in doc.

Change-Id: I17e66b3732657a5606e300b504bbf474abc073fa
2017-03-13 04:37:17 +00:00
Ken'ichi Ohmichi
4d8ba2377b Fix typo of setUpClass
There are a few same pattern of typo related to setUpClass.
Let's fix them.

Change-Id: Ic835bb37353f1ef6623d55f294c09f4f06a4be44
2017-03-03 18:28:05 -08:00
Andrea Frittoli
b200555709 Update the test removal procedure
Tests that target and API which does not provide a version discovery
mechanism, and which introduces backward incompatibilites cannot
live in Tempest due to its branchless nature.

With this commit I propose to extend the list of exceptions from
the standard removal procedure to include this group of tests.

Example: I84626976ca729f65b0ee0ea6afe5c9a6a408eecc

Change-Id: I209b0b3d470bd284949a77d9c266d78e7c5a5c13
2017-02-23 11:41:58 -05:00
Ken'ichi Ohmichi
aca816da20 Enable sphinx on servers_client
servers_client is most useful client for testing, but the docstring was
not enabled on the site. So this patch makes it enabled.

Change-Id: I031de923deab74bc0f84cff52f470ab233b7dbba
2017-02-10 10:47:27 -08:00
Sergey Nikitin
103d591860 Fixed wrong link in microversion_testing.rst
Change-Id: Id457dce3cbe59a2d675fc199dc4c015b1248ba01
2017-02-08 15:02:34 +04:00
Matt Riedemann
07845fa2ed Add test for compute API microversion 2.42
This just runs the 2.32 test against the 2.42 microversion.
The content is the same. The issue with tags is due to a bug
where block device tags only work for the 2.32 microversion
specifically, and network tags only worked for 2.32->2.36
microversions. Network tags were broken in the 2.37 microversion.
The 2.42 microversion re-introduces block device and network
tags when creating a server.

Depends-On: Ia0869dc6f7f5bd347ccbd0930d1d668d37695a22
Related-Bug: #1658571
Part of blueprint fix-tag-attribute-disappearing

Change-Id: Ide579744f4b2c768f622f1f3d928e9e2b02f1051
2017-01-30 20:24:20 -05:00
gengchc2
831604c1da Removes unnecessary utf-8 coding
The file was added redundant utf-8 coding by some editor.
we can delete it .

Change-Id: I55cfca58af0985fb54f7f6307d96f99ae10bae35
2016-12-26 14:13:35 +08:00
Jenkins
4541ebebcb Merge "Integration tests for device role tagging" 2016-12-02 12:54:37 +00:00
Frédéric Guillot
8160f08882 Fix typo in documentation
Change-Id: If8ff20ff77e5bbe1497faee45c9ef6401b1e5921
2016-11-25 10:41:04 -05:00
Artom Lifshitz
fc8f8e6a82 Integration tests for device role tagging
This adds an API test that tests device role tagging. It boots an
instance with tagged network interfaces and block devices and makes
sure that the tags appear correctly in the metadata, both via the API
and in the configdrive.

Change-Id: Ica92b771fc04891ad231967470f8b0ade7d2dead
Implements blueprint virt-device-role-tagging
2016-11-23 16:46:30 -05:00
Jordan Pittier
2e7ae7c6e5 Remove the Stress framework
It's not used anymore. There was general consensus in Feb 2016
to deprecate it (see [1]) and remove it in Newton.

[1]  [qa] deprecating Tempest stress framework

Change-Id: Ib229985ea2a1fee495c9492c9ce1781e6bac1dc6
2016-10-19 14:31:13 +02:00
Yushiro FURUKAWA
836361de95 Add 'code-block' and revise tab
This commit inserts '.. code-block::' and revises tab to 4 spaces.

Change-Id: Ic36444f101cc8a560c1cfa67dffdf64956c2bb99
2016-09-30 23:35:31 +09:00
Hironori Shiina
91049ad85d Fix a few grammatical errors in docs
This patch fixes a few grammatical errors in documentation.

Change-Id: I5aa92537165aa452649f71e94d6d569011b78fa4
2016-09-28 17:28:49 +09:00
Jenkins
2a7f13b7d3 Merge "Remove non-locking accounts from the config guide" 2016-09-14 05:07:33 +00:00
Thomas Bechtold
89d56178b7 Fix doc build if git is absent
When building packages if git is absent, then we should not set
html_last_updated_fmt. It can still be set via the -D switch
when building with sphinx-build.

Change-Id: Icfeb9354fff36776f5c83d3da3ab39ce2bb1dfb3
Closes-Bug: #1552251
2016-09-02 11:51:16 +00:00
Matthew Treinish
45915b0a39
Add doc section on expectations of clean tenants
Every few weeks we get people filing bugs because they're using creds
with pre-existing resources created in an accounts.yaml and list tests
start randomly failing. This adds documentation to say don't do that
because it breaks the isolation expectation of tests.

Change-Id: I6d31a8309d17c72748c4c6283fb6d014f7493463
2016-08-31 10:29:50 -04:00
Matt Riedemann
3e4a46aa69 Add compute API tests for 'get-me-a-network'
This adds the tests for the 2.37 microversion in nova
that handles automatic allocation of network resources
for a server via neutron's auto-allocated-topology extension
when there are no networks already available to the tenant.

This also adds the 2.26 microversion json response schema
since that's what's coming back for GET and LIST operations
on servers when testing the 2.37 microversion.

Tests for nova blueprint get-me-a-network

Change-Id: Ia8538e20ba52c85cfabbf9e44a959b2821995eab
2016-08-18 11:09:41 -04:00
Andrea Frittoli (andreaf)
e07579c603 Migrate service_clients to tempest.lib
Migrate the service_clients module to tempest.lib.services.clients.
Migrate related unit tests as well.

The clients module atm imports plugin.py from Tempest which is not
allowed via hacking to avoid cirtular dependencies.
If there is no way around this, I will have to remove the self
registration of the service clients from plugins, and ask the
plugins to do the registration themselves - which is a pity. Ideas?

Change-Id: I40e3478f69af62a7cdc14fa65ed21dcfbbe10e72
2016-08-05 16:23:26 +01:00
ghanshyam
2bff1a133a
Remove deprecated Javelin CLI utilities from Tempest
Javelin CLI utilities has been deprecated in Jan 2016
- Ie4ab5258946271a16e96a070abeedfafa5423714
which is over 6 months of Tempest deprecation period.

This patch removes the javelin CLI and corresponding doc/sample
files etc.

Change-Id: Ia59d3e81f245f29a7bf0f56b690586dfc55f16a0
2016-08-01 21:14:42 -04:00
Eli Qiao
e07eaccf84 Add new live_migration case to support block_migration=auto
Compute microversion 2.25 supports auto block_migration
and also the disk_over_commit flag has been removed.

Details: http://docs.openstack.org/developer/nova/api_microversion_history.html#maximum-in-mitaka

This commit adds tests for the same.
Also adds the below required schema for version 2.25 tests.

- 2.3 Schema. Details:
http://docs.openstack.org/developer/nova/api_microversion_history.html#maximum-in-kilo

- 2.16 Schema. Details:
http://docs.openstack.org/developer/nova/api_microversion_history.html#id14

- 2.23 Schema. Details:
http://docs.openstack.org/developer/nova/api_microversion_history.html#id21

Co-Authored-By: ghanshyam <ghanshyam.mann@nectechnologies.in>

Change-Id: I0fb5567cb4f7363465b68b86174b2df039f183d9
2016-07-17 21:56:26 +09:00
Masayuki Igawa
a8d3cae7c2 Fix typo in Test Removal Procedure doc
This commit fixes some typos in the Tempest Test Removal Procedure
document. The document was introduced by just copying from the wiki page
to this repo[1]. So we didn't paying attention at that time.

[1] I5f2322a5de7b73252e0162165eeaec120ec94948

Change-Id: Ia3b4f255cc688ddd4007cf80753923cb18799b98
2016-07-12 03:53:39 +00:00
Castulo J. Martinez
34329b546a Remove non-locking accounts from the config guide
Before Tempest had three different methods of providing authentication,
dynamic credentials, locking test accounts and non-locking test
accounts, currently only the first two are supported. This commit
updates a section on the configuration guide where it still mentions
three methods.

Change-Id: I532aff27a803b9fd34e994153f4183de48d91d00
Closes-Bug: 1600319
2016-07-08 10:56:52 -07:00
Jenkins
68ab4d0a16 Merge "Add basic tempest run instructions to the quickstart" 2016-07-01 19:43:58 +00:00
Jenkins
0720ebc26b Merge "Tidy up document index page" 2016-07-01 08:37:34 +00:00
Matthew Treinish
85c8e3e60d
Add basic tempest run instructions to the quickstart
This commit adds details for using tempest run to execute tempest tests
to the quickstart guide in the readme.

Partially-implements: bp tempest-run-cmd

Change-Id: I7c5b51e4f055424fa62b1b262b2d1c96918e46eb
2016-06-30 19:41:36 -04:00
Matthew Treinish
fc46326854
Add plugin registry generation to sphinx build
This commit adds running the plugin registry generation script to the
sphinx build. This ensure that every time we build the docs we'll have
an up-to-date plugin registry. This comes at the cost of increased
build time since the script will query openstack's git server to get
the plugin list. Also, the plugin-registry source file was added to
.gitignore since it is autogenerated now.

Change-Id: Ib26124c5d5d5ef4617e4e702e594ce7f1795ce23
2016-06-29 10:58:39 -04:00
Masayuki Igawa
d787bc29e3 Tidy up document index page
This commit tidies up the tempest document index page. The tempest docs
are increasing day by day. It's really good however I feel it's a little
messy these days. So let's tidy up :)

Change-Id: I4d34934b8d1a157bf38a8f2cafe5de1ba0e6098c
2016-06-29 14:30:24 +09:00
Jenkins
396593432c Merge "Add subunit-describe-calls" 2016-06-27 18:26:45 +00:00
Jenkins
6dbc403f3d Merge "Add test removal procedure doc" 2016-06-24 07:02:36 +00:00
Stephen Lowrie
c8548fc93c Add subunit-describe-calls
Adds new command subunit-describe-calls, documentation,
and unittests.

subunit-describe-calls is a parser for subunit v1 & v2 streams to
determine what REST API calls are made inside of a test and in what
order they are called.

Later commits will add additional functionality relating to request
& response headers & body data along with a stdout output option and
stdin input.

Change-Id: I468d0d3e3b6098da95a81cc86d9bdd1b47ee1f03
2016-06-22 14:22:22 -05:00
Matthew Treinish
bdef1c77ab
Move oslo config generator config inside package
This commit moves the oslo config generator config file from living as
a data file, which makes it very difficult to rely on, to just living
in the package. By including it in the package we have a guaranteed
relative path we can rely on for building utilities on it, like the
tempest init command.

Change-Id: I5b9deae733f42fe3ed39418103304f71b43dccb3
Partially-implements: bp tempest-run-cmd
2016-06-22 14:39:42 -04:00
Masayuki Igawa
b8532432f8 Add test removal procedure doc
This commit copies the Tempest test removal procedure doc from wiki[1]
to the tempest repo. Because this document is tightly coupled with
tempest so we don't need to manage it in the wiki. And we can see and
review this through the gerrit when we would like to update it.
And I'll update the wiki page to be just a link after merging this.

[1] https://wiki.openstack.org/wiki/QA/Tempest-test-removal

Change-Id: I5f2322a5de7b73252e0162165eeaec120ec94948
2016-06-22 17:31:02 +09:00
Jenkins
b15c5d5649 Merge "Use scope in v3 identity client" 2016-06-10 18:12:09 +00:00
Jenkins
62a8c29b75 Merge "Fix docs warnings of auth" 2016-06-10 13:24:07 +00:00
Jenkins
552f9f7af5 Merge "Disable SmartyPants for docs" 2016-06-10 13:08:27 +00:00