294 Commits

Author SHA1 Message Date
Zuul
4de12b1113 Merge "Update microversion doc for compute microversion 2.3" 2021-02-10 16:36:48 +00:00
Zuul
eae384ac1d Merge "Inclusive jargon" 2021-02-09 22:33:47 +00:00
Ghanshyam Mann
bfce1f219b Change Review merge policy from two +2 to single +2 requirement
Now a days, Tempest does not have much active core reviewers due
to that merging the incoming code change is taking too much time.

As you can see we have lot of backlogs in open review ~400

If situation improve in future and we have more Core review
then we can change the policy back to two +2 requirement.

Discussion in QA office hour:
-  http://eavesdrop.openstack.org/meetings/qa/2021/qa.2021-01-26-14.00.log.html#l-147

Change-Id: Ic005de3e56cb4fde9cfce183ee598c7e9f77f464
2021-02-03 16:50:34 -06:00
Martin Kopec
dc84423b72 Inclusive jargon
Following stestr's example where arguments such as --blacklist-file,
--black-regex and --whitelist-file are deprecated since its
3.1.0 release, let's do the change here as well in order to
get tempest consumers some time for the transition.

This change deprecates the following arguments and replaces them
by new ones which are functionally equivavelnt:
* --black-regex is replaced by --exclude-regex
* --blacklist-file is replaced by --exclude-list
* --whitelist-file is replaced by --include-list

For now, Tempest will accept both (new and old) arguments to make
the transition smoother for all consumers.

The patch also bumps min version of tox to 3.18.0 in order to
replace tox's whitelist_externals by allowlist_externals option:
https://github.com/tox-dev/tox/blob/master/docs/changelog.rst#v3180-2020-07-23

Change-Id: I3e09b31f63d2cd7ea41c48e62432bd3bc54fcf44
2021-01-20 08:40:57 +00:00
Ghanshyam Mann
983e1ceb44 Update microversion doc for compute microversion 2.3
compute microversion 2.3 schema is already covered in
I2f36a51fa47b28df1afada5396dec3ce7dc43d78

This commit update the doc for the same.

Change-Id: I58160cc2bd42cabce1abc482dd769e2323c90026
2020-12-29 14:36:10 -06:00
Ghanshyam Mann
f8625f0de5 Remove stable/stein testing jobs
stable/stein is not suported in Tempest now, so
let's remove their jobs from master gate.

Also, update doc to reflect it.

Depends-On: https://review.opendev.org/c/openstack/stackviz/+/768212

Change-Id: I0cbc2883e1cfdb3b1d6b10a7ecea83a4bae32afb
2020-12-22 14:46:23 +00:00
Roman Dobosz
edda62ab35 Fix indentation for the example code in documentation.
Change-Id: I454c22aaf1ffa56c37c0105ab76aa70d28983f43
2020-12-07 10:18:42 +01:00
zhufl
fb1e4db2bf Fix incorrect compute api microversion history links
Some compute api microversion history links are incorrect, this
is to fix them.

Change-Id: Ied16a88afa2799d6b5b5cb858851ead44ce2e081
2020-10-29 14:34:13 +08:00
Lukas Piwowarski
a9055010fc Create documentation for tests
Generate documentation for each test from its docstring.

The sphinx-apidoc tool is used to generate the .rst
files necessary for the generation of the documentation.

When the documentation is being build only functions that
start with "test" are passed to the resulting documentation.

Change-Id: I1878f67e10df9bb1f8289beda8e59a56b5057fe4
2020-09-02 09:46:00 +02:00
Zuul
b652e78103 Merge "Enable xindy for PDF build" 2020-08-04 10:05:45 +00:00
Zuul
50ec7d74c3 Merge "Document the process to pin the constraint in tox.ini" 2020-07-22 03:23:41 +00:00
Ghanshyam Mann
0aa0636a09 Fix tempest plugin cookicutter repo path
cookicutter expect ether git+<repo-url> or it has the
'git' in url, otherwise it give error
- http://paste.openstack.org/show/795952/

plugin cookicutter README is fine but tempest doc does
not mention about it and end up having error
- https://opendev.org/openstack/tempest-plugin-cookiecutter

Change-Id: Ifb12011ac901be57d49a6ae623a24a916837c07d
2020-07-15 13:42:07 -05:00
Zuul
ea55a17ee2 Merge "Fix pygments style" 2020-07-14 16:16:59 +00:00
Ghanshyam Mann
d89122be41 Document the process to pin the constraint in tox.ini
As discussed in Victoria PTG[1], we need to start pining
the constraint in tox.ini on Tempest new release so that our
tox.ini can match with compatible constraints with Tempest version.

[1] https://etherpad.opendev.org/p/qa-victoria-ptg

Change-Id: Ib705f59ef3aea93b2778cc87fc44d390b5a62c94
2020-07-07 13:11:42 +00:00
Zuul
3800158de0 Merge "Remove deprecated scenario image options" 2020-07-06 13:04:36 +00:00
Martin Kopec
02af6a44cc Remove deprecated scenario image options
Let's remove deprecated scenario image options which have been
deprecated for more than 4 years.

From now on CONF.scenario.img_file will need a full path for the image.
CONF.scenario.img_dir was deprecated and will be removed in the next
release. Till Tempest 25.0.0, old behavior is maintained and keep working
but starting Tempest 26.0.0, you need to specify the full path
in CONF.scenario.img_file config option.

Change-Id: I96d26ad3889f55d867fdea016953cce522a6fbdf
Related-Bug: #1393881
2020-07-05 10:16:18 +00:00
Ghanshyam Mann
aaaafbb5b8 Fix pdf-doc build by skiping the sample file
Tempest pdf doc build includes the sample config
file which is large in size and end up with
error 'Dimension too large'

- https://zuul.opendev.org/t/openstack/build/84d73ec987d04c05acc54b231d33067e/log/sphinx-build-pdf.log#1874

Its happening while adding new config option in
https://review.opendev.org/#/c/686073/ which means we
are at the edge of pdf build limit.

We should not include the sample config file as part
of pdf build.

Change-Id: I59383505989705d35d86b19b5c1aaafebd2bd307
Closes-Bug: #1886212
2020-07-03 11:24:43 -05:00
melissaml
217eebd0bf Fix pygments style
New theme of docs respects pygments_style.

more info: http://lists.openstack.org/pipermail/openstack-discuss/2020-May/014971.html

Change-Id: I4fbc5fc613e6eb64997935422697477db3ebcc91
2020-06-24 10:13:45 +08:00
Zuul
9d716814f4 Merge "Add migration uuid API schema validation for 2.59" 2020-05-20 18:28:20 +00:00
Andreas Jaeger
0fbce17220 Switch to newer openstackdocstheme and reno versions
Switch to openstackdocstheme 2.2.0 and reno 3.1.0 versions. Using
these versions will allow especially:
* Linking from HTML to PDF document
* parallelizing building of documents

Update Sphinx version as well.

openstackdocstheme renames some variables, so follow the renames
before the next release removes them. A couple of variables are also
not needed anymore, remove them.

Set openstackdocs_pdf_link to link to PDF file.

Depends-On: https://review.opendev.org/728938
Change-Id: Ia31f69f00eb24771bf700b4e25ae73a09c1c8aed
2020-05-18 19:34:29 +02:00
James Parker
4bbe5b58ec Add migration uuid API schema validation for 2.59
Microversion 2.59 [1] compute API added a "uuid" parameter to the body of
the following migration responses:

- GET /os-migrations
- GET /servers/{server_id}/migrations/{migration_id}
- GET /servers/{server_id}/migrations

This commit adds the uuid to the response validation schema for
list_migrations.

[1] https://docs.openstack.org/nova/latest/reference/api-microversion-history.html#id55

Change-Id: Ic748f70d90446c79324df30147e4a270b72d710e
2020-05-14 10:21:26 -04:00
Ghanshyam Mann
710e877e43 Fix redirect for doc section
support-policy section was renamed in
- https://review.opendev.org/#/c/725446/

but redirect for that was not correct. Fixing that
redirect.

Change-Id: Ia2921533c7a61bab4325a4a89b2b84f391e0aafd
2020-05-05 14:30:34 -05:00
Ghanshyam Mann
da3bb61f1f Add index page for plugins documents
Now we have more documents for plugins on stable release,
support and their testing policy. Let's prepare a
index page for it will be easy for plugins maintainer.

Also renaming the stable support policy section to have a clear
name.

Adding redirect links for moved documents.

Change-Id: I17a9a6e0e88605a0ee5047678d6ed168c31396ec
2020-05-05 02:12:05 +00:00
Ghanshyam Mann
96800bb833 Add document for stable branch testing for tempest plugins
As Tempest and plugins master version is used to test the supported
stable branches, we need to test them on master gate.

Adding document for that so that we can test the stable branches
more consistently on plugins side too.

Change-Id: Ied3c6bb4032fd3740ae0d6d185e4a138fd335b02
2020-05-05 01:41:11 +00:00
Vishakha Agarwal
e8f1876aa6 Update supported version doc tempest
This patch updates about the new supported release Ussuri.

Change-Id: Ib17602dfe0eb1707acfe220ab0c230cf781cd367
2020-05-02 21:57:10 +05:30
Zuul
5cc3ffce8c Merge "Remove the stable rocky from supported branch in Tempest master" 2020-04-29 21:54:31 +00:00
Ghanshyam Mann
d9654dae59 Fix typo in contributor guide
There are few typo in contributor guide which were
added recently.

Change-Id: I0f3d18ee375ac32d83a019f3ce6194b332b2c9a1
2020-04-22 21:54:19 -05:00
Ghanshyam Mann
ba416467e6 Remove the stable rocky from supported branch in Tempest master
Rocky is in Extended Maintainance state now so we can
remove this from supported branch and also remove its
jobs to run on master gate.

-https://releases.openstack.org/

Depends-On: https://review.opendev.org/#/c/722186/

Change-Id: I46f4abf07839fb5e8767635e2502e97e8409b8b8
2020-04-23 02:30:32 +00:00
Zuul
e357481ffb Merge "[ussuri][goal] Update contributor documentation" 2020-04-20 17:36:37 +00:00
Ghanshyam Mann
95c410afc0 [ussuri][goal] Update contributor documentation
This patch updates/adds the contributor documentation to follow
the guidelines of the Ussuri cycle community goal[1].

[1] https://governance.openstack.org/tc/goals/selected/ussuri/project-ptl-and-contrib-docs.html
Story: #2007236
Task: #38554

Change-Id: Ib54b16543eb428087555cd3411bae51244d1aa65
2020-04-19 17:44:59 -05:00
Zuul
a21844a609 Merge "Document the policy for Tempest & its plugins release" 2020-04-18 02:45:02 +00:00
Ghanshyam Mann
235c264457 Document the policy for Tempest & its plugins release
Tempest and its plugin are very tightly coupled for testing
Upstream or Production Cloud. Due to its branchless model,
one of the challenges we faced/facing is to provide their
compatible version set.

Since Queens release and with operator request, we started
doing a coordinated release of plugins along with Tempest
which will be marked as the First compatible version for
that particular release.

For example https://releases.openstack.org/train/index.html#tempest-plugins

We test our stable branch with master version of Tempest &
plugins until it is moved to Extended Maintainance state.
One stable release is in EM state, Tempest officially declares
the end of support tag so that we can use that as the last compatible
version for that EM stable testing. But we do not have the correct
last compatible version from plugins which can be used for testing
the EM branch. It should be with hash from the master at the time
stable release is moved to EM not the hash when the stable release
was done otherwise it will be incompatible with Tempest.

We have faced and fixed many issue due to that during py2-drop work
where we have to pick and try all different versions from plugin to
make it work against EM testing.

Change-Id: I99a6df0a2c02e19efaf484fcd97b875887f08d8e
2020-04-17 15:23:18 +00:00
Lee Yarwood
803b4a7e83 compute: Add missing 2.73 response schema validation
Microversion v2.73 was introduced in Nova by I46edd595e7417c58410648
changing the request responses of ``GET servers/{server_id}``, ``GET
/servers/detail``, ``POST /servers/{server_id}/action``  where the
action is rebuild and ``PUT servers/{server_id}``.

Change-Id: I8c800f6e280ec6fdf204d344124d994a25d0af19
2020-04-12 11:15:09 +01:00
Ghanshyam Mann
551e8d7a59 [ussuri][goal] Drop python 2.7 support and testing
OpenStack is dropping the py2.7 support in ussuri cycle.

Tempest is ready with python 3 and ok to drop the
python 2.7 support. Last Tempest version officially supported
for py2.7 is 23.0.0.

Now onwards, Tempest will test all stable branch with py3 jobs.
tempest-full and other py2 version of jobs definition are kept
for stable branch gate.

Complete discussion & schedule can be found in
- http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010142.html
- https://etherpad.openstack.org/p/drop-python2-support

Ussuri Communtiy-wide goal:
https://governance.openstack.org/tc/goals/selected/ussuri/drop-py27.html

Change-Id: I75868d5c9b6630fe78958ff89e58a0aced09a6b3
2020-02-12 00:11:31 +00:00
Ghanshyam
b0a8057fbb Drop python 3.5 support from Tempest
Tempest, its plugins and their dependencies in ussuri
cycle are python-requires>=py3.6 which makes distro not
having python 3.6 to do hack to install py3.6 etc.

We cannot do >py3.6 in basepython so one way is to drop the
py3.5 support and basepython to py3 so that it can choose
the available py version in env.

It time to drop the py3.5 from Tempest. Last supported version of
Tempest for py3.5 is 23.0.0.

oslo drop py2 so we need to remove the py2 unit test job which
is failing and blocking gate.

There is seoarate work to drop the py2 things from Tempest in
compplete set.

Change-Id: I872dbb57df46d1193c0d409bb00d56f372d295fe
Related-Bug: 1861308
2020-02-04 19:23:01 +00:00
Zuul
01b779e784 Merge "Add doc for supported OpenStack release & py version" 2020-01-26 00:26:50 +00:00
Ghanshyam Mann
68600b18fa Add doc for supported OpenStack release & py version
Tempest is branchless and support many OpenStack stable branches
and python versions. Users of Tempest should have a clear doc about
what all openstack releases and python versions are supported.

Change-Id: Idc76e07efdd3710a59c773c564ca532419989ed5
2020-01-23 14:39:36 +00:00
Soniya Vyas
6ed6fb5af5 Replaced testr with stestr
The officially supported test runner for Tempest is stestr.
overview.rst has frequently used testr as Tempest runner.
Hence, there is need to replace it.

Change-Id: Ie9f9557ebb791225cb2a9f7dabba67f92a1ac376
Signed-off-by:- Soniya Vyas<svyas@redhat.com>
2019-12-06 11:51:47 +05:30
Masayuki Igawa
b20c3a5cc0
Enable xindy for PDF build
This commit enables xindy for the PDF build. We can do this since the
bug[0] was already fixed.

[0] https://bugzilla.redhat.com/show_bug.cgi?id=1643664

Change-Id: I98aa27ea412fdc2d562fe845dd834550d6751a2b
2019-09-30 11:04:38 +09:00
pengyuesheng
e740d39d04 Bump the openstackdocstheme extension to 1.20
Some options are now automatically configured by the version 1.20:
- project
- html_last_updated_fmt
- latex_engine
- latex_elements
- version
- release.

Change-Id: Ia656e992e86293339521627acc892f81f7bd6a0b
2019-09-16 02:08:48 +00:00
Masayuki Igawa
7e4ef4c823
Add PDF building
This commit add PDF building tox.ini environment and options for LaTeX
output. overview.rst is copied from README.rst. And, the original
README.rst file is shrunk because we don't need such a long information
in the README file. People can see the same contents in overview.rst
now.

Change-Id: Id654c814988e78704726d2ba8bea9a03ce8596f8
2019-09-11 16:42:28 +09:00
Matthew Treinish
4730b9dd45
Remove references to locking test accounts config doc
The name locking test accounts was an early name in the development of
the pre-provisioned credentials development. It described what it did
used tests accounts and lock files to ensure one test class only was
using an account at a time. However, that name hasn't been really used
in a long time and we've called the feature pre-provisioned credentials.
The configuration guide section for pre-provisioned credentials still
had some out dated references to locking test accounts which were never
updated when the feature was renamed. This commit corrects the oversight
and consistently names the feature in that section of the documentation.

Change-Id: I0f3a7b373c5ca2d84a8e82c1e2c3bcd6a2d833f9
2019-08-15 09:33:15 -04:00
Masayuki Igawa
ac8ae64d5b
Publish BLACKLIST on Tempest plugin registry page
This commit makes the BLACKLIST to be published on the Tempest plugin
registry page which we discussed at the PTG[0].

[0] https://etherpad.openstack.org/p/qa-train-ptg

Change-Id: I707aba930037e86f5f94dac73da957f5afacf935
2019-06-13 11:57:09 +09:00
Zuul
53d8b0b1cf Merge "Add compute API response schema validation for 2.71" 2019-05-28 14:36:25 +00:00
Zuul
21ce12ed9f Merge "Add support for compute API v2.70 - os-volume_attachments" 2019-05-28 13:59:39 +00:00
caoyuan
349ba75410 Replace git.openstack.org URLs with opendev.org URLs
Thorough replacement of git.openstack.org and review.openstack.org URLs
with their opendev.org counterparts.

Change-Id: I88e894db7b854d32593c770f5aa9b8a91fad7866
2019-05-23 10:19:31 +00:00
Matt Riedemann
0b14b1e0ff Add compute API response schema validation for 2.71
The 2.71 compute API includes the "server_groups" parameter
in the response to the following APIs:

- GET /servers/{server_id} (show)
- PUT /servers/{server_id} (update)
- POST /servers/{server_id}/action (rebuild)

This will be used in an upcoming change to test attaching
and detaching the root volume of a shelved offloaded instance.

Change-Id: I612a15c475404ded0af15b6241b9ac8ec9fb8e26
2019-05-21 12:34:51 +02:00
Matt Riedemann
b9b6e37a75 Add support for compute API v2.70 - os-volume_attachments
This adds the compute API response schema validation for the
2.70 microversion and the following APIs:

- GET /servers/{server_id}/os-volume_attachments (list)
- GET /servers/{server_id}/os-volume_attachments/{volume_id} (show)
- POST /servers/{server_id}/os-volume_attachments (attach)

This will be used in an upcoming change for testing root volume
attach/detach of a shelved offloaded server.

Since the response schema for these have not changed since 2.1 we
have to backfill all of the other servers API response schema
files going back to 2.1.

Change-Id: I2f36a51fa47b28df1afada5396dec3ce7dc43d78
2019-04-26 10:20:00 +02:00
ghanshyam
59a93d1bba Fix openstack-dev ML ref in test removal process.
Change-Id: I281ab52bc714e6b6dc1529f13b700d23caaf6f41
2019-03-07 17:25:29 +00:00
Matt Riedemann
f786405da0 doc: fix compute API microversion list format
Change-Id: I5737b2c906b9e85e7cac3a3abd0746db608bc79d
2019-03-02 12:50:52 -05:00