1e4cb1da36
run-tempest is changed recently to add the new variables but keep supporting the old ones too, for example: tempest_black_regex, tempest_exclude_regex. and if both old and new var are used in job definition (parent and child) then new variables are picked. Because Tempest is branchless, zuul pick the Tempest master playbooks/roles. That is why job running on stable branch gate will pick the base job definition from Tempest master. This way if any stable jobs which were defining the old var and using old Tempest are broken if any of their parent job define the new var. This commit pin the older run-tempest role for such stable branches. Change-Id: If49ab0c31aca5b7837636727096a9bc83f891b1b
84 lines
1.9 KiB
ReStructuredText
84 lines
1.9 KiB
ReStructuredText
Run Tempest
|
|
|
|
The result of the tempest run is stored in the `tempest_run_result`
|
|
variable (through the `register` statement).
|
|
|
|
**Role Variables**
|
|
|
|
.. zuul:rolevar:: devstack_base_dir
|
|
:default: /opt/stack
|
|
|
|
The devstack base directory.
|
|
|
|
.. zuul:rolevar:: tempest_concurrency
|
|
:default: 0
|
|
|
|
The number of parallel test processes.
|
|
|
|
.. zuul:rolevar:: tempest_test_regex
|
|
:default: ''
|
|
|
|
A regular expression used to select the tests.
|
|
|
|
It works only when used with some specific tox environments
|
|
('all', 'all-plugin'.)
|
|
|
|
In the following example only api scenario and third party tests
|
|
will be executed.
|
|
|
|
::
|
|
vars:
|
|
tempest_test_regex: (tempest\.(api|scenario|thirdparty)).*$
|
|
|
|
.. zuul:rolevar:: tempest_test_blacklist
|
|
|
|
Specifies a blacklist file to skip tests that are not needed.
|
|
|
|
Pass a full path to the file.
|
|
|
|
.. zuul:rolevar:: tox_envlist
|
|
:default: smoke
|
|
|
|
The Tempest tox environment to run.
|
|
|
|
.. zuul:rolevar:: tempest_black_regex
|
|
:default: ''
|
|
|
|
A regular expression used to skip the tests.
|
|
|
|
It works only when used with some specific tox environments
|
|
('all', 'all-plugin'.)
|
|
|
|
::
|
|
vars:
|
|
tempest_black_regex: (tempest.api.identity).*$
|
|
|
|
.. zuul:rolevar:: tox_extra_args
|
|
:default: ''
|
|
|
|
String of extra command line options to pass to tox.
|
|
|
|
Here is an example of running tox with --sitepackages option:
|
|
|
|
::
|
|
vars:
|
|
tox_extra_args: --sitepackages
|
|
|
|
.. zuul:rolevar:: tempest_test_timeout
|
|
:default: ''
|
|
|
|
The timeout (in seconds) for each test.
|
|
|
|
.. zuul:rolevar:: stable_constraints_file
|
|
:default: ''
|
|
|
|
Upper constraints file to be used for stable branch till stable/rocky.
|
|
|
|
.. zuul:rolevar:: tempest_tox_environment
|
|
:default: ''
|
|
|
|
Environment variable to set for run-tempst task.
|
|
|
|
Env variables set in this variable will be combined with some more
|
|
defaults env variable set at runtime.
|