Define the Integrated-gate-storage gate template
tempest-full job run all services API and scenario tests (non slow) and this job is part of Integrated-gate gate template which run on multiple services (nova, neutron, cinder, glance, placement) check and gate pipeline. But there are many unrelated tests run on each project gate. For example, neutron gate run cinder only tests and fail due to cinder bugs. There is no point of breaking the neutron gate due to cinder only test failure and slow down the neutron development phase. This is what we dicussed in Train PTG in denver to improve the integrated gate[1] and came up with idea of split the integated-gate template into much logical way so that only dependent services tests run on their gate. One way was to move the service only tests to service tempest plugin side but Tempest is used by interop as well as on production cloud testing so moving the test is not good idea. This commit propose the idea of defining the 'Integrated-gate-storage' gate template for cinder gate which will run Cinder, Glance, Swift and Nova tests. ML discussion: http://lists.openstack.org/pipermail/openstack-discuss/2019-May/005871.html Next step will be to replace the Integrated-gate-py3 template with new Integrated-gate-storage template on cinder and glance gate. [1] https://etherpad.openstack.org/p/qa-train-ptg Change-Id: Iae7d26325228aad0edb94f7e191c8fd0d60e1362
This commit is contained in:
parent
5072a24080
commit
a699445d28
31
.zuul.yaml
31
.zuul.yaml
|
@ -191,6 +191,21 @@
|
|||
s-proxy: false
|
||||
c-bak: false
|
||||
|
||||
- job:
|
||||
name: tempest-integrated-storage
|
||||
parent: devstack-tempest
|
||||
branches: ^(?!stable/ocata).*$
|
||||
description: |
|
||||
This job runs integration tests for image & block storage. This is
|
||||
subset of 'tempest-full' job and run Cinder, Glance, Swift and Nova
|
||||
related tests. This is meant to be run on Cinder and Glance gate only.
|
||||
vars:
|
||||
tox_envlist: integrated-storage
|
||||
devstack_localrc:
|
||||
USE_PYTHON3: true
|
||||
FORCE_CONFIG_DRIVE: true
|
||||
ENABLE_VOLUME_MULTIATTACH: true
|
||||
|
||||
- job:
|
||||
name: tempest-full-py3-ipv6
|
||||
parent: devstack-tempest-ipv6
|
||||
|
@ -534,6 +549,22 @@
|
|||
- grenade-py3
|
||||
- tempest-integrated-networking
|
||||
|
||||
- project-template:
|
||||
name: integrated-gate-storage
|
||||
description: |
|
||||
Run the python3 Tempest image & block storage integration tests
|
||||
(Cinder, Glance, Swift and Nova related) in check and gate
|
||||
for the neutron integrated gate. This is meant to be
|
||||
run on Cinder and Glance gate only.
|
||||
check:
|
||||
jobs:
|
||||
- grenade-py3
|
||||
- tempest-integrated-storage
|
||||
gate:
|
||||
jobs:
|
||||
- grenade-py3
|
||||
- tempest-integrated-storage
|
||||
|
||||
- project:
|
||||
templates:
|
||||
- check-requirements
|
||||
|
|
|
@ -0,0 +1,13 @@
|
|||
# This file includes the backlist of tests which need to be
|
||||
# skipped for Integrated-gate-storage template. Integrated-gate-storage template
|
||||
# needs to run only Cinder, Glance, Swift and Nova related tests and rest all
|
||||
# tests will be skipped by below list.
|
||||
|
||||
# Skip network, keystone API tests.
|
||||
tempest.api.network
|
||||
tempest.api.identity
|
||||
|
||||
# Skip network only scenario tests.
|
||||
tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_network_advanced_server_ops
|
||||
tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops
|
||||
tempest.scenario.test_network_v6.TestGettingAddress.test_security_groups_basic_ops
|
12
tox.ini
12
tox.ini
|
@ -130,6 +130,18 @@ commands =
|
|||
tempest run --regex '(?!.*\[.*\bslow\b.*\])(^tempest\.api)' --blacklist_file ./tools/tempest-integrated-gate-networking-blacklist.txt {posargs}
|
||||
tempest run --combine --serial --regex '(?!.*\[.*\bslow\b.*\])(^tempest\.scenario)' --blacklist_file ./tools/tempest-integrated-gate-networking-blacklist.txt {posargs}
|
||||
|
||||
[testenv:integrated-storage]
|
||||
envdir = .tox/tempest
|
||||
sitepackages = {[tempestenv]sitepackages}
|
||||
setenv = {[tempestenv]setenv}
|
||||
deps = {[tempestenv]deps}
|
||||
# The regex below is used to select which tests to run and exclude the slow tag and
|
||||
# tests listed in blacklist file:
|
||||
commands =
|
||||
find . -type f -name "*.pyc" -delete
|
||||
tempest run --regex '(?!.*\[.*\bslow\b.*\])(^tempest\.api)' --blacklist_file ./tools/tempest-integrated-gate-storage-blacklist.txt {posargs}
|
||||
tempest run --combine --serial --regex '(?!.*\[.*\bslow\b.*\])(^tempest\.scenario)' --blacklist_file ./tools/tempest-integrated-gate-storage-blacklist.txt {posargs}
|
||||
|
||||
[testenv:full-serial]
|
||||
envdir = .tox/tempest
|
||||
sitepackages = {[tempestenv]sitepackages}
|
||||
|
|
Loading…
Reference in New Issue