openstack
/
neutron
Code Issues Proposed changes

Move tempest job with neutron-lib master to the experimental queue 

The job neutron-tempest-with-neutron-lib-master is mostly to check if
current neutron changes will work fine with some changes done in
neutron-lib.
It isn't really needed to run it on all patches and can be rune on
demand by running experimental queue if that is needed.

This patch also removes job neutron-ovn-tempest-ovs-master from the
experimental queue as we already have there similar multinode job.
As job neutron-ovn-tempest-ovs-master wasn't used anywhere, this patch
also removes its definition.

Finally this patch improves ci_scenario_jobs document and adds there
info about experimental queue and what is there currently.

Change-Id: I0fc4ffd5db2673cefcd01307555d1a3900bb12e8
This commit is contained in:
Slawek Kaplonski 2021-02-04 11:24:09 +01:00
parent 72b7996966
commit fc4e6ce1fe
3 changed files with 44 additions and 31 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

54
doc/source/contributor/testing/ci_scenario_jobs.rst
View File

@ -79,27 +79,12 @@ Below is a summary of those jobs.
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-slow-py3 |tempest slow tests | 3.6 | 2 | openvswitch | openvswitch | legacy | False | False | True | Yes |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-with-uwsgi-loki |tempest.api (without slow tests) | 3.6 | 1 | openvswitch | openvswitch | legacy | False | False | True | No |
|(non-voting) |tempest.scenario | | | | | | | | | |
| |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-ipv6-only |tempest smoke + IPv6 tests | 3.6 | 1 | openvswitch | openvswitch | legacy | False | False | True | Yes |
| |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-ovs-release |Various tempest api, scenario | 3.6 | 1 | ovn | ovn | --- | False | False | True | Yes |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-slow |tempest slow tests | 3.6 | 2 | ovn | ovn | --- | False | False | True | No |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-multinode-ovs-master |Various tempest api, scenario | 3.6 | 2 | ovn | ovn | --- | False | False | True | No |
| |and neutron_tempest_plugi tests | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-with-neutron-lib-master |tempest.api (without slow tests) | 3.6 | 1 | openvswitch | openvswitch | legacy | False | False | True | No |
| |tempest.scenario | | | | | | | | | |
| |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
Grenade jobs running in Neutron CI
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
@ -118,6 +103,45 @@ Below is summary of those jobs.
| neutron-grenade-dvr-multinode | 3.6 | 2 | openvswitch | openvswitch | dvr | False | False | True | Yes |
| | | | | | dvr_snat | | | | |
+--------------------------------+---------+-------+-------------+-------------+----------+-------+--------+------------+-------------+
Tempest jobs running in Neutron experimental CI
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
In upstream Neutron CI there is also queue called ``experimental``. It includes
jobs which are not needed to be run on every patch and/or jobs which isn't
stable enough to be run always.
Those jobs can be run by making comment ``check experimental`` in the comment to
the patch in Gerrit.
Currently we have in that queue jobs like listed below.
::
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
| Job name | Run tests | python | nodes | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate |
| | | version | | | driver | mode | | | | queue |
+==============================================+==================================+=========+=======+=============+=================+==========+=======+========+============+=============+
|neutron-tempest-with-neutron-lib-master |tempest.api (without slow tests) | 3.6 | 1 | openvswitch | openvswitch | legacy | False | False | True | No |
| |tempest.scenario | | | | | | | | | |
| |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-with-uwsgi-loki |tempest.api (without slow tests) | 3.6 | 1 | openvswitch | openvswitch | legacy | False | False | True | No |
|(non-voting) |tempest.scenario | | | | | | | | | |
| |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-slow |tempest slow tests | 3.6 | 2 | ovn | ovn | --- | False | False | True | No |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-multinode-ovs-master |Various tempest api, scenario | 3.6 | 2 | ovn | ovn | --- | False | False | True | No |
| |and neutron_tempest_plugi tests | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
And we also have Grenade jobs in the experimental queue.
::
+--------------------------------+---------+-------+-------------+-------------+----------+-------+--------+------------+-------------+
| Job name | python | nodes | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate |
| | version | | | driver | mode | | | | queue |
+================================+=========+=======+=============+=============+==========+=======+========+============+=============+
| neutron-grenade-ovn | 3.6 | 2 | OVN | --- | --- | --- | --- | False | no |
| (non-voting) | | | | | | | | | |
+--------------------------------+---------+-------+-------------+-------------+----------+-------+--------+------------+-------------+

5
zuul.d/project.yaml
View File

@ -48,9 +48,6 @@
irrelevant-files: *irrelevant-files
- neutron-tempest-ipv6-only:
irrelevant-files: *irrelevant-files
- neutron-tempest-with-neutron-lib-master:
voting: false
irrelevant-files: *irrelevant-files
- neutron-ovn-tempest-ovs-release:
irrelevant-files: *irrelevant-files
- neutron-ovn-tempest-ovs-release-ipv6-only:
@ -98,11 +95,11 @@
experimental:
jobs:
- neutron-ovn-tempest-ovs-master
- neutron-grenade-ovn
- neutron-tempest-with-uwsgi-loki
- neutron-ovn-tempest-slow
- neutron-ovn-tempest-full-multinode-ovs-master
- neutron-tempest-with-neutron-lib-master
periodic:
jobs:

16
zuul.d/tempest-singlenode.yaml
View File

@ -392,12 +392,14 @@
s-proxy: false
- job:
name: neutron-ovn-tempest-ovs-master
description: Job testing for devstack/tempest testing Neutron with ovn driver and OVN master branch
name: neutron-ovn-tempest-ovs-master-fedora
description: Job testing for devstack/tempest testing Neutron with ovn driver and OVN master branch and Fedora
parent: neutron-ovn-base
nodeset: devstack-single-node-fedora-latest
vars:
devstack_localrc:
OVN_BRANCH: master
OVS_BRANCH: master
devstack_services:
etcd: false
br-ex-tcpdump: true
@ -445,13 +447,3 @@
OVN_BRANCH: v20.06.1
# TODO(jlibosva): v2.13.1 is incompatible with kernel 4.15.0-118, sticking to commit hash until new v2.13 tag is created
OVS_BRANCH: 0047ca3a0290f1ef954f2c76b31477cf4b9755f5
- job:
name: neutron-ovn-tempest-ovs-master-fedora
description: Job testing for devstack/tempest testing Neutron with ovn driver and OVN master branch and Fedora
parent: neutron-ovn-tempest-ovs-master
nodeset: devstack-single-node-fedora-latest
vars:
devstack_localrc:
OVN_BRANCH: master
OVS_BRANCH: master