5357689002
After discussing this topic again during the PTG I spent some time checking our scenario jobs which runs in the check and gate queues. After analysis this patch proposes to: * remove neutron-ovs-tempest-slow job from both check and gate queue as slow tests are already run also in the neutron-ovs-tempest-multinode-full job, * remove neutron-ovn-tempest-slow job from both check and gate queue as slow tests are already run also in the neutron-ovn-tempest-ipv6-only job - of course this job is using IPv6 instead of IPv4 but I don't really think it's big issue in that case, neutron-ovn-tempest-slow job was multinode job, unfortunately neutron-ovn-tempest-ipv6-only is single node job and for now it isn't possible to make ipv6-only job to be multinode job so we will keep it like single node job and hopefully move to be multinode job when zuul will provide required data in the job's inventory, * move neutron-ovn-tempest-ovs-release and neutron-ovn-tempest-ovs-release-ipv6-only jobs to periodic queue - I think that running those tests once per day should be enough. Additionally this patch removes definition of the neutron-ovs-tempest-slow and neutron-ovn-tempest-slow jobs are those jobs aren't used anywhere now. Change-Id: I657881c319d425470277885545240d6a8b66a1f6
19 KiB
19 KiB
Neutron jobs running in Zuul CI
Tempest jobs running in Neutron CI
In upstream Neutron CI there are various tempest and neutron-tempest-plugin jobs running. Each of those jobs runs on slightly different configuration of Neutron services. Below is a summary of those jobs. :
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
| Job name | Run tests | python | nodes | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate |
| | | version | | | driver | mode | | | | queue |
+==============================================+==================================+=========+=======+=============+=================+==========+=======+========+============+=============+
|neutron-tempest-plugin-api |neutron_tempest_plugin.api | 3.6 | 1 | openvswitch | openvswitch | legacy | False | False | True | Yes |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-plugin-designate-scenario |neutron_tempest_plugin.scenario.\ | 3.6 | 1 | openvswitch | openvswitch | legacy | False | False | True | No |
| |test_dns_integration | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-plugin-scenario-linuxbridge |neutron_tempest_plugin.scenario | 3.6 | 1 | linuxbridge | iptables | ha | False | False | False | Yes |
| |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_attach_interfaces | | | | | | | | | |
| |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_multiple_create | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-plugin-scenario-openvswitch |neutron_tempest_plugin.scenario | 3.6 | 1 | openvswitch | openvswitch | ha | False | False | False | Yes |
| |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_attach_interfaces | | | | | | | | | |
| |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_multiple_create | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-plugin-scenario-openvswitch-\ |neutron_tempest_plugin.scenario | 3.6 | 1 | openvswitch | iptables_hybrid | ha | False | False | False | Yes |
| iptables_hybrid | | | | | | | | | | |
| |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_attach_interfaces | | | | | | | | | |
| |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_multiple_create | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-plugin-scenario-ovn | neutron_tempest_plugin.scenario | 3.6 | 1 | ovn | ovn | --- | False | False | False | Yes |
| |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_attach_interfaces | | | | | | | | | |
| |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_multiple_create | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovs-tempest-multinode-full |tempest.api (without slow tests) | 3.6 | 2 | openvswitch | openvswitch | legacy | False | False | True | Yes |
| |tempest.scenario | | | | | | | | | |
| |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovs-tempest-dvr-ha-multinode-full |tempest.api (without slow tests) | 3.6 | 3 | openvswitch | openvswitch | dvr | True | True | True | No |
|(non-voting) |tempest.scenario | | | | | dvr_snat | | | | |
| | | | | | | dvr_snat | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovs-tempest-slow |tempest slow tests | 3.6 | 2 | openvswitch | openvswitch | legacy | False | False | True | Yes |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-ipv6-only |tempest smoke + IPv6 tests | 3.6 | 1 | ovn | ovn | --- | False | False | True | Yes |
| |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-ovs-release-ipv6-only | tempest smoke + IPv6 tests | 3.6 | 1 | ovn | ovn | --- | False | False | True | Yes |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+Grenade jobs running in Neutron CI
In upstream Neutron CI there are various Grenade jobs running. Each of those jobs runs on slightly different configuration of Neutron services. Below is summary of those jobs. :
+------------------------------------+---------+-------+-------------+-------------+----------+-------+--------+------------+-------------+
| Job name | python | nodes | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate |
| | version | | | driver | mode | | | | queue |
+====================================+=========+=======+=============+=============+==========+=======+========+============+=============+
| neutron-ovs-grenade-multinode | 3.6 | 2 | openvswitch | openvswitch | legacy | False | False | True | Yes |
+------------------------------------+---------+-------+-------------+-------------+----------+-------+--------+------------+-------------+
| neutron-ovs-grenade-dvr-multinode | 3.6 | 2 | openvswitch | openvswitch | dvr | False | False | True | Yes |
| | | | | | dvr_snat | | | | |
+------------------------------------+---------+-------+-------------+-------------+----------+-------+--------+------------+-------------+Tempest jobs running in Neutron experimental CI
In upstream Neutron CI there is also queue called
experimental. It includes jobs which are not needed to be
run on every patch and/or jobs which isn't stable enough to be run
always. Those jobs can be run by making comment
check experimental in the comment to the patch in
Gerrit.
Currently we have in that queue jobs like listed below. :
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
| Job name | Run tests | python | nodes | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate |
| | | version | | | driver | mode | | | | queue |
+==============================================+==================================+=========+=======+=============+=================+==========+=======+========+============+=============+
|neutron-ovn-tempest-with-uwsgi-loki |tempest.api (without slow tests) | 3.6 | 1 | ovn | ovn | --- | --- | --- | --- | No |
|(non-voting) |tempest.scenario | | | | | | | | | |
| |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-full-multinode-ovs-master |Various tempest api, scenario | 3.6 | 2 | ovn | ovn | --- | --- | --- | --- | No |
| |and neutron_tempest_plugi tests | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-ovs-master |Various tempest api, scenario | 3.6 | 1 | ovn | ovn | --- | --- | --- | --- | No |
| |and neutron_tempest_plugi tests | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-with-neutron-lib-master |tempest.api (without slow tests) | 3.6 | 1 | openvswitch | openvswitch | legacy | False | False | True | No |
| |tempest.scenario | | | | | | | | | |
| |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-with-uwsgi-loki |tempest.api (without slow tests) | 3.6 | 1 | openvswitch | openvswitch | legacy | False | False | True | No |
|(non-voting) |tempest.scenario | | | | | | | | | |
| |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+---------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+And we also have Grenade jobs in the experimental queue. :
+--------------------------------+---------+-------+-------------+-------------+----------+-------+--------+------------+-------------+
| Job name | python | nodes | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate |
| | version | | | driver | mode | | | | queue |
+================================+=========+=======+=============+=============+==========+=======+========+============+=============+
| neutron-ovn-grenade-multinode | 3.6 | 2 | OVN | --- | --- | --- | --- | False | no |
| (non-voting) | | | | | | | | | |
+--------------------------------+---------+-------+-------------+-------------+----------+-------+--------+------------+-------------+Columns description
- L2 agent - agent used on nodes in test job,
- firewall driver - driver configured in L2 agent's config,
- L3 agent mode - mode(s) configured for L3 agent(s) on test nodes,
- L3 HA - value of
l3_haoption set inneutron.conf, - L3 DVR - value of
router_distributedoption set inneutron.conf, - enable_dvr - value of
enable_dvroption set inneutron.conf