openstack
/
tripleo-quickstart-extras
Code Issues Proposed changes

[Train] Remove passing tests from skiplist 

Tests which are passing are being removed from the skiplist
with this patch.

Along with that, class
neutron_tempest_plugin.api.test_networks has maximum no. of
tests passing, so just kept failing test and other all tests
are removed.

Related-Bug: #1753209
Related-Bug: #1793482

Co-Authored-by: Soniya Vyas<svyas@redhat.com>
Co-Authored-by: Suraj Patil<surpatil@redhat.com>
Change-Id: I6a18555ba74018495daee5e5e6479bd2bd0427fd
This commit is contained in:
Soniya Vyas 2019-12-12 19:44:50 +05:30
parent 66ce22d6ed
commit 361cc61be4
1 changed files with 1 additions and 67 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

68
roles/validate-tempest/vars/tempest_skip_train.yml
View File

@ -17,15 +17,6 @@ known_failures:
- test: 'tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_port_security_macspoofing_port'
reason: 'It can be removed when bug for OVN is repaired'
lp: 'https://bugs.launchpad.net/tempest/+bug/1728886'
- test: 'neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest'
reason: 'RBAC policy resource conflict'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1753209'
- test: 'tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot_no_size'
reason: 'network resource conflict'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1753209'
- test: 'tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot'
reason: 'network resource conflict'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1753209'
- test: 'mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_in_list_filter'
reason: 'mismatch error, mistral team is investigating'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1736950'
@ -64,72 +55,15 @@ known_failures:
- test: 'tempest.api.compute.admin.test_auto_allocate_network.AutoAllocateNetworkTest.test_server_multi_create_auto_allocate'
reason: 'Test is failing due microversion'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1821690'
- test: 'neutron_tempest_plugin.api.test_trunk_negative'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_timestamp'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_subnetpools_negative'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_service_type_management'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_security_groups'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_routers_negative'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_routers'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_qos_negative'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_qos'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_ports'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_networks_negative'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_networks'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_floating_ips_negative'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_floating_ips'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_flavors_extensions'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_extension_driver_port_security'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_allowed_address_pair'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_address_scopes_negative'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.test_address_scopes'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.admin.test_shared_network_extension'
- test: 'neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_create_update_network_dns_domain'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.admin.test_routers_ha'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'
- test: 'neutron_tempest_plugin.api.admin.test_l3_agent_scheduler'
reason: 'neutron tempest tests are failing by giving 503 Service Unavailable'
lp: 'https://bugs.launchpad.net/tripleo/+bug/1793482'