Commit Graph

522 Commits (master)

Author SHA1 Message Date
Alan Pevec ec349ebef6 Revert "Add fs020-rbac to skiplist - BZ2211604"
This reverts commit 30b34879ce.

Reason for revert: ovn22.12-22.12.0-94.el9fdp with the fix is in the latest compose

Change-Id: I5c96971efcb0e95b207ae514c376714ddbd193a9
2023-07-07 18:21:43 +02:00
Balazs Gibizer 56f6cd0a47 Ignore api.compute.admin.test_networks.NetworksTest.test_list_all_networks
It randomly fails for example [1].
There is a fix pushed to tempest too. [2]

[1] https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/origin-ci-test/pr-logs/pull/openstack-k8s-operators_nova-operator/408/pull-ci-openstack-k8s-operators-nova-operator-main-nova-operator-build-deploy-tempest/1671137960516390912/build-log.txt
[2] https://review.opendev.org/c/openstack/tempest/+/883892

Change-Id: Ia0e8cc9e68b9b29afaa7a505cc88314bbb2eefea
2023-06-20 18:36:56 +02:00
Soniya Vyas 1354e6c706 Skip ironic tests and allow ironic passing tests
Change-Id: I76d40470e386e81c630625c0c1e053e744c02e91
2023-06-13 19:17:26 +05:30
frenzyfriday d3da658b36 Adds tempest and compute jobs to skiplist for bug https://bugzilla.redhat.com/show_bug.cgi?id=2211604
Change-Id: Ief4384b3f7a4b5ba199fa3e790dd1d81e4439b44
2023-06-05 13:50:27 +02:00
Ronelle Landy 30b34879ce Add fs020-rbac to skiplist - BZ2211604
Related-Bug: #BZ2211604
Change-Id: I0f465f5dd32df6e5cc72f3a5edbce1e19a83f10f
2023-06-01 20:51:05 -04:00
Zuul 0129b6d0c8 Merge "Skip neutron_tempest_plugin.scenario.test_security_groups." 2023-06-01 11:49:39 +00:00
Soniya Vyas 35d0925995 Skip neutron_tempest_plugin.scenario.test_security_groups.
Related-Bug: #2211604
Change-Id: Ifb0a83027785246c4baf5e0054b4590383bdaf9a
2023-06-01 16:39:17 +05:30
Soniya Vyas 8f903ce7fb Skip TestObjectStorageBasicOps on rhos-17.1
Related-Bug: #BZ2211370
Change-Id: I656d7075fa68453e99ea826190a6a72a5fea3e45
2023-05-31 08:09:26 -04:00
Balazs Gibizer 5ab4a24be5 Skip two live-migration test in nova-operator
The current prow job has no computes deployed so it cannot run live
migration tests.

Change-Id: I0139a72d9983518c302126300d0216555e85a7b0
2023-05-16 10:58:54 +02:00
jgilaber 615411f28b Add manila-operator tests to allow and skip list
Se the list of tests to be executed by manila operator and one failing
test to the skiplist.

Change-Id: Icf425c160c4add0b25d3d03f61b876c46815032e
2023-05-15 17:48:37 +02:00
Ghanshyam Mann 3f66d538b8 Retire patrole projects
patrole project is not maintained and in QA
PTG, we decided to retire it.

- https://etherpad.opendev.org/p/qa-bobcat-ptg

Depends-On: https://review.opendev.org/c/openstack/governance/+/880014
Change-Id: Ieb9648f3d0b1e80f3934349f4699fd2eeb858114
2023-04-12 14:04:43 -05:00
Pooja Jadhav 04f30cb671 Add nova-operator tests to allow and skip list
Set the list of tests to be executed by nova operator as well as the
failing tests at the moment.

Change-Id: I6b2956e795cf03f03a99f5af668307b04c0411d2
2023-03-27 16:40:26 +05:30
Sandeep Yadav 6ebbe9e5c6 Skip live migration test on fs020
We don't have shared storage between compute nodes in CI.
This test used to get skipped on its own[1][2].

For some reason, `live_migration = false` is not set in tempestconf
in the latest jobs and this tests runs now and fails.

While we investigate and find cause what changed, Adding this test
manually on skip via skiplist.

[1] https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-1ctlr_2comp-featureset020-master/d59ec78/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz
~~~
tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_live_migration ... SKIPPED: Live migration is not available.
~~~

[2] https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-1ctlr_2comp-featureset020-master/d59ec78/logs/undercloud/var/log/tempest/tempestconf.log.txt.gz
~~~
2023-03-14 05:28:26.342 223102 DEBUG config_tempest.constants [-] Setting [compute-feature-enabled] live_migration = false set /usr/lib/python3.9/site-packages/config_tempest/tempest_conf.py:105
~~~

Related-Bug: #2011824
Change-Id: I1e7bb232e2f28749341db6d9e6881f8a28a2e06e
2023-03-17 14:41:24 +05:30
Soniya Vyas 6bf6b724d1 Add neutron-operator tests to allow list
Set the list of tests to be executed by neutron operator.

Change-Id: I343330d5ed664589e93e4fd2ec2824c8c0ddd52b
2023-03-15 17:51:53 +05:30
Arx Cruz 0b41e55da2 Add keystone-operator tests
Add tempest tests for keystone-operator
Right now only tempest.api.identity because the keystone-tempest-tests
are failing because rbac is not available

Change-Id: I311a71d9f62f7eba3e25d1f7aa1da96bea1c751e
2023-03-06 16:46:59 +01:00
Arx Cruz c28f98ee7b Add cinder-operator tests to allow and skip list
Set the list of tests to be executed by cinder operator as well as the
failing tests at the moment.

Change-Id: I6e318efbbceebd7633025f3e3d146c59c4e63c4a
2023-02-21 15:01:13 +01:00
Ronelle Landy afec362ad4 Reinstate skiplist for RHOS-17
RHOS-17 will remain on RHEL-9.0 and will not
receive updates to fi the related bug.
Keeping this skip on 17 (it is no longer needed
on 17.1).

It is a partial revert of
https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/872889.

Related-Bug: https://bugzilla.redhat.com/show_bug.cgi?id=2148354
Change-Id: I76d6cdf13e226ba44f43d27c40d83541d0f8d836
2023-02-14 13:29:43 +05:30
dasm 6dfac6bf87 Revert "Skipped OAUTH1TokensTest to pass fs35 on rhos17 and rhos17.1"
This reverts commit e90779e0f8.

Reason for revert: Bugfix for #2148354 merged

Related-Bug: #2148354

Change-Id: I46015de1bae0a4e7e9c6378594e11d21744bd2d0
2023-02-08 17:42:59 +00:00
Arx Cruz 23305d8359 Fixes on tests and new lists for openstack-operators
This patch changes the following:

* Add a separated skip and allow list for openstack operators.
* Fix tox replacing the whitelist_externals with allowlist_externals
  since the first is now no longer supported.
* Fix validate tests to work on tox python 3.8 and 3.9 jobs

Change-Id: Ifdfa31105ab4231ae3bc48c480265f461d928df7
2023-02-08 14:35:55 +01:00
Pooja Jadhav e90779e0f8 Skipped OAUTH1TokensTest to pass fs35 on rhos17 and rhos17.1
This patch skkiped set of test from OAUTH1TokensTest to pass
fs35 ovb job on rhos17 and rhos17.1 rhel9.

Related-Bug: #2148354
Change-Id: I6796b748ecedb2a57eb11f56b72bc53a0ef0c38e
2022-11-28 13:25:09 +05:30
Dariusz Smigiel af0e6c17b8 Revert "Skip keystone OAUTH1TokensTest tests"
This reverts commit 4ecd42032b.

Reason for revert: Testing if the fix for this issue is already merged.

Change-Id: Ibf5b3c93044e43353b08b2d5e0cf903a5ce2dc63
2022-11-21 06:58:50 -08:00
Juan Badia Payno 473fed6e00 Added allowed group featureset067
Change-Id: Ie9340cb51f9bafbb3f39a5d45a571f9c1ef4adef
2022-11-08 15:25:49 +01:00
Arx Cruz 5180cbf3d3 Add zed to transfer_encoding test
Zed still using old tempest, adding back zed release to the skip list

Change-Id: Ib4c11c27b53264949401eb29092b9f14f2e8318e
2022-11-01 17:39:36 +01:00
Arx Cruz 738ff8cf14 Removing test_create_object_with_transfer_encoding
Removing test_create_object_with_transfer_encoding from master and zed
skip list. Tempest was updated and the test is now passing.
Leaving for wallaby branch since unpin tempest for old branches is a
little bit complicate, and might bring more issues.

Change-Id: I2e3adbf72083492da31534df34d1cdf20d401b93
2022-10-31 15:58:05 +01:00
yatinkarel 5c25f09d26 Unskip 17.0 job for 1990480
[1] is now available in 17.0 so test no longer
required to be skipped.

[1] https://review.opendev.org/q/I25f75d7bd8864ea132246cea79e073232d664d76

Related-Bug: #1990480
Change-Id: If89a6dd5697ec8843ada7687c56e052306337a5b
2022-10-26 10:38:33 +00:00
Arx Cruz 78d417b399 Add featureset to allowed list
This patch add the following featureset groups:
* featureset020
* featureset020_periodic
* featureset063
* featureset064

Note 063 and 064 doesn't have a periodic group since these jobs run the
same set of tests for both periodic and check jobs.

Change-Id: I4fea2941225c8d8c01932931783c59370b245130
2022-10-25 09:45:07 +02:00
Dariusz Smigiel 90fbd74af5 Disable OAUTH1TokenTest due to a bug
Added test
keystone_tempest_plugin.tests.api.identity.v3.test_oauth1_tokens.OAUTH1TokensTest
to skip for tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035 job.

Related-Bug: https://bugs.launchpad.net/tripleo/+bug/1960355
Change-Id: I8afcb7af84c8458c4457b51b935808d62794d23c
2022-10-24 10:00:05 -07:00
Pooja Jadhav 26e795fb49 Update releases for fs62 group
This patch adds all rest releases except train release as
a exceptional case.

Change-Id: I87530399be67c142d48422f4c693bf1776b1027b
2022-10-18 15:50:54 +05:30
yatinkarel 56eeda3610 Unskip 17.1 job for 1990480
[1] is now available in 17.1 so test no longer
required to be skipped.

Also drop zed release from this bug as it was added
as part of [2] but since master is dropped with[3] zed
is also not required.

[1] https://review.opendev.org/q/I25f75d7bd8864ea132246cea79e073232d664d76
[2] https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/860403
[3] https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/860263

Related-Bug: #1990480
Change-Id: I854fe4554cdf3ebcd3cbd274805be5602791b0bd
2022-10-11 12:03:12 +05:30
Marios Andreou d1ecbc72cf Add periodic centos-9-ovb-3ctlr_1comp fs 35 zed to skiplist
This job is added in [1] and we need this patch as the job hits
the related-bug at [2].

[1] https://review.rdoproject.org/r/c/rdo-jobs/+/45537
[2] https://review.rdoproject.org/zuul/build/e15e7a2c7c7644cdac6d777f21f5fb55

Related-Bug: 1960355
Change-Id: I6fd75a2e4921867776c5d6ad0a774fcc2d71e446
2022-10-07 13:54:41 +03:00
Zuul c064eb37b1 Merge "Add standalone-full-tempest-api-rhos-17 to dns test skip" 2022-10-07 07:19:05 +00:00
Zuul efd2528ca8 Merge "Update skiplist for bug 1990480" 2022-10-07 06:53:53 +00:00
Ronelle Landy 438e3145e3 Add standalone-full-tempest-api-rhos-17 to dns test skip
This test is now showing the 'KeyError: 'dns_domain''
error.

Change-Id: I38c89edf0d6467252d9627656c2162b99012ea66
Related-Bug: #1990480
2022-10-06 17:25:39 -04:00
Arx Cruz 8438eff263 Add zed release to list of skipped tests
Add zed release for tests being skipped,
based on the master release. This means
the zed release as well as lp and bz are
copied from master release.

Change-Id: I1c3842f544b07a02ca9a08cb9b723d7f4416e133
2022-10-05 13:37:35 +02:00
yatinkarel 2364897288 Update skiplist for bug 1990480
With [1] included in master and wallaby, the skips
not required for these releases.
rhos-17 jobs can be removed later once the fixes are
backported.

Related-Bug: #1990480
Change-Id: Ibb363165668da23b43eef6e461cf1407b2982405
2022-10-04 19:52:43 +05:30
Soniya Vyas c542f0e007 Skip test_create_update_port_with_dns_domain test for rhos17/rhos17.1
rhel-9-standalone-full-tempest-api-network-rhos-17 and
rhel-9-standalone-full-tempest-api-network-rhos-17.1 is failing on above test
Hence, blocking promotion.

Change-Id: Ie611cd7fedbb1a9d61d398b980d894b434e4e91b
2022-10-03 18:32:28 +05:30
Soniya Vyas fe1bd44258 Skip test_create_update_port_with_dns_domain test for
c9-full-tempest-api-compute/tempest-wallaby

test_create_update_port_with_dns_domain test is failing on
periodic-tripleo-ci-centos-9-standalone-full-tempest-api-compute-wallaby
consecutively for 7 runs

Related bug:  #1990480

Change-Id: I2cd35e36f0a2b8f45e8eca22540f98791707332b
2022-10-03 16:38:55 +05:30
frenzyfriday 29fda7f4f7 Skips neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_dns_domain for tempest api compute master 1990480
Related-Bug:

Change-Id: Id67fd3d74963ead415c3bd16fbac1930059ef8cb
2022-09-30 15:48:12 +02:00
Arx Cruz 092b752422 Update releases in tempest allow list
Adding the keyword all, means the teste will run in any release.
This avoid the need of edit the allow list every time a new
release is created.

Change-Id: Ic3403a2f59d61fc3914ef95432c63f6e0c047025
2022-09-29 15:15:42 +02:00
frenzyfriday c26ed99989 Skips octavia_tempest_plugin.tests.scenario.v2.test_listener.ListenerScenarioTest.test_listener_CRUD for scenario010-ovn-provider-standalone-train
Related-Bug: #1991232
Change-Id: I3d5e4837686c3017519eb6acc02032eeb1569df9
2022-09-29 11:49:33 +02:00
yatinkarel 28f9f6fb24 Remove skips for bug 1793482
These tests already running fine in wallaby but due
to the skips master is missing coverage. Let's drop
the skiplist for all the tests which included master
as a release.

Related-Bug: #1793482
Change-Id: I8fb90b88c18109d9db51f184271ffe403605244f
2022-09-23 14:51:39 +00:00
Chandan Kumar (raukadah) 04397e68de Skip test_create_update_port_with_dns_domain test
It is affecting following job in master/wallaby:
- periodic-tripleo-ci-centos-9-standalone-full-tempest-api-network-wallaby
- will also affect periodic-tripleo-ci-centos-9-standalone-full-tempest-api-wallaby
  in integration line. So skipping it.
- periodic-tripleo-ci-centos-9-standalone-full-tempest-api-network-master
- periodic-tripleo-ci-centos-9-standalone-full-tempest-api-master

Related-Bug: #1990480

Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
Change-Id: I9988eecccd68056feb46e238959be39257194170
2022-09-23 16:39:37 +05:30
Arx Cruz 2773f75393 Add train release on featureset062 periodic group
Train release was missing on featureset062 periodic group, and so, the
periodic jobs were failing due the empty list of tests to be executed.

Change-Id: I519e0644d54925ef467ec5f6f42b8633364016d0
Closes-Bug: #1990045
2022-09-19 11:14:37 +02:00
yatin c6305c27d0 Revert "Skip neutron_tempest_plugin.api.test_port_forwardings.PortForwardingTestJSON"
This reverts commit d56cd975e8
and a13e0bba15.

Reason for revert: Fixed with https://review.opendev.org/855608.

Related-Bug: #1989197
Change-Id: Ia9de8af6a55e2400e11f0c6ad9ebbd0c54bc86b4
2022-09-16 13:16:57 +05:30
Zuul 2ec23d805c Merge "Revert "Update "hard_reboot_after_vol_snap_deletion" entry"" 2022-09-14 14:32:30 +00:00
Jakob Meng a13e0bba15 Skip neutron_tempest_plugin.api.test_port_forwardings.PortForwardingTestJSON on c9 master network comp.
Related-Bug: #1989197
Change-Id: If3936ecea0691e9cae07abcbe3850d7ca5f58d09
2022-09-13 14:40:52 +02:00
Bhagyashri Shewale 69ebdc6b5c Revert "Update "hard_reboot_after_vol_snap_deletion" entry"
This reverts commit 691edbc126.

Reason for revert: Issue is resolved here: https://bugs.launchpad.net/tripleo/+bug/1923194

Change-Id: I046044b0d5a826fa892e35b8761bb32cee51e99f
2022-09-12 14:14:24 +05:30
Jakob Meng d56cd975e8 Skip neutron_tempest_plugin.api.test_port_forwardings.PortForwardingTestJSON
Related-Bug: #1989197
Change-Id: Ifbaa0dae1023e05601bd68fe081fdb23e2968149
2022-09-09 15:30:20 +02:00
Chandan Kumar (raukadah) e5fef170ad Remove test_minimum_basic_instance_hard_reboot_after_vol_snap_deletion
Remove it from skiplist

Testing result: https://review.opendev.org/c/openstack/tripleo-ci/+/850156/1#message-977af8b73a09f8b161a4fb408cab2aec369b8369

Depends-On: https://review.opendev.org/c/openstack/tempest/+/849562

Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
Change-Id: Ia9609a7677a1ffdbf0ff86308d85cab8769a5a1d
2022-09-07 15:47:09 +00:00
Zuul e3f004594c Merge "Add featureset003 group into tempest-allow" 2022-09-01 11:51:40 +00:00