Use Ubuntu Jammy and Temporarily disable scenario tests

A couple of issues happening at the moment:

- Nova recently merged a change that bumps the libvirt version in
the Bobcat release [1]. The new libvirt version is not available
in Ubuntu Focal. In order to get the new libvirt version, our jobs
that were using Ubuntu Focal, are now forced to use Jammy, so we
bump it to the new version in this patch.

- The support for Ubuntu Focal has also been dropped in this
release [2]. Making it one more reason to get the new jammy
images.

While upgrading the image, some other issues surfaced:

- Some CI jobs are doing IPv6 testing, which use quagga. Quagga
does not have a candidate for installation in Jammy and must be
replaced. This issue is already documented [3].

- The inability to set up IPv6, combined with the scenario tests
being enabled in the LVM and CEPH drivers brought up another known
issue: when doing IPv6 setup, we don't set up only IPv6 networking
and we also end up setting crucial information for the scenario
tests to run in the function that does IPv6 setup. So in case the
job is only using IPv4 in scenario testing, we currently don't set
some key configuration to let the shares be created/mounted [4].

- Due to the reasons above, the scenario tests will never pass, as
we can't use Focal images, and when using Jammy, we can't do
scenario testing.

This is blocking the Manila gate and all other changes in the CI.
As we are forced to use the Jammy image and the scenario tests
won't pass, we disable them in this change, do some refactoring
in Manila [5], and re-enable them again for IPv4, until we have
figured out the quagga replacement.

[1] https://review.opendev.org/c/openstack/nova/+/887255
[2] https://lists.openstack.org/pipermail/openstack-discuss/2023-September/034968.html
[3] https://bugs.launchpad.net/manila/+bug/1998489
[4] https://github.com/openstack/manila/blob/master/devstack/plugin.sh#L1104-L1116
[5] https://review.opendev.org/c/openstack/manila/+/893804

Change-Id: Ia45a8e7f7c9cf9959bcc9b9a7243cccbbd1f4916

zuul.d/manila-tempest-jobs.yaml

@@ -166,7 +166,6 @@
 
 - job:
     name: manila-tempest-plugin-lvm-base
-    nodeset: openstack-single-node-focal
     description: |
       Test LVM multibackend (DHSS=False) in a 4+6 (dual-stack) devstack
       environment with IPv6 control plane endpoints.
@@ -176,6 +175,7 @@
       - openstack/neutron-dynamic-routing
     vars:
       tempest_test_regex: '(^manila_tempest_tests.tests)(?=.*\[.*\bbackend\b.*\])'
+      tempest_exclude_regex: "(^manila_tempest_tests.tests.scenario.*)"
       devstack_services: &devstack-with-ovs
         # NOTE(gouthamr): LP#1940324 prevents bgp usage with OVN, disable OVN
         br-ex-tcpdump: false
@@ -230,13 +230,23 @@
               multi_backend: true
               image_password: manila
 
+# NOTE(carloss): Nova bumped libvirt to a version available only on Ubuntu
+# Jammy. We are then forced to migrate this job to use Jammy. When LP Bug
+#1998489 is fixed, we will be able to unify the job above with this.
 - job:
     name: manila-tempest-plugin-lvm
     description: |
-      Test LVM multibackend (DHSS=False) in a 4+6 (dual-stack) devstack
-      environment with IPv6 control plane endpoints.
-    branches: *ubuntu_jammy_test_image_branches
+      Test LVM multibackend (DHSS=False) in a IPv4 environment.
+    branches: ^(?!stable/(2023.1|zed|yoga|xena|wallaby|victoria|ussuri)).*$
     parent: manila-tempest-plugin-lvm-base
+    vars:
+      devstack_localrc:
+        MANILA_SETUP_IPV6: false
+      devstack_local_conf:
+        test-config:
+          $TEMPEST_CONFIG:
+            share:
+              run_ipv6_tests: false
 
 - job:
     name: manila-tempest-plugin-container
@@ -393,7 +403,6 @@
 
 - job:
     name: manila-tempest-plugin-cephfs-native
-    nodeset: openstack-single-node-focal
     description: Test CephFS Native (DHSS=False)
     parent: manila-tempest-plugin-cephfs-native-base
     branches: *ubuntu_jammy_test_image_branches
@@ -619,7 +628,6 @@
     description: |
       Test the GlusterFS driver (DHSS=False) with the native GlusterFS protocol
     parent: manila-tempest-plugin-standalone-base
-    nodeset: openstack-single-node-focal
     required-projects:
       - x/devstack-plugin-glusterfs
     vars:
@@ -652,7 +660,6 @@
     description: |
       Test the GlusterFS driver (DHSS=False) with the native NFS protocol
     parent: manila-tempest-plugin-standalone-base
-    nodeset: openstack-single-node-focal
     required-projects:
       - x/devstack-plugin-glusterfs
     vars:

zuul.d/manila-tempest-stable-jobs.yaml

@@ -7,7 +7,7 @@
       Test the scenario test cases on the generic driver multibackend
       (DHSS=True) with NFS and CIFS
     parent: manila-tempest-plugin-generic-scenario-base
-    branches: &manila_tempest_image_pinned_branches ^(stable/(zed|yoga|xena)).*$
+    branches: &manila_tempest_image_pinned_branches ^(stable/(2023.1|zed|yoga|xena)).*$
     vars: &manila_tempest_image_pinned_vars
       devstack_localrc:
         # NOTE(carloss): Pinning manila service image to a Focal version,
@@ -27,15 +27,12 @@
 
 - job:
     name: manila-tempest-plugin-lvm-stable
-    # NOTE(carloss): we are aware that focal is the current default, but
-    # in order to avoid breakages when devstack-minimal switches to a newer
-    # branch, we are pinning focal here.
-    nodeset: openstack-single-node-focal
     description: |
       Test LVM multibackend (DHSS=False) in a 4+6 (dual-stack) devstack
       environment with IPv6 control plane endpoints.
     branches: *manila_tempest_image_pinned_branches
     parent: manila-tempest-plugin-lvm-base
+    nodeset: openstack-single-node-focal
     vars: *manila_tempest_image_pinned_vars
 
 - job:
@@ -74,14 +71,12 @@
 - job:
     name: manila-tempest-plugin-lvm-yoga
     parent: manila-tempest-plugin-lvm-base
-    nodeset: openstack-single-node-focal
     override-checkout: stable/yoga
     vars: *manila_tempest_image_pinned_vars
 
 - job:
     name: manila-tempest-plugin-lvm-xena
     parent: manila-tempest-plugin-lvm-base
-    nodeset: openstack-single-node-focal
     override-checkout: stable/xena
     vars: *manila_tempest_image_pinned_vars