Use Ubuntu Jammy and Temporarily disable scenario tests
A couple of issues happening at the moment:
- Nova recently merged a change that bumps the libvirt version in
the Bobcat release [1]. The new libvirt version is not available
in Ubuntu Focal. In order to get the new libvirt version, our jobs
that were using Ubuntu Focal, are now forced to use Jammy, so we
bump it to the new version in this patch.
- The support for Ubuntu Focal has also been dropped in this
release [2]. Making it one more reason to get the new jammy
images.
While upgrading the image, some other issues surfaced:
- Some CI jobs are doing IPv6 testing, which use quagga. Quagga
does not have a candidate for installation in Jammy and must be
replaced. This issue is already documented [3].
- The inability to set up IPv6, combined with the scenario tests
being enabled in the LVM and CEPH drivers brought up another known
issue: when doing IPv6 setup, we don't set up only IPv6 networking
and we also end up setting crucial information for the scenario
tests to run in the function that does IPv6 setup. So in case the
job is only using IPv4 in scenario testing, we currently don't set
some key configuration to let the shares be created/mounted [4].
- Due to the reasons above, the scenario tests will never pass, as
we can't use Focal images, and when using Jammy, we can't do
scenario testing.
This is blocking the Manila gate and all other changes in the CI.
As we are forced to use the Jammy image and the scenario tests
won't pass, we disable them in this change, do some refactoring
in Manila [5], and re-enable them again for IPv4, until we have
figured out the quagga replacement.
[1] https://review.opendev.org/c/openstack/nova/+/887255
[2] https://lists.openstack.org/pipermail/openstack-discuss/2023-September/034968.html
[3] https://bugs.launchpad.net/manila/+bug/1998489
[4] https://github.com/openstack/manila/blob/master/devstack/plugin.sh#L1104-L1116
[5] https://review.opendev.org/c/openstack/manila/+/893804
Change-Id: Ia45a8e7f7c9cf9959bcc9b9a7243cccbbd1f4916
diff --git a/zuul.d/manila-tempest-jobs.yaml b/zuul.d/manila-tempest-jobs.yaml
index 690b8bc..6383c4b 100644
--- a/zuul.d/manila-tempest-jobs.yaml
+++ b/zuul.d/manila-tempest-jobs.yaml
@@ -166,7 +166,6 @@
- job:
name: manila-tempest-plugin-lvm-base
- nodeset: openstack-single-node-focal
description: |
Test LVM multibackend (DHSS=False) in a 4+6 (dual-stack) devstack
environment with IPv6 control plane endpoints.
@@ -176,6 +175,7 @@
- openstack/neutron-dynamic-routing
vars:
tempest_test_regex: '(^manila_tempest_tests.tests)(?=.*\[.*\bbackend\b.*\])'
+ tempest_exclude_regex: "(^manila_tempest_tests.tests.scenario.*)"
devstack_services: &devstack-with-ovs
# NOTE(gouthamr): LP#1940324 prevents bgp usage with OVN, disable OVN
br-ex-tcpdump: false
@@ -230,13 +230,23 @@
multi_backend: true
image_password: manila
+# NOTE(carloss): Nova bumped libvirt to a version available only on Ubuntu
+# Jammy. We are then forced to migrate this job to use Jammy. When LP Bug
+#1998489 is fixed, we will be able to unify the job above with this.
- job:
name: manila-tempest-plugin-lvm
description: |
- Test LVM multibackend (DHSS=False) in a 4+6 (dual-stack) devstack
- environment with IPv6 control plane endpoints.
- branches: *ubuntu_jammy_test_image_branches
+ Test LVM multibackend (DHSS=False) in a IPv4 environment.
+ branches: ^(?!stable/(2023.1|zed|yoga|xena|wallaby|victoria|ussuri)).*$
parent: manila-tempest-plugin-lvm-base
+ vars:
+ devstack_localrc:
+ MANILA_SETUP_IPV6: false
+ devstack_local_conf:
+ test-config:
+ $TEMPEST_CONFIG:
+ share:
+ run_ipv6_tests: false
- job:
name: manila-tempest-plugin-container
@@ -393,7 +403,6 @@
- job:
name: manila-tempest-plugin-cephfs-native
- nodeset: openstack-single-node-focal
description: Test CephFS Native (DHSS=False)
parent: manila-tempest-plugin-cephfs-native-base
branches: *ubuntu_jammy_test_image_branches
@@ -619,7 +628,6 @@
description: |
Test the GlusterFS driver (DHSS=False) with the native GlusterFS protocol
parent: manila-tempest-plugin-standalone-base
- nodeset: openstack-single-node-focal
required-projects:
- x/devstack-plugin-glusterfs
vars:
@@ -652,7 +660,6 @@
description: |
Test the GlusterFS driver (DHSS=False) with the native NFS protocol
parent: manila-tempest-plugin-standalone-base
- nodeset: openstack-single-node-focal
required-projects:
- x/devstack-plugin-glusterfs
vars:
diff --git a/zuul.d/manila-tempest-stable-jobs.yaml b/zuul.d/manila-tempest-stable-jobs.yaml
index 28db229..e59b5fb 100644
--- a/zuul.d/manila-tempest-stable-jobs.yaml
+++ b/zuul.d/manila-tempest-stable-jobs.yaml
@@ -7,7 +7,7 @@
Test the scenario test cases on the generic driver multibackend
(DHSS=True) with NFS and CIFS
parent: manila-tempest-plugin-generic-scenario-base
- branches: &manila_tempest_image_pinned_branches ^(stable/(zed|yoga|xena)).*$
+ branches: &manila_tempest_image_pinned_branches ^(stable/(2023.1|zed|yoga|xena)).*$
vars: &manila_tempest_image_pinned_vars
devstack_localrc:
# NOTE(carloss): Pinning manila service image to a Focal version,
@@ -27,15 +27,12 @@
- job:
name: manila-tempest-plugin-lvm-stable
- # NOTE(carloss): we are aware that focal is the current default, but
- # in order to avoid breakages when devstack-minimal switches to a newer
- # branch, we are pinning focal here.
- nodeset: openstack-single-node-focal
description: |
Test LVM multibackend (DHSS=False) in a 4+6 (dual-stack) devstack
environment with IPv6 control plane endpoints.
branches: *manila_tempest_image_pinned_branches
parent: manila-tempest-plugin-lvm-base
+ nodeset: openstack-single-node-focal
vars: *manila_tempest_image_pinned_vars
- job:
@@ -74,14 +71,12 @@
- job:
name: manila-tempest-plugin-lvm-yoga
parent: manila-tempest-plugin-lvm-base
- nodeset: openstack-single-node-focal
override-checkout: stable/yoga
vars: *manila_tempest_image_pinned_vars
- job:
name: manila-tempest-plugin-lvm-xena
parent: manila-tempest-plugin-lvm-base
- nodeset: openstack-single-node-focal
override-checkout: stable/xena
vars: *manila_tempest_image_pinned_vars