341 Commits

Author SHA1 Message Date
9213ccd207 [Stable Only] pin virtualbmc/sushy-tools/ironic-tempest-plugin to last released tag
With [1][2][3] it no longer works on ubuntu focal with
py3.8.

Also partially cherry-picked [4] for bug #2057972.

[1] https://review.opendev.org/c/openstack/virtualbmc/+/933263
[2] https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/933266
[3] https://review.opendev.org/c/openstack/sushy-tools/+/933259
[4] https://review.opendev.org/c/openstack/ironic/+/913270

Related-Bug: #2086617
Related-Bug: #2057972
Change-Id: I61f7a6d1af3a66d0e8cc610eda5829c7703d144f
2024-11-29 08:31:11 +00:00
Zuul
90aeb10452 Merge "Revert "ci: stable-only: explicitly pin centos build"" into stable/2023.1 2024-10-10 14:55:30 +00:00
Julia Kreger
d409512b4f CI: stable/2023.1 - remove partition and older non-voting jobs
The partition image test job is known to be easy to cause to fail
because it is reliant upon CI scripting to try and make a partition
image during the job run, and it sometimes doesn't work which
increases the failure risk. Given this branch is moving un-maintained
in a few months, we can go ahead and remove this job with relatively
low risk at this point in time.

Also remove centos8, postgres, metalsmith, and non-voting bifrost jobs
to minimize resource waste.

Change-Id: I4cee2c24fc20227e84f7c25b5d24a4c9557b9614
2024-09-05 16:06:57 -07:00
Riccardo Pittau
12b49a29db [CI][stable only] fix zuul config
Change-Id: Iebfc1aa95b96c7c20cd1abe2d03b6b302a1a076a
2024-08-20 13:08:45 +00:00
Riccardo Pittau
2e1bfeb15c [CI] Fix job parent name
ironic-tempest-partition-uefi-redfish-vmedia was renamed to
ironic-tempest-uefi-redfish-vmedia a long time ago

Change-Id: Iaa63e9cf12d47667955973033586fa65dd18e6b7
(cherry picked from commit 3f34f04bf0c46173bbc9d865bd0b001b87ab592d)
2024-08-08 12:29:06 +00:00
Julia Kreger
71682d4017 Revert "ci: stable-only: explicitly pin centos build"
This reverts commit 86358c89e80cb2d078d1aef705cb1609e22da5bb.

Reason for revert: DIB appears to be still trying to merge filename in,
and as such we likely need to re-work our approach here.

Furthermore, explicitly force the redfish job to utilize just the wholedisk
test, instead of both the wholedisk and partition image build process, since
the partition image build test is easy to cause to fail.

Change-Id: I8c110deceda3a65e952cfb9b590d68b5d95efc16
2024-06-24 15:18:00 -07:00
Julia Kreger
59800efd88 ci: pin CI to dnsmasq 2.85
A temporary path forward to increase CI stability, by pinning
to what appears to be a "good working version" of upstream dnsmasq
which does not crash fon us.

Change-Id: I3295c92fd7b7871ad351b94f4c6cf0f554279db0
(cherry picked from commit f893c740d7303e9d321e04f32e3b623237815ff2)
(cherry picked from commit b32378e1cfd4531759b253b58a9dc424ebb713a1)
2024-03-05 17:03:01 +00:00
Julia Kreger
d278fdb6d2 stable-only: pin proliantutils/scciclient to prevent break
Proliantutils 2.16.0 roughly times with the 2023.2
release of ironic and a switch to lextudio-pysnmp,
however in this branch of ironic, however this breaks
depending on order and collides with pysnmp namespace.

Also pins python-scciclient to <0.14.0 as to also not
pull in the dependency difference.

Also, Also, disables standalone, grenade, and metalsmith,
and snmp jobs from voting while we work to stabilize CI across
multiple branches.

Change-Id: Ibe3274d7fabfd4f06af8aba1af0957fa36e8d217
2024-03-04 20:44:45 -08:00
Takashi Kajinami
e04a7273a9 Stop using a specific mirror in infra
The host currently hard-coded is not functioning. This replaces
the hard-coded mirror by the local CI mirror detected. In case
mirror info is not available then upstream centos mirror is used.

Change-Id: I96a8cb45154c9dbb50efecc22d34c4ff75c6722a
(cherry picked from commit 7032a0d9ac2c875c5349708eb78b779473a41a6e)
(cherry picked from commit aec3c072cdd0cde2a49ccd0a4f6136b81e96e5f5)
2024-01-23 03:42:05 +00:00
Zuul
d72eb004ed Merge "CI: Disable mysql counters for grenade" into stable/2023.1 2023-05-25 16:06:42 +00:00
Julia Kreger
cdf8931979 CI: Disable mysql counters for grenade
Disabling the performance counters as we suspect it is causing
database interaction to freeze on the grenade CI job.

Change-Id: Id951815ab9bfd1ca16aa66fa4c87c0e1b3e788f6
(cherry picked from commit 8b98dfafd848bc1f1bd31c073bcdd37606081045)
2023-05-24 19:53:10 +00:00
Jay Faulkner
12e79423aa [ci] [stable-only] Cinder fixed; make BFV job vote
We need to ensure CI for BFV is enabled if we expect BFV to work.

Change-Id: If7cfc319de8cefdb42d4a613e5126c0f0edb0c9e
2023-05-24 12:35:55 -07:00
Jay Faulkner
0c2911b141 [stable-only] [CI] BFV, RBAC jobs marked non-voting
Both of these jobs are broken and need different fixes. We have to
disable them both to later fix them.

Change-Id: I7789d9694ea98a1daa635e7c8656fdd6f0c582f0
2023-05-19 12:06:41 -07:00
Julia Kreger
692a383fdc [CI] Swap anaconda urls
The anaconda job is failing as were getting a redirect issued back
upon attempting to validate URLs. The servers are now directing us
to use HTTPS instead.

Change-Id: Iac8e6e58653ac616250f4ce3ab3ae7f5164e5b03
2023-01-26 13:58:12 -08:00
Zuul
e011922bac Merge "CI: Reset VM footprint to 2.6GB" 2023-01-11 00:48:16 +00:00
Julia Kreger
0230d361f4 CI: Reset VM footprint to 2.6GB
This commit partially reverts change set
I0bfef09a5312a17be54ce5c09805f06b7c349026
where the amount of memory for test VMs was
increased to 4GB. This was because excess
junk getting stuck in the staged ramdisk
images used by CI.

Change-Id: Ia0c74cbeecdb9febf9f7a4e76db84e0f378a97fc
2023-01-03 17:42:55 -08:00
Julia Kreger
1d07be8237 Use centos grub artifacts with centos ramdisk for vmedia
It appears we are getting an opcode error when attempting to boot
Centos 9-stream utilizing the EFI artifacts from Ubuntu.

Technically this should work, however further aftifacts in the boot
chain may be signed with other key credentials that Ubuntu's
grub does not know about, because the chain of trust is
MSFT -> Vendor shim (slow change rate) -> Vendor GRUB -> Kernel

Where vendor differences should never work, is if Secure Boot
is enforcing.

Exception on launch:
 X64 Exception Type - 06(#UD - Invalid Opcode)  CPU Apic ID - 00000000 !!!!

A similar Debian bug is open for a very similar issue:

https://groups.google.com/g/linux.debian.bugs.dist/c/BOiLLeROrmo

However, no additional comments or information have been in follow
up to that reported issue. So in the mean time, we're going to try
and do what those smarter than I recommend, use the vendor's
binaries for their distribution.

There is one further, potentially far more depressing possibility,
that centos9's kernel doesn't support the type of hardware
we're getting. This is suggested by the precise opcode error, UD,
https://xem.github.io/minix86/manual/intel-x86-and-64-manual-vol3/o_fe12b1e2a880e0ce-212.html
But again, easiest possibility first.

Change-Id: Id9bd30bc3c2f1076555317e4a3f277725fa7c1f4
2023-01-03 17:05:04 -08:00
Riccardo Pittau
6b84fbf8f2 Fix CI
- Remove skipsdist that it was never supported and causes breakage
when used with usedevelop.
- add script to allowlist for pep8 test
- disable setuptools autodiscovery
- Increase base VM memory according to new requirements for CS9
based IPA

Change-Id: I0bfef09a5312a17be54ce5c09805f06b7c349026
2022-12-29 17:10:53 +01:00
Jay Faulkner
d7c95306d6 Ironic doesn't use metering; don't start it in CI
We don't use metering. We do use every byte of ram we can get our hands
on.

Change-Id: I839c7fd4cb6fe8661a25e6b4e00650575ae17520
2022-12-13 13:51:11 -08:00
Sławek Kapłoński
7c47ad04fc [grenade] Explicitly enable Neutron ML2/OVS services in the CI job
As with [1] basic grenade job will be switched to run with OVN as
Neutron backend, which is default in Devstack, we need to explicitly
disable ML2/OVN neutron services in the ironic-grenade job and use
ML2/OVS related services in that job.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/867065

[1] https://review.opendev.org/c/openstack/grenade/+/862475

Change-Id: I2ef96d1b3e19004f05253dfae508e9f07ae58f63
2022-12-09 11:52:08 +00:00
Riccardo Pittau
ad0b8e4dce Cross test sushy with python 3.10
We don't test python 3.8 anymore in antelope

Change-Id: I4748f14f7a75ae9da204ffafb61c8e495822f040
2022-10-20 18:04:45 +02:00
1499023c4a Switch to 2023.1 Python3 unit tests and generic template name
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for antelope. Also,
updating the template name to generic one.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Ie1e2138b16929c204235e459df5f9c26885140ab
2022-09-23 08:39:28 +00:00
Julia Kreger
d8fc96fd1f CI: Changes to support Anaconda CI jobs
Introduces additional job configuration to enable automated
integration testing via tempest of the anaconda deployment
interface.

Also, configures a private subnet with DNS, which is required
by anaconda executing, in order to facilitate processing of URLs.

Change-Id: I61b5205cf2c9f83dfcabf4314247c76fb6a56acd
2022-09-06 07:38:11 -07:00
Dmitry Tantsur
f0a1778766 Finally remove support for netboot and the boot_option capability
Instance network boot (not to be confused with ramdisk, iSCSI or
anaconda deploy methods) is insecure, underused and difficult to
maintain. This change removes a lot of related code from Ironic.

The so called "netboot fallback" is still supported for legacy boot when
boot device management is not available or is unreliable.

Change-Id: Ia8510e4acac6dec0a1e4f5cb0e07008548a00c52
2022-08-02 12:47:31 +02:00
Julia Kreger
af838cca79 CI: Pull in diskimage-builder until new release is cut
Change-Id: I88a4863cd24258eb0b395303738c23e3468615c0
2022-06-30 16:29:01 -07:00
Zuul
936414a3cc Merge "Remove netboot jobs from the gate" 2022-06-25 00:21:16 +00:00
Zuul
d807350f6e Merge "Use bifrost on centos9 integration job" 2022-06-24 10:44:22 +00:00
Zuul
6f90d5f6a7 Merge "Swap the metalsmith UEFI job for a legacy one" 2022-06-22 13:45:22 +00:00
Riccardo Pittau
089b0c8e63 Use bifrost on centos9 integration job
We don't support CentOS Stream 8 anymore.

Change-Id: I90f20395afbb5e4299dc807288d4a44863d56768
2022-06-16 14:07:58 +02:00
Dmitry Tantsur
5bbcabbabe Remove netboot jobs from the gate
Netboot option will be removed soon, this change stops covering it.
Some jobs have been renamed to reflect the new reality.

Change-Id: I7e248c3deb4778fcf59bc64821833987653fbbcd
2022-05-31 10:02:56 +02:00
Zuul
37d70d78d7 Merge "CI: Removing ironic job queue" 2022-05-26 19:54:24 +00:00
Dmitry Tantsur
81f583f69b devstack: use CentOS 9 for DIB IPA builds
Additionally bumps CPU model to host-model as centos9 builds now
require a subset of CPU processors which include advanced features.
Host-model also allows for the VM to still start when running with
pure qemu, as opposed to KVM passthrough.

https://developers.redhat.com/blog/2021/01/05/building-red-hat-enterprise-linux-9-for-the-x86-64-v2-microarchitecture-level#architectural_considerations_for_rhel_9

Change-Id: Ic261efd4bf6f5929687df5e7b1b51b541554af18
2022-05-25 08:57:15 -07:00
Julia Kreger
63e53797ad CI: Removing ironic job queue
Change-Id: Idf7991d8f8a8cebcdc0413f26ad31542f8ffa8a8
See: https://zuul-ci.org/docs/zuul/latest/releasenotes.html#relnotes-4-1-0-deprecation-notes
2022-05-19 11:08:22 -07:00
Dmitry Tantsur
f1257c79ca Swap the metalsmith UEFI job for a legacy one
UEFI is well covered by existing jobs, while the legacy job is covering
calling install_bootloader.

Depends-On: https://review.opendev.org/c/openstack/metalsmith/+/841911
Change-Id: I18c5334a52591f3d8ccced15aee8eb332121dded
2022-05-17 12:46:53 +02:00
Zuul
f73639d72c Merge "Fix names of two jobs" 2022-05-09 19:45:25 +00:00
Zuul
49113385e8 Merge "Fix v6 CI job - Return it to normal non-voting status" 2022-05-05 14:46:27 +00:00
Julia Kreger
a9f4acfdb0 Fix v6 CI job - Return it to normal non-voting status
* Fixes the IPv6 job by utilizing HOST_IPV6 instead of
  SERVICE_IPV6, as Devstack now automatically wraps
  SERVICE_IPV6 with brackets as if it is for a URL.
* Locks ipv6 job to bios mode. Ubuntu Focal OVMF/EDK2 does not
  support IPv6 PXE boot by default.
* Split from Devstack in terms of IP usage, since full explicit
  V6 usage is not a thing anymore. 4+6 is the default in devstack
  and regardless of what we set on the job we see both now used.
  So we delineate apart our usage for our own sanity.
* Reduce VM Interface count for IPv6 in an attempt to eliminate
  in-kernel routing confusion by two interfaces on the same physical
  network.
* Set IPv6 mode to dhcpv6-stateless due to fun issues in dhcp clients.
  When we move to UEFI, this will need to be changed to stateful as
  stateless is not supported in general by OVMF/E2DK.

Once the job has run in normal non-voting for a while, and we
ensure that it seems to be stable, we can make it voting again.

Change-Id: Ia833bfb64c6c3cc8e48cbe34ed200536652a8adf
2022-05-04 11:32:29 -07:00
Ghanshyam Mann
2e94aa4241 Drop lower-constraints.txt and its testing
As discussed in TC PTG[1] and TC resolution[2], we are
dropping the lower-constraints.txt file and its testing.
We will keep lower bounds in the requirements.txt file but
with a note that these are not tested lower bounds and we
try our best to keep them updated.

[1] https://etherpad.opendev.org/p/tc-zed-ptg#L326
[2] https://governance.openstack.org/tc/resolutions/20220414-drop-lower-constraints.html#proposal

Change-Id: Ide6b3e9d6c1171f1ae568c256a3e9affa45de17b
2022-04-30 17:58:31 -05:00
Riccardo Pittau
b77a5d67da Fix names of two jobs
Making jobs names less misleading

This should impact sushy and sushy-tools only

sushy change https://review.opendev.org/c/openstack/sushy/+/838662
sushy-tools change https://review.opendev.org/c/openstack/sushy-tools/+/838664

Change-Id: I83f3ac7ddc0662e32c205cd8ec0fab073aeaec56
2022-04-20 08:56:55 +00:00
Julia Kreger
9df7e67e69 Grenade: Change to use bios because we have funky networking
Grenade, for some confusing reason, creates a separate network,
and uses that for upgrade testing as opposed to the original network
the VMs were bound to. If Julia's memory is correct, this was for
multinode upgrade testing.

Anyway, When in UEFI mode, it appears that the TFTP packets
don't get tracked nor cross the boundrary. We likley need to
explicitly address this, but first, lets get the job working as
it was and can then update it.

Also, update requirements because markupsafe removed soft_unicode
method taht was deprecated since a while. Jinja2 started using the
new soft_str method since version 3.0.0

Change-Id: Iaebe966569962b0d3d43774d57b570469479f159
2022-04-04 14:13:58 +02:00
30b0c56d23 Add Python3 zed unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for zed.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I7ac9a2c84d60ca722e2343a5ca21d8c8b2b1ba71
2022-03-24 07:49:59 +00:00
Dmitry Tantsur
5a9dd8b092 Deprecate instance network boot
It's insecure and not very popular. See this post for details:
http://lists.openstack.org/pipermail/openstack-discuss/2021-December/026224.html

Change-Id: I9a2df47bb8c08cc991b3c615a9eb533aba3171f4
2022-02-23 12:15:33 +01:00
Dmitry Tantsur
2f09b7b102 CI: force config drive on the multinode job's subnode
We need configdrives to pass information reliably, and the new cirros
image does not work without them.

Change-Id: I6cafa050d5c1c8289483f968d26c50485fd4528a
2022-02-21 11:57:31 +01:00
Zuul
8452de687e Merge "CI: use a custom cirros partition image instead of the default" 2022-02-16 16:53:59 +00:00
Dmitry Tantsur
bbceca562e CI: use a custom cirros partition image instead of the default
Cirros partition images are not compatible with local boot since they
don't ship grub (nor a normal root partition). This change adds a script
that builds a partition image with UEFI artifacts present. It still
cannot be booted in legacy mode, but it's a progress.

Set the tempest plugin's partition_netboot option. We need it to inform
the tempest plugin about the ability to do local boot. This option
already exists but is never set.

Also set the new default_boot_option parameter, which will be introduced
and used in Iaba563a2ecbca029889bc6894b2a7f0754d27b88.

Remove netboot from most of the UEFI jobs.

Change-Id: I15189e7f5928126c6b336b1416ce6408a4950062
2022-02-16 10:12:06 +01:00
Dmitry Tantsur
f67bbeb9f6 Clean up jobs with legacy names
Not everyone on the team even knows what pxe_ipmitool used to mean :)
Furthermore, we don't need "ipa" in job names, everything uses IPA
for... even longer than pxe_ipmitool does not exist.

While here, one job was clearly meant to use BIOS boot, but it does not.

Change-Id: I8a37efa0f222361f30ddb7fa621548685a40f961
2022-02-03 19:01:28 +01:00
Dmitry Tantsur
6f389138ff Re-enable the standalone job
Change-Id: Ieefdfc0ec287b5fed42f7c7d6d213cbd2f8cd927
2022-02-01 14:40:37 +01:00
Dmitry Tantsur
720b42d538 Avoid non-Stream CentOS and temporary disable the standalone job
The standalone job is failing because of a bug in IPA. To fix it we need
to make DIB jobs operational, and they're failing because of CentOS repos.

Change-Id: I8bd051ea709d328cb5efa2c2cbd5a226bdb4cfd3
2022-01-31 16:32:08 +01:00
Zuul
f6f6ce1a31 Merge "CI: reduce api worker processes to 1" 2021-12-12 18:20:10 +00:00
Julia Kreger
cdc3b9538f CI: Lower test VM memory by 200MB
We're seeing OOM events in CI, hopefully this helps.

Change-Id: Id8c0e4830011ca2fa526df461ed5b9b01f769cf9
2021-12-08 22:43:10 +00:00