Commit Graph

58 Commits (master)

Author SHA1 Message Date
Riccardo Pittau 39b6553161 Fix for tox4 and setuptools
- Disable auto discovery in setuptools
This is to avoid issues with latest setuptools after version 61.0
For more info see [1]
- add bash script to allowlist in tox.ini
- use default size for vm memory

[1] https://github.com/pypa/setuptools/issues/3197

Change-Id: Iae24917add1aae6b1ed46dba0d2c270b39c5698c
5 months ago
Dmitry Tantsur 6a1334a068 Drop support for instance netboot
Change-Id: I2b4c543537dac8904028fdcdb590c1c214238e10
11 months ago
Dmitry Tantsur 21b075cd3f Add a metalsmith job with legacy boot
With netboot removal, this will be the only job that tests local legacy
boot with partition images.

Depends-On: https://review.opendev.org/c/openstack/metalsmith/+/841911
Change-Id: Id3f165286cfc47dcf45c042115a63804a0c671e8
1 year ago
Zuul db981d07a4 Merge "CI: be explicit that the jobs are using the DIB ramdisk" 1 year ago
Dmitry Tantsur 48f30ab528 Stop defaulting the standalone job to netboot; use the correct boot mode
Its configuration must match one in Ironic, and netboot does not work
with whole disk images under UEFI.

Fix the boot mode of the BIOS job: it was running in UEFI.

Change-Id: Ia207e80bbfc30f8d2891e11bbeda7b2ab0d617c0
1 year ago
Dmitry Tantsur 56c20a7e57 CI: be explicit that the jobs are using the DIB ramdisk
Currently it requires tracing the jobs up to the ironic's devstack
plugin. Be explicit.

Change-Id: I19d0e680b0025bda22709c5a4fff9eacb5b4b1d0
1 year ago
Julia Kreger ce296a43d6 Remove metalsmith centos7 job
Change-Id: I523382b5b06b479ba34dce5a1dc7262076122514
2 years ago
Dmitry Tantsur 764e29729d Stop testing the iscsi deploy interface
Remove the jobs that are now redundant.

Depends-On: https://review.opendev.org/c/openstack/diskimage-builder/+/788972
Depends-On: https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/788971
Change-Id: Ic0b7bc509652c23cec85e685d66de368fdc4761d
2 years ago
Dmitry Tantsur afcc5d392c Fix incorrect lsblk tag and add a virtual media job
Follow-up to 8dd6589e66d03e45e1d510601da9531a30842cff: PATH is not a
valid lsblk tag, we need to use KNAME with -p flag.

Also add a vmedia job to avoid breakages in the future. It's added
non-voting because we have a deadlock with this change:
https://review.opendev.org/c/openstack/ironic/+/783722

Change-Id: Ifffeac9c1c4d394526d655eaa14c9fe7bd3a1e5e
2 years ago
Riccardo Pittau 45371bfb9e Prepare to use tinycore 12
Tinycore 12 requires some more RAM than its predecessor.

Change-Id: I642ccdcef43361b5648a9652d041ebb6dfe6a0e9
2 years ago
Zuul d84e88769e Merge "Don't run os-prober from grub2-mkconfig" 3 years ago
Riccardo Pittau c3ab4a7ca7 Remove nodeset option
The ironic-ipa-base is based on ironic-base that is already running
on ubuntu focal, non need to specify nodeset for those jobs that
are based on it.

Change-Id: I7ffb920442d5e33ef5014152b72b9ac32e367047
3 years ago
Riccardo Pittau 1f15a10c6a Run dib ipa src jobs on ubuntu focal
Also disabling dstat in all focal based jobs because of
https://bugs.launchpad.net/ubuntu/+source/dstat/+bug/1866619
Plus including increase of alloc memory to increase job
success rate, original change from [1]
And re-enabling ipa-tempest-bios-ipmi-direct-src and
ipa-tempest-bios-ipmi-iscsi-src

[1] https://review.opendev.org/759765

Co-authored-by: Julia Kreger <juliaashleykreger@gmail.com>

Change-Id: Ia154745b71c17063eeaaabeb56950ab1cc9ce927
3 years ago
Julia Kreger 6542a9cb04 Don't run os-prober from grub2-mkconfig
By default, grub2-mkconfig scans everything to look for other
environments and then load those into the grub configuration.

It makes sense, but on newer versions of grub2 in distribution
images, os-prober is taking an exceptionally long time in some
cases where more than one storage device exists with other
filesystems.

As a result, of the os-prober execution by grub2-mkconfig, the
bootloader installation can completely time out and fail the
deployment. This is presently experienced with metalsmith on
centos8.

There are numerous sporatic reports of issues like this issue
where grub2-mkconfig hangs for some period of time, and this is
observable on Centos8.2 in our CI. While one report[0] mentions
this issue, Another bug [1] has the dialog that actually helps us
frame the context as to what we likely should do.

Also, fixes the unit testing so we actually test if we're running
with grub2. :\

[0]: https://bugzilla.redhat.com/show_bug.cgi?id=1744693
[1]: https://bugzilla.redhat.com/show_bug.cgi?id=1709682

Depends-On: https://review.opendev.org/#/c/748315
Change-Id: I14bf299afef3a1ddb2006fe5f182d7f0d249e734
3 years ago
Riccardo Pittau 5c99f60083 Use focal for tinyipa src jobs used by ipa-builder
We can use focal here but we need to disable dstat because of
https://bugs.launchpad.net/ubuntu/+source/dstat/+bug/1866619

Change-Id: I2c013e871fc56aa0077656dfc76de9aad6bed83f
3 years ago
Riccardo Pittau 13de98bd98 Use bionic nodeset for DIB centos src jobs
We'll keep using bionic as nodeset for certain jobs because of limitations
in DIB when building centos images.
DIB uses yum-tools to prepare the chroot environment, but the package is
not present in ubuntu focal because of lack of Python 2.x support.

Change-Id: I8635b7dfa6910c1721b89739d4d51fa7df488432
3 years ago
Zuul 6cb781b24e Merge "Remove unused jobs" 3 years ago
Julia Kreger afb521d18e CI: Lower memory usage of VMs/Increase swap
The IPA images we presently build/use for centos are
now smaller than their peak size a few months ago.

As such, we should be able to reduce that memory footprint
and still execcute all of the necessary tests without any
issues.

Also increases the amount of swap to 8GB as the infra
default is now 1GB.

Change-Id: I5705f1f2504803a049ed88a0d8b1d6d0bbccf9e4
3 years ago
Zuul f45d2cc0e7 Merge "Move ironic-standalone-ipa-src to Ubuntu Focal" 3 years ago
Riccardo Pittau 63513aeb6f Remove unused jobs
Also add some info on external projects that use current jobs.

Depends-On: https://review.opendev.org/749723

Change-Id: Ifeffebf2264993e1773a1e9867380523ec49a93f
3 years ago
Riccardo Pittau 85bd44d6ac Prepare to move ipa-builder jobs
Correctly rename jobs used by ipa-builder

Change-Id: Ia07b23518ea9c7500aaa21d88b72f94f48e97cb6
3 years ago
Riccardo Pittau 700c14c73c Move ironic-standalone-ipa-src to Ubuntu Focal
The ironic-standalone-ipa-src job uses tinyipa, which should be
ready to be moved to use Ubuntu Focal.
This will allow us to move to build tinyipa with tinycore 11 in
ipa-builder.

Depends-On: https://review.opendev.org/749357

Change-Id: I3548ca1ecb16cdefd6e51e379d5d7458e13f9ec4
3 years ago
Riccardo Pittau 82c7043f1a Remove experimental jobs
They're not really useful anymore.

Change-Id: I89acdaa38a5c02a1d87e65e4d4e8d0fb5281772f
3 years ago
Riccardo Pittau 2a5ba7ef68 Increase memory for tinyipa jobs
Tinyipa is not that tiny anymore and we need to increase the base
memory for VMs in jobs that use it.

Depends-On: https://review.opendev.org/747397

Change-Id: I7e2d93ef566f4f2beb54caf445c7810a01aec1de
3 years ago
Zuul c4a78862d3 Merge "Revert "Switch the inspector job to tinyIPA until DIB is fixed"" 3 years ago
Dmitry Tantsur 15807819a8 Revert "Switch the inspector job to tinyIPA until DIB is fixed"
This reverts commit a08029a44e.

Change-Id: I4e2ab36792c47997e4f604abe806a0cc4338398e
3 years ago
Dmitry Tantsur 7fb098aa0b Import example hardware managers from ipa-example-hardware-managers
They're not easily discoverable there, let's keep them in tree.

The examples have been restructured to have two different projects
ready to be copied and adjusted. PEP8 failures have been fixed.

Change-Id: I2af04f4b7f9a2109fe83ec517e716159331a48bb
Co-Authored-By: Jay Faulkner <jay@jvf.cc>
3 years ago
Riccardo Pittau 52cc87e788 Revert jobs to dib
We need to be sure that the issue with the EPEL repo is fixed
before reverting to dib.

Change-Id: Ib0a80a35dcfc9d51009cc1a6816b191c6926cfdb
3 years ago
Iury Gregory Melo Ferreira 6bde89e4dd Update jobs
- Increase the number of VM's since we are running two tests.
- Do no run ipa-tempest-wholedisk-* (the partition jobs are covering
this since tempest runs wholedisk and partition tests)
- Remove `partition` from the job names

Change-Id: Ic82fc9dc7b658dab52c06b3619a0118acd111bc5
3 years ago
Dmitry Tantsur a08029a44e Switch the inspector job to tinyIPA until DIB is fixed
Change-Id: Ibe4d212d83bc27163af1fa9aa82881ade2d647db
3 years ago
Riccardo Pittau 437a8c61d1 Convert jobs to dib
This patch converts the main jobs to dib images.
The discrepancy in the names is due to the fact that some other
projects, like diskimage-builder and ironic-python-agent-builder,
use those jobs, so we leave them for the time being.
The same thing happen for the tinyipa jobs, we create some ad-hoc
jobs until we convert the jobs in the other projects.

Depends-On: https://review.opendev.org/718607

Change-Id: If12a6152015ad00145002f0e5cc2bb948ea6457a
3 years ago
Dmitry Tantsur 67dd91dbea CI: raise DIB jobs memory to 3 GiB
The only reason the current 2 GiB nodes work is because DIB started
removing linux-firmware from its images. Unfortunately, we need this
package on bare metal, and readding it brings to 3 GiB consump

Change-Id: Ic0f2274b29abe7470b835cfc305898643204e1f6
3 years ago
Iury Gregory Melo Ferreira 38215d3c04 Change default ram for tinyipa jobs
Change-Id: I6c4b9e9f9c06548408db124f204dcaaed78570a0
3 years ago
Iury Gregory Melo Ferreira b909277b15 Change ipa partition jobs to netboot
We are changing the default boot in ironic to local,
to avoid breaking the CI let's set the partition
jobs to netboot.

Change-Id: I4e3ad1881ea2068dd845706b7c977e10a6bb5da3
3 years ago
Riccardo Pittau 476931d719 Explicitly set ramdisk type
The ironic-ipa-base job is based on ironic-base job which
will default to dib.
To prevent breaking the ironic-ipa CI we set the ramdisk
type to tinyipa for now and we'll convert the jobs here later.

Change-Id: I00a7b88289c9a0a65aabc8b1e32b63f0f787a65f
3 years ago
Dmitry Tantsur 2017c27d32 Start installing DIB from Zuul-cloned sources in the CI
We need to be able to pick up fixes quicker than now and to use
depends-on with DIB changes. This change achieves it.

Change-Id: I70f2e13f799cc496878afd2d1416b50386dd0123
3 years ago
Dmitry Tantsur 584d209364 Lower RAM for DIB jobs to 2 GiB
The CentOS 8 images we use now are much smaller than the previously
used CentOS 7 images, so hopefully we can require less RAM.

Change-Id: I876cd4af8fe9a0516c0802f3894a964000d0ae2b
3 years ago
Dmitry Tantsur 84f7a2dce0 CI: add a non-voting partition-iscsi DIB job
Change-Id: I1569c58006b9f411b54d32a92651812253a8c164
3 years ago
Iury Gregory Melo Ferreira 68fb8006e0 Switch jobs to py3
- removed `USE_PYTHON3` from ironic-ipa-base since ironic-base
already has this configuration

- Enabled python3 for ipa-tempest-wholedisk-bios-ipmi-direct-tinyipa-src
and ipa-tempest-partition-bios-ipmi-direct-tinyipa-src

- Renamed ipa-tempest-dsvm-partition-ipmi-iscsi-tinyipa-python3 to
ipa-tempest-dsvm-partition-ipmi-iscsi-tinyipa

Change-Id: Ib955e93c19182dd6f16e00c8e8e92523d7b2e22b
4 years ago
Dmitry Tantsur 924528f7de Try increasing memory in the DIB job
We seem to be running out of it now (after CentOS 7.7?).

Also remove the unneccesary USE_PYTHON3: False.

Change-Id: Ibbc5538473b17c58d84f1cb764edec0c6747b263
4 years ago
Zuul 381d7ba349 Merge "Switch to image building jobs from ironic-python-agent-builder" 4 years ago
nishagbkar 5b19cee48e Adds CI job that uses DIB build images
Change-Id: I333627a8fb9e5a5d4e53f19e8b2e15d80938d90a
Task: 36272
Story: 2005114
4 years ago
Dmitry Tantsur e73786af90 Switch to image building jobs from ironic-python-agent-builder
Depends-On: https://review.opendev.org/678884
Change-Id: I50a9f9dc15f3a782aaf4b8c4096a418136f4ebd4
4 years ago
Dmitry Tantsur e446a5e6c4 Remove support for CoreOS images
Change-Id: Id9737067c678d4d01b20eae0b4a681c6cf9171a8
4 years ago
Zuul 5271064c76 Merge "Run a standalone job in the gate" 4 years ago
Dmitry Tantsur 236c800609 Run a standalone job in the gate
Now that this job has software RAID coverage, we should use it
to avoid regressions in this code.

Change-Id: I7452fb783f72dec589a074e4e46d246dc4ba6aa0
4 years ago
Dmitry Tantsur 0f07bfcac6 Fix the post job for tinyipa/coreos
The image_distro variable has to be initialized even when not actually
used, because run.yaml is one big bash script.

Change-Id: Id73931b29feaa73550d3cb4924f63e303a2fa145
4 years ago
Dmitry Tantsur 9226263ccb Correct building DIB images in the CI
* Install bindep from diskimage-builder in the DIB image job
* Switch to using ironic-python-agent-builder script
* Include distribution and branch name into target file names
* Place resulting files into correct directories
* Switch the distribution to centos7 since ubuntu seems to require
  additional configuration
* Add dhcp-all-interfaces, otherwise the image won't DHCP

Change-Id: I3f95323fa59bde4d4be6ff356e5e9f20b7cd453c
4 years ago
nishagbkar 0f1fc91e29 Installs diskimage-builder to pass the DIB image building test
Installs diskimage-builder to pass the
ironic-python-agent-buildimage-dib test for jobs using
DIB image building

Change-Id: I7be1ec3d70c59bb6bede1099e3d76fc007d8a02e
Task: 36271
Story: 2005114
4 years ago
Nisha Brahmankar f5e6ac5095 Implements OpenStack CI job having DIB-built IPA
Implements DIB-built IPA. Also adds a corresponding zuul test.

Change-Id: Iabfde30f35af172610777f55d986d1ec2debb415
Task: #29752
Story: #2005114
4 years ago