Commit Graph

52 Commits

Author SHA1 Message Date
Julia Kreger
ce296a43d6 Remove metalsmith centos7 job
Change-Id: I523382b5b06b479ba34dce5a1dc7262076122514
2021-11-10 11:30:03 -08:00
Dmitry Tantsur
764e29729d Stop testing the iscsi deploy interface
Remove the jobs that are now redundant.

Depends-On: https://review.opendev.org/c/openstack/diskimage-builder/+/788972
Depends-On: https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/788971
Change-Id: Ic0b7bc509652c23cec85e685d66de368fdc4761d
2021-04-30 17:16:59 +02:00
Dmitry Tantsur
afcc5d392c Fix incorrect lsblk tag and add a virtual media job
Follow-up to 8dd6589e66: PATH is not a
valid lsblk tag, we need to use KNAME with -p flag.

Also add a vmedia job to avoid breakages in the future. It's added
non-voting because we have a deadlock with this change:
https://review.opendev.org/c/openstack/ironic/+/783722

Change-Id: Ifffeac9c1c4d394526d655eaa14c9fe7bd3a1e5e
2021-03-30 12:25:14 +02:00
Riccardo Pittau
45371bfb9e Prepare to use tinycore 12
Tinycore 12 requires some more RAM than its predecessor.

Change-Id: I642ccdcef43361b5648a9652d041ebb6dfe6a0e9
2021-03-04 13:52:09 +01:00
Zuul
d84e88769e Merge "Don't run os-prober from grub2-mkconfig" 2020-11-01 12:27:07 +00:00
Riccardo Pittau
c3ab4a7ca7 Remove nodeset option
The ironic-ipa-base is based on ironic-base that is already running
on ubuntu focal, non need to specify nodeset for those jobs that
are based on it.

Change-Id: I7ffb920442d5e33ef5014152b72b9ac32e367047
2020-10-29 15:39:19 +01:00
Riccardo Pittau
1f15a10c6a Run dib ipa src jobs on ubuntu focal
Also disabling dstat in all focal based jobs because of
https://bugs.launchpad.net/ubuntu/+source/dstat/+bug/1866619
Plus including increase of alloc memory to increase job
success rate, original change from [1]
And re-enabling ipa-tempest-bios-ipmi-direct-src and
ipa-tempest-bios-ipmi-iscsi-src

[1] https://review.opendev.org/759765

Co-authored-by: Julia Kreger <juliaashleykreger@gmail.com>

Change-Id: Ia154745b71c17063eeaaabeb56950ab1cc9ce927
2020-10-27 21:31:05 +01:00
Julia Kreger
6542a9cb04 Don't run os-prober from grub2-mkconfig
By default, grub2-mkconfig scans everything to look for other
environments and then load those into the grub configuration.

It makes sense, but on newer versions of grub2 in distribution
images, os-prober is taking an exceptionally long time in some
cases where more than one storage device exists with other
filesystems.

As a result, of the os-prober execution by grub2-mkconfig, the
bootloader installation can completely time out and fail the
deployment. This is presently experienced with metalsmith on
centos8.

There are numerous sporatic reports of issues like this issue
where grub2-mkconfig hangs for some period of time, and this is
observable on Centos8.2 in our CI. While one report[0] mentions
this issue, Another bug [1] has the dialog that actually helps us
frame the context as to what we likely should do.

Also, fixes the unit testing so we actually test if we're running
with grub2. :\

[0]: https://bugzilla.redhat.com/show_bug.cgi?id=1744693
[1]: https://bugzilla.redhat.com/show_bug.cgi?id=1709682

Depends-On: https://review.opendev.org/#/c/748315
Change-Id: I14bf299afef3a1ddb2006fe5f182d7f0d249e734
2020-10-22 22:28:07 +00:00
Riccardo Pittau
5c99f60083 Use focal for tinyipa src jobs used by ipa-builder
We can use focal here but we need to disable dstat because of
https://bugs.launchpad.net/ubuntu/+source/dstat/+bug/1866619

Change-Id: I2c013e871fc56aa0077656dfc76de9aad6bed83f
2020-10-06 17:43:03 +02:00
Riccardo Pittau
13de98bd98 Use bionic nodeset for DIB centos src jobs
We'll keep using bionic as nodeset for certain jobs because of limitations
in DIB when building centos images.
DIB uses yum-tools to prepare the chroot environment, but the package is
not present in ubuntu focal because of lack of Python 2.x support.

Change-Id: I8635b7dfa6910c1721b89739d4d51fa7df488432
2020-10-06 15:16:28 +02:00
Zuul
6cb781b24e Merge "Remove unused jobs" 2020-09-23 22:32:42 +00:00
Julia Kreger
afb521d18e CI: Lower memory usage of VMs/Increase swap
The IPA images we presently build/use for centos are
now smaller than their peak size a few months ago.

As such, we should be able to reduce that memory footprint
and still execcute all of the necessary tests without any
issues.

Also increases the amount of swap to 8GB as the infra
default is now 1GB.

Change-Id: I5705f1f2504803a049ed88a0d8b1d6d0bbccf9e4
2020-09-22 06:09:07 -07:00
Zuul
f45d2cc0e7 Merge "Move ironic-standalone-ipa-src to Ubuntu Focal" 2020-09-14 12:52:42 +00:00
Riccardo Pittau
63513aeb6f Remove unused jobs
Also add some info on external projects that use current jobs.

Depends-On: https://review.opendev.org/749723

Change-Id: Ifeffebf2264993e1773a1e9867380523ec49a93f
2020-09-03 12:49:08 +00:00
Riccardo Pittau
85bd44d6ac Prepare to move ipa-builder jobs
Correctly rename jobs used by ipa-builder

Change-Id: Ia07b23518ea9c7500aaa21d88b72f94f48e97cb6
2020-09-03 14:32:29 +02:00
Riccardo Pittau
700c14c73c Move ironic-standalone-ipa-src to Ubuntu Focal
The ironic-standalone-ipa-src job uses tinyipa, which should be
ready to be moved to use Ubuntu Focal.
This will allow us to move to build tinyipa with tinycore 11 in
ipa-builder.

Depends-On: https://review.opendev.org/749357

Change-Id: I3548ca1ecb16cdefd6e51e379d5d7458e13f9ec4
2020-09-02 16:06:22 +00:00
Riccardo Pittau
82c7043f1a Remove experimental jobs
They're not really useful anymore.

Change-Id: I89acdaa38a5c02a1d87e65e4d4e8d0fb5281772f
2020-08-22 11:39:11 +00:00
Riccardo Pittau
2a5ba7ef68 Increase memory for tinyipa jobs
Tinyipa is not that tiny anymore and we need to increase the base
memory for VMs in jobs that use it.

Depends-On: https://review.opendev.org/747397

Change-Id: I7e2d93ef566f4f2beb54caf445c7810a01aec1de
2020-08-21 18:34:25 +00:00
Zuul
c4a78862d3 Merge "Revert "Switch the inspector job to tinyIPA until DIB is fixed"" 2020-08-12 11:11:36 +00:00
Dmitry Tantsur
15807819a8 Revert "Switch the inspector job to tinyIPA until DIB is fixed"
This reverts commit a08029a44e.

Change-Id: I4e2ab36792c47997e4f604abe806a0cc4338398e
2020-08-07 11:29:59 +00:00
Dmitry Tantsur
7fb098aa0b Import example hardware managers from ipa-example-hardware-managers
They're not easily discoverable there, let's keep them in tree.

The examples have been restructured to have two different projects
ready to be copied and adjusted. PEP8 failures have been fixed.

Change-Id: I2af04f4b7f9a2109fe83ec517e716159331a48bb
Co-Authored-By: Jay Faulkner <jay@jvf.cc>
2020-07-31 13:35:34 +02:00
Riccardo Pittau
52cc87e788 Revert jobs to dib
We need to be sure that the issue with the EPEL repo is fixed
before reverting to dib.

Change-Id: Ib0a80a35dcfc9d51009cc1a6816b191c6926cfdb
2020-07-25 21:46:32 +02:00
Iury Gregory Melo Ferreira
6bde89e4dd Update jobs
- Increase the number of VM's since we are running two tests.
- Do no run ipa-tempest-wholedisk-* (the partition jobs are covering
this since tempest runs wholedisk and partition tests)
- Remove `partition` from the job names

Change-Id: Ic82fc9dc7b658dab52c06b3619a0118acd111bc5
2020-07-10 20:16:19 +02:00
Dmitry Tantsur
a08029a44e Switch the inspector job to tinyIPA until DIB is fixed
Change-Id: Ibe4d212d83bc27163af1fa9aa82881ade2d647db
2020-07-03 10:31:59 +02:00
Riccardo Pittau
437a8c61d1 Convert jobs to dib
This patch converts the main jobs to dib images.
The discrepancy in the names is due to the fact that some other
projects, like diskimage-builder and ironic-python-agent-builder,
use those jobs, so we leave them for the time being.
The same thing happen for the tinyipa jobs, we create some ad-hoc
jobs until we convert the jobs in the other projects.

Depends-On: https://review.opendev.org/718607

Change-Id: If12a6152015ad00145002f0e5cc2bb948ea6457a
2020-05-15 10:46:39 +02:00
Dmitry Tantsur
67dd91dbea CI: raise DIB jobs memory to 3 GiB
The only reason the current 2 GiB nodes work is because DIB started
removing linux-firmware from its images. Unfortunately, we need this
package on bare metal, and readding it brings to 3 GiB consump

Change-Id: Ic0f2274b29abe7470b835cfc305898643204e1f6
2020-05-12 14:07:33 +02:00
Iury Gregory Melo Ferreira
38215d3c04 Change default ram for tinyipa jobs
Change-Id: I6c4b9e9f9c06548408db124f204dcaaed78570a0
2020-04-09 10:08:21 +02:00
Iury Gregory Melo Ferreira
b909277b15 Change ipa partition jobs to netboot
We are changing the default boot in ironic to local,
to avoid breaking the CI let's set the partition
jobs to netboot.

Change-Id: I4e3ad1881ea2068dd845706b7c977e10a6bb5da3
2020-04-02 09:54:15 +02:00
Riccardo Pittau
476931d719 Explicitly set ramdisk type
The ironic-ipa-base job is based on ironic-base job which
will default to dib.
To prevent breaking the ironic-ipa CI we set the ramdisk
type to tinyipa for now and we'll convert the jobs here later.

Change-Id: I00a7b88289c9a0a65aabc8b1e32b63f0f787a65f
2020-03-23 11:57:11 +01:00
Dmitry Tantsur
2017c27d32 Start installing DIB from Zuul-cloned sources in the CI
We need to be able to pick up fixes quicker than now and to use
depends-on with DIB changes. This change achieves it.

Change-Id: I70f2e13f799cc496878afd2d1416b50386dd0123
2020-01-21 12:05:12 +01:00
Dmitry Tantsur
584d209364 Lower RAM for DIB jobs to 2 GiB
The CentOS 8 images we use now are much smaller than the previously
used CentOS 7 images, so hopefully we can require less RAM.

Change-Id: I876cd4af8fe9a0516c0802f3894a964000d0ae2b
2020-01-11 15:07:59 +01:00
Dmitry Tantsur
84f7a2dce0 CI: add a non-voting partition-iscsi DIB job
Change-Id: I1569c58006b9f411b54d32a92651812253a8c164
2020-01-10 17:17:07 +01:00
Iury Gregory Melo Ferreira
68fb8006e0 Switch jobs to py3
- removed `USE_PYTHON3` from ironic-ipa-base since ironic-base
already has this configuration

- Enabled python3 for ipa-tempest-wholedisk-bios-ipmi-direct-tinyipa-src
and ipa-tempest-partition-bios-ipmi-direct-tinyipa-src

- Renamed ipa-tempest-dsvm-partition-ipmi-iscsi-tinyipa-python3 to
ipa-tempest-dsvm-partition-ipmi-iscsi-tinyipa

Change-Id: Ib955e93c19182dd6f16e00c8e8e92523d7b2e22b
2019-10-30 14:37:17 +01:00
Dmitry Tantsur
924528f7de Try increasing memory in the DIB job
We seem to be running out of it now (after CentOS 7.7?).

Also remove the unneccesary USE_PYTHON3: False.

Change-Id: Ibbc5538473b17c58d84f1cb764edec0c6747b263
2019-09-19 09:48:59 +02:00
Zuul
381d7ba349 Merge "Switch to image building jobs from ironic-python-agent-builder" 2019-09-17 21:19:32 +00:00
nishagbkar
5b19cee48e Adds CI job that uses DIB build images
Change-Id: I333627a8fb9e5a5d4e53f19e8b2e15d80938d90a
Task: 36272
Story: 2005114
2019-09-10 10:17:41 +02:00
Dmitry Tantsur
e73786af90 Switch to image building jobs from ironic-python-agent-builder
Depends-On: https://review.opendev.org/678884
Change-Id: I50a9f9dc15f3a782aaf4b8c4096a418136f4ebd4
2019-08-28 19:47:22 +02:00
Dmitry Tantsur
e446a5e6c4 Remove support for CoreOS images
Change-Id: Id9737067c678d4d01b20eae0b4a681c6cf9171a8
2019-08-28 19:46:37 +02:00
Zuul
5271064c76 Merge "Run a standalone job in the gate" 2019-08-28 08:59:52 +00:00
Dmitry Tantsur
236c800609 Run a standalone job in the gate
Now that this job has software RAID coverage, we should use it
to avoid regressions in this code.

Change-Id: I7452fb783f72dec589a074e4e46d246dc4ba6aa0
2019-08-27 14:53:05 +02:00
Dmitry Tantsur
0f07bfcac6 Fix the post job for tinyipa/coreos
The image_distro variable has to be initialized even when not actually
used, because run.yaml is one big bash script.

Change-Id: Id73931b29feaa73550d3cb4924f63e303a2fa145
2019-08-27 14:13:44 +02:00
Dmitry Tantsur
9226263ccb Correct building DIB images in the CI
* Install bindep from diskimage-builder in the DIB image job
* Switch to using ironic-python-agent-builder script
* Include distribution and branch name into target file names
* Place resulting files into correct directories
* Switch the distribution to centos7 since ubuntu seems to require
  additional configuration
* Add dhcp-all-interfaces, otherwise the image won't DHCP

Change-Id: I3f95323fa59bde4d4be6ff356e5e9f20b7cd453c
2019-08-23 10:20:02 +02:00
nishagbkar
0f1fc91e29 Installs diskimage-builder to pass the DIB image building test
Installs diskimage-builder to pass the
ironic-python-agent-buildimage-dib test for jobs using
DIB image building

Change-Id: I7be1ec3d70c59bb6bede1099e3d76fc007d8a02e
Task: 36271
Story: 2005114
2019-08-13 17:10:46 +05:30
Nisha Brahmankar
f5e6ac5095 Implements OpenStack CI job having DIB-built IPA
Implements DIB-built IPA. Also adds a corresponding zuul test.

Change-Id: Iabfde30f35af172610777f55d986d1ec2debb415
Task: #29752
Story: #2005114
2019-08-08 00:04:28 +05:30
Dmitry Tantsur
248a4ccda5 Repair building tinyipa images after the move to ipa-builder
Change-Id: Ie74e75a67ddb7012f41e8f6076a70610b5e1aa6e
2019-08-01 15:15:50 +02:00
Kaifeng Wang
6f634c358b Adds bandit template and exclude some of tests
Adds bandit configuration template and exclude some of
tests that we don't want to fix for the moment.

Keeping job unvoted so that we can keep an eye on possible
issues while not breaking gate.

Change-Id: I092d686ba38723d7951e8f06415f28cc809ad365
Story: 2005791
Task: 33563
2019-06-20 14:39:36 +08:00
Nisha Brahmankar
dd7e7fdd1a Removes tinyipa from IPA
Change-Id: I56f7c9abdae1f406de1e086fdc0cac8bebca0e3c
Task: 33745
Story: 2005114
2019-06-13 11:01:48 +05:30
Dmitry Tantsur
6579471d5b Add a non-voting metalsmith job
Currently we don't have any coverage for local boot with partition
images, this job provides it.

Change-Id: Iad81ee2bd091287372c6842b50eaa0623e1326d5
2019-06-07 14:44:08 +02:00
Kaifeng Wang
3352d40907 Incorporate bandit support in CI
Change-Id: I2144c284ffcfa696412fca30f59a66c54c3d1965
Story: 2005791
Task: 33564
2019-06-05 08:49:58 +08:00
OpenDev Sysadmins
ba7d273986 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:48:56 +00:00