131 Commits

Author SHA1 Message Date
Iury Gregory Melo Ferreira
b869b46c63 Drop python 2.7 support and testing
OpenStack is dropping the py2.7 support in ussuri cycle.

Ironic is ready with python 3 and ok to drop the
python 2.7 support.

Complete discussion & schedule can be found in
- http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010142.html
- https://etherpad.openstack.org/p/drop-python2-support

Ussuri Communtiy-wide goal - https://review.opendev.org/#/c/691178/

Change-Id: I3cc36d79ffabf31607d503dada9e7512c639647c
2019-11-22 14:06:45 +01:00
Zuul
630c85126b Merge "Change integration jobs to run under Python3" 2019-10-26 08:07:42 +00:00
Zuul
d471beed61 Merge "CI: add ironic-python-agent-builder to the multinode job" 2019-10-24 14:06:18 +00:00
Iury Gregory Melo Ferreira
bba990c7e0 Change integration jobs to run under Python3
This patch enables python3 by default in the `ironic-base` job.
All jobs that have `ironic-base` as `parent` will be running under
python3 by default.

- Switch parent/child for `ironic-tempest-functional-python2` and
`ironic-tempest-functional-python3`

- Renamed `ironic-tempest-ipa-partition-pxe_ipmitool-tinyipa-python3`
to `ironic-tempest-ipa-partition-pxe_ipmitool-tinyipa` since it was
running under python3 that it's the default now

Depends-On: https://review.opendev.org/690537
Change-Id: Ibc503baa572c2746e1e703653ddf040bad5e8363
2019-10-24 10:20:52 +02:00
Zuul
06bf5df3be Merge "CI: limit rescue testing to only two jobs" 2019-10-23 17:06:02 +00:00
Dmitry Tantsur
a38b1c8340 CI: add ironic-python-agent-builder to the multinode job
It is not unconditionally required by the devstack plugin.

Change-Id: I1d60323829e6bbc8e835314b2eef8daa7f353631
2019-10-23 18:19:15 +02:00
Dmitry Tantsur
a2472c1518 CI: limit rescue testing to only two jobs
This feature is time-consuming and prone to race conditions. This
changes switches it off by default, leaving it on in two jobs:
the one running on Nova and the standalone one.

Change-Id: I7c50cb12065da05dad4ece0918883748ee4617e0
2019-10-22 17:20:51 +02:00
Iury Gregory Melo Ferreira
3db445ab5d Switch to ussuri job
Change-Id: I49082656880dbfcdb54ad0d2808e57eaa4070a56
2019-10-21 11:55:52 +02:00
Zuul
270efc1443 Merge "Change MTU logic to allow for lower MTUs automatically" 2019-10-18 02:35:07 +00:00
Julia Kreger
cf074202e5 Change MTU logic to allow for lower MTUs automatically
Change-Id: I40d357e716b589585493824cfd963fd5f579bd81
2019-10-11 10:07:50 -07:00
Iury Gregory Melo Ferreira
8cc6dbdd89 ironic-tempest-functional-python3 unused variables
The difference between the jobs `ironic-tempest-functional-python2`
and `ironic-tempest-functional-python3` should be only the python
version in use (for deployment and to run the functional tests).

Removing the variables `IRONIC_TEMPEST_WHOLE_DISK_IMAGE` and
`IRONIC_VM_EPHEMERAL_DISK`doesn't matter for the functional tests,
and they are set with different values in the python2 job.

Change-Id: I49ff241793f42de0f0cc9d98ae1f99940e581dcb
2019-10-09 11:00:01 +02:00
Dmitry Tantsur
78e763c61b Add a CI job with a DIB-built ramdisk
Also updates the devstack plugin to support pre-built DIB images
and removes the explicit mention of dhcp-all-interfaces element,
which is already a dependency of ironic-python-agent-ramdisk.

Change-Id: I564016528e80c738d6004c47f8df502a7748b311
2019-09-30 20:14:19 +02:00
Zuul
4b56fe29bd Merge "Make multinode jobs non-voting" 2019-09-21 04:19:11 +00:00
Zuul
5342ca17c0 Merge "Lower MTU override" 2019-09-20 23:21:11 +00:00
Julia Kreger
26c4a00c74 Make multinode jobs non-voting
As Dmitry suggested, we should likely just make this
a standard practice as end of cycle gate instability
makes multinode jobs blocking in nature.

We will revert this patch once things are happier,
hopefully sooner rather than later.

Change-Id: I17b853aabd1a2cddf64d73b3778d315092d5612a
2019-09-20 07:45:21 -07:00
Julia Kreger
1745eea83e Lower MTU override
For some unknown reason, new networks being created in the
fortnebula test VMs are defaulting to a MTU size of 1350 bytes.

This is based upon the physnet MTU, which does appear to be
lower on the fortnebula cloud.

Change-Id: I113973ba2a0a33c68f485d02af1ce8e12a6fbba4
Story: 2006589
Task: 36716
2019-09-19 17:24:09 -07:00
Dmitry Tantsur
625c71d48d CI: move libvirt images to /opt for standalone and multinode jobs
Moves the volume pool from / to /opt for the standalone and multinode
jobs, since on smaller nodes /opt is mounted from a larger ephemeral disk.

Change-Id: Idb4e235fd40ecd9829c3ad8a9dd1224f1c29a12e
2019-09-16 18:57:22 +02:00
Zuul
5df2ecbdf5 Merge "CI: move the fast-track job to the experimental pipeline" 2019-09-14 20:57:01 +00:00
Dmitry Tantsur
cfc0f5dac9 Combined gate fixes
We seem to be running out of disk space in standalone and mutlinode
jobs. Since we're creating a lot of virtual disks here, reduce each
to 4 GiB. No jobs need so much anyway. Reducing further will likely
hit issues with IPA assumptions of root devices.

Then correct setting OS_TEST_TIMEOUT in the multinode job. DevStack
variables do not affect tox runs, we need to use a new tempest
role variable instead.

Change-Id: Iceebf246b000cf77cbbf62e4edb9b06ee9dd7b71
2019-09-11 11:39:52 +02:00
Dmitry Tantsur
b3595b3f07 CI: move the fast-track job to the experimental pipeline
The job cannot pass right now, so it just wastes CI resources.

Change-Id: Ie5a8144735ac18a5a36f77e4fad6af05f7a7e02d
2019-09-10 10:02:39 +02:00
Zuul
f1329c1049 Merge "Add fast-track testing" 2019-09-03 18:18:10 +00:00
Julia Kreger
aa5db417d2 Lower standalone concurrency to 3 from 4
The standalone job seems to be the most problematic CI job
in ironic's CI jobs at this point in time. While we've moved
to unsafe disk caching for the test VMs, there are times when
the devstack instance is still being crushed with IO wait for
multiple seconds.

This could be from processes in the VM or just a noisy neighbor
but first lets try to lower the concurrency to hopefully make
the job more reliable.

Change-Id: I4dfeb3407cfe4064a5d93a4ed3657677fa5237ef
2019-08-20 08:01:41 -04:00
Zuul
95a140a54c Merge "Enable testing software RAID in the standalone job" 2019-08-14 17:14:15 +00:00
Dmitry Tantsur
27f7143eb9 Switch non-multinode jobs to new-style neutron services
Change-Id: I62f462986f0f3976cdd8ac72f0e86afea07760cd
2019-08-13 11:16:55 +02:00
Dmitry Tantsur
2f7de3264c Enable testing software RAID in the standalone job
Change-Id: Id5cc1854492df230e6657bc8450c49a52f21ac16
Depends-On: https://review.opendev.org/#/c/675064/
2019-08-07 14:11:04 +02:00
Dmitry Tantsur
3dfce5f2de CI: stop using pyghmi from git master
It's just a library we consume, there is no reason to use its
git head. Currently 1.4.0 is breaking us.

Story: #2006301
Task: #36014
Change-Id: Ib1b1e32bc60d7ec271098dcd17086f79518c09df
2019-07-29 17:52:49 +02:00
Zuul
1ac2caa339 Merge "Adds bandit template and exclude some of tests" 2019-06-29 12:54:49 +00:00
Dmitry Tantsur
ac0900add2 CI: remove quotation marks from TEMPEST_PLUGINS variable
The has stopped working out of a sudden. We should move to tempest_plugins
zuul variable later on, but it is only available since Stein.

Change-Id: I2cc64580b089566e664d54ea2087878b9cce6666
2019-06-26 13:12:28 +02:00
Kaifeng Wang
bffb075d20 Adds bandit template and exclude some of tests
Adds bandit configuration template and exclude some of
tests that we don't want to fix for the moment.

Keeping job unvoted so that we can keep an eye on possible
issues while not breaking gate.

Change-Id: Ic577cad3b61421c04023ea887236992acb19f77c
Story: 2005791
Task: 33518
2019-06-20 15:08:43 +08:00
Zuul
adecc670f7 Merge "Incorporate bandit support in CI" 2019-06-19 05:45:10 +00:00
Nisha Brahmankar
df5ac6d5bc Updates ironic for using ironic-python-agent-builder
Change-Id: Ic7a515eeda59b6611049c39978fda3ccbb162a45
Task: 33746
Story: 2005114
2019-06-13 03:54:43 +05:30
Kaifeng Wang
caf925349a Incorporate bandit support in CI
Change-Id: I0ffe0c12e9e32f32d2b400b5756fc2148a2993a0
Story: 2005791
Task: 33518
2019-06-10 09:26:04 +08:00
Julia Kreger
55e8d3fde1 Add a pxe/uefi/grub2 CI job
Fixes the grub2 based devstack logic and adds a grub2 CI job
such that the ironic team can safely clean-up some of the PXE
code without fear of breaking the grub2 scenario.

Story: 2003936
Task: 27724
Change-Id: Ieb395bf35e2689741a243c11b56d08a237b200bc
2019-06-05 14:21:13 -07:00
Dmitry Tantsur
75d796e731 Make the multinode grenade job voting again
Change-Id: I483fd8efc642ecb780421a1181c771f6108ad8b4
Depends-On: https://review.opendev.org/#/c/661559/
2019-05-27 13:07:03 +02:00
ZhongShengping
befc4a61e6 Update Python 3 test runtimes for Train
This goal is to implement the process set out in the 2018-10-24 Python
Update Process TC resolution[1], for the Train cycle to ensure unit
testing is in place for all of the Tested Runtimes for Train[2].
In practice, this generally means adding unit tests for Python 3.7 and dropping
unit tests for Python 3.5. Using the Zuul template for Train will ensure that
all projects that support Python3 will be tested against the agreed runtime
versions, and make it easier to update them in future.

[1]https://governance.openstack.org/tc/resolutions/20181024-python-update-process.html
[2]https://governance.openstack.org/tc/reference/runtimes/train.html

Change-Id: I06e6c071b8bd369c8a66bade2490f65070fd0665
Depends-On: https://review.opendev.org/#/c/641878/
2019-05-09 17:42:47 +08:00
Julia Kreger
bda02c43fb Direct bridge to be setup
The multinode jobs are failing because the br-infra bridge
is not being setup. It is not being setup because somewhere
in the infra, the multi-node-bridge role is never established
as a requirement. Realistically, only ironic does this, but
we need to ensure it is present.

Change-Id: Ia1dcc68d7e75a931e01829ce23da36c978a70765
2019-04-23 16:47:24 +00:00
OpenDev Sysadmins
d0e6c6cb10 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:40:53 +00:00
Zuul
5fe272f4f8 Merge "Use the PUBLIC_BRIDGE for vxlan" 2019-04-12 15:03:05 +00:00
Julia Kreger
1d0accbbe1 Use the PUBLIC_BRIDGE for vxlan
The PUBLIC_BRIDGE parameter, for most multinode zuul jobs
defaults to br-infra in cases where native zuul configuration
is used.

However, this is not true for legacy jobs still using devstack-gate.

When jobs are invoked with devstack-gate, the bridge must be set
to match the devstack-gate scripting as zuul *does not* setup the
vxlan bridge for us. Devstack-gate does so.

Change-Id: I37bff3c4d930ada483690d0dea17cb9a64d51fd2
2019-04-10 07:10:49 -07:00
Julia Kreger
2bb05fef72 Temporarily mark grenade multinode as non-voting
Seems the bridg name has changed, and until we're
able to get it sorted, lets mark it non-voting such
that we're able to land other code... and actually
land any fixes since the changes ideally need to
merge to stable/stein first given grenade's
operating model.

Change-Id: Ibeb89003416b398c199d605744eadf408927de45
2019-04-09 12:54:34 -07:00
Zuul
eaf6d8d95d Merge "Replace openstack.org git:// URLs with https://" 2019-03-31 19:25:07 +00:00
Riccardo Pittau
6f22c00149 Workaround for uefi job with ubuntu bionic
In ubuntu bionic, the UEFI provided in the ovmf package version
0~20180205.c0d9813c-2, EFI v2.70 by EDK II, seems broken and
causes kernel panic.
To be able to boot using uefi, we download and install the old
working version 2.60 from the multiverse repository.

Story: 2004604
Task: 28500

Change-Id: I1a5b4a6544621316f71203282f7418d2001ad357
2019-03-26 15:08:39 +01:00
Ian Wienand
228dfe308a Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: Ie1be8a026e88eba235bce29fe0504e35e03afe8e
2019-03-24 20:33:50 +00:00
Zuul
f1bcaf7b80 Merge "Migrate ironic-grenade-dsvm-multinode-multitenant job to Ubuntu Bionic" 2019-03-23 01:31:15 +00:00
Zuul
971b1ed13e Merge "Add a non-voting metalsmith job for local boot coverage" 2019-03-21 14:14:21 +00:00
Julia Kreger
7eb0b72872 Add fast-track testing
Depends-On: https://review.openstack.org/#/c/637039/
Change-Id: I09d54417921168f9e7ccde2176c6916fbc7e2d16
2019-03-14 17:39:15 +00:00
Julia Kreger
3f734c8728 fast tracked deployment support
Provides a facility to minimize the power state changes of
a baremetal node to save critical time during deployment
operations.

Story: #2004965
Task: #29408
Depends-On: https://review.openstack.org/636778
Change-Id: I7ebbaddb33b38c87246c10165339ac4bac0ac6fc
2019-03-14 10:34:31 -07:00
ghanshyam
407724a22a Migrate ironic-grenade-dsvm-multinode-multitenant job to Ubuntu Bionic
We have migrated the zuulv3 job to Bionic during Dec/Jan month.
 - http://lists.openstack.org/pipermail/openstack-discuss/2018-December/000837.html
 - https://etherpad.openstack.org/p/devstack-bionic
But that effort does not move all gate job to Bionic as there are
large amount of jobs are still legacy jobs. All the legacy jobs still
use Xenial as nodeset.

As per the decided runtime for Stein, we need to test everything on openstack
CI/CD on Bionic - https://governance.openstack.org/tc/reference/runtimes/stein.html

Below patch move the legacy base jobs to bionic which will move the derived jobs
automatically to bionic. These jobs are modified with branch variant so that they will use
Bionic node from stein onwards and xenial for all other stable branches
until stable/rocky.
- https://review.openstack.org/#/c/639096

This commit remove the overridden nodeset in ironic-grenade-dsvm-multinode-multitenant
job so that it will start using the nodeset defined in parent job.

More Details: 
- https://etherpad.openstack.org/p/legacy-job-bionic
- http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003614.html

Depends-On: https://review.openstack.org/#/c/639096
Change-Id: If5876243d2d9b16f1c1ef37ef0ab5a660629f741
2019-03-13 00:58:02 +00:00
Dmitry Tantsur
2bf3d0a3a0 Add a non-voting metalsmith job for local boot coverage
Also provides coverage of standalone ironic and openstacksdk.

Change-Id: I9419ae769d38324b035c2f2c1c1ac3829e3bab0a
Story: #1531149
Task: #10406
2019-03-11 14:55:28 +01:00
Mark Goddard
cf2c0a0022 Add python3 unit test with drivers installed
Adds unit-with-driver-libs-python3 tox environment, and corresponding
ironic-with-driver-libs-python3 Zuul job.

The lack of this job was highlighted by
https://review.openstack.org/#/c/641972 which marks UcsSdk as supported
in python 2 only.

Change-Id: Ibc0f9a8fddd8f6b358efed1c4c93b95d4e01bc13
2019-03-11 11:22:49 +00:00