1845 Commits

Author SHA1 Message Date
Mark Goddard
775620733b CI: Fix IP address detection in baremetal compute test
The 'openstack server show <server> -f value -c addresses' command
previously had output like this:

    <network name>=<IP>

Now it shows a Python output like this:

    {'<network name>': ['IP']}

This broke the parsing of the command output when determining which IP
address to use to access a bare metal instance via SSH.

This change fixes the issue by querying the server's port in Neutron,
and using the fixed IP address.

Change-Id: I55b5f185fb7136d3c6fa565aa46598f21c94eb43
2021-03-23 12:03:20 +00:00
Zuul
ad0800c2cb Merge "Change docker_registry network_mode to host" 2021-03-19 22:48:21 +00:00
Michal Nasiadka
90a0ca3443 Change docker_registry network_mode to host
Change-Id: I404dd52701426a10c2e92727bd52b7fd7112abf6
2021-03-19 09:05:14 +00:00
Zuul
f09070a416 Merge "Remove patch from kolla-ansible dependencies" 2021-03-12 12:21:28 +00:00
Zuul
85046ede56 Merge "CI: Add Ubuntu seed job" 2021-03-10 16:07:51 +00:00
Zuul
06a5237eb1 Merge "CI: Use cached cirros image for seed vm job" 2021-03-10 15:19:29 +00:00
Zuul
ee7804a3ce Merge "Wait for overcloud manage and provide state transitions" 2021-03-10 15:19:13 +00:00
Zuul
8b4f24f6d2 Merge "Bump Ansible version range to 2.9 - 2.9" 2021-03-10 14:09:40 +00:00
Zuul
3d7f15faa9 Merge "CI: display VM console log on ping or SSH failure" 2021-03-10 14:08:25 +00:00
Zuul
a7c3a9d606 Merge "Add support for custom shm_size for seed container(s)" 2021-03-10 12:44:53 +00:00
Mark Goddard
39b3fe70c6 CI: Use cached cirros image for seed vm job
The nodepool images include CirrOS images.

Also update to newly released 0.5.2 image.

Change-Id: I95fc2c3873c8cd17edf928f613a06d2154196786
2021-03-10 12:02:35 +01:00
Zuul
d42e3229c9 Merge "Ubuntu: fix deployment image build" 2021-03-05 12:13:15 +00:00
Zuul
03f26092ba Merge "Ubuntu: document overcloud development environment" 2021-03-04 18:50:49 +00:00
Zuul
241f4dc921 Merge "Ubuntu: container image build" 2021-03-04 18:50:40 +00:00
Zuul
6014af96c0 Merge "CI: add Ubuntu seed VM job" 2021-03-04 18:45:49 +00:00
Zuul
f29dd59605 Merge "CI: Ubuntu host configure job" 2021-03-04 18:38:45 +00:00
Zuul
c60846507e Merge "Ubuntu: update Apt cache before package installation" 2021-03-04 18:21:59 +00:00
Mark Goddard
1d55a33094 Ubuntu: document overcloud development environment
Updates the contributor documentation for the overcloud development
environment to include steps for running on Ubuntu.

Change-Id: I1dbb5978342261e8c8e36fbe270f238750808ad6
Story: 2004960
Task: 41550
2021-03-04 15:02:09 +00:00
Zuul
0e3ec62471 Merge "CI: add Ubuntu overcloud deploy job" 2021-03-04 14:22:40 +00:00
Zuul
df9174090b Merge "Add ipa_build_upper_constraints_file variable" 2021-03-04 11:58:52 +00:00
Pierre Riteau
aafed5811d Fix documentation of control host bootstrap
Change-Id: Ie1d7753d9061b587caa5e150f72b51658a887318
2021-03-03 12:52:30 +01:00
Zuul
245b7b0fc2 Merge "Report available entropy" 2021-03-03 11:25:15 +00:00
Zuul
a4919e1877 Merge "Quote kolla limit when calling kolla-ansible" 2021-03-01 18:58:44 +00:00
Mark Goddard
0c309a18c8 Ubuntu: update Apt cache before package installation
Update Apt cache prior to all package installation tasks.

Adds apt_cache_valid_time, which defaults to 3600 seconds. This allows
the time for which the Apt cache is valid to be configured.

Change-Id: I0ecf4f4ce9b7333d3e41c69c3f908bee83391781
Story: 2004960
Task: 41766
2021-03-01 18:00:49 +00:00
Mark Goddard
e2a01b790f Ubuntu: container image build
* Use bash to execute kolla-build
* Remove backslashes from kolla-build command. YAML folded literal
  block avoids the need for this by replacing newlines with spaces
* Distribution-specific package list when installing kolla

Change-Id: Icad129aaafb17023f3c9d007fb63466b23b1395a
Story: 2004960
Task: 41764
2021-03-01 18:00:00 +00:00
Piotr Parczewski
534465797b CI: Add Ubuntu seed job
This commit adds Zuul job for deploying seed services against
Ubuntu 20.04 LTS (Focal Fossa).

Co-Authored-By: Mark Goddard <mark@stackhpc.com>

Story: 2004960
Task: 41807
Depends-On: https://review.opendev.org/c/openstack/kayobe/+/772929
Change-Id: I839cd1b9d63c9bbf3e0c75def76b8bff68637c75
2021-03-01 17:59:37 +00:00
Mark Goddard
7a99b88ebc CI: add Ubuntu seed VM job
* Need to specify bash for &> syntax

Story: 2004960
Task: 41806

Change-Id: Ic33d3e31096f7b0cec2e4e9284f5c1078a4ff04c
2021-03-01 17:59:31 +00:00
Mark Goddard
9c29d7d76c CI: Ubuntu host configure job
Issues:

* bond configuration not working on Ubuntu - disabled in CI test

Story: 2004960
Task: 41560

Change-Id: Ib124dc6f313a2a13fa509b10702c6141f102f2f9
2021-03-01 17:58:16 +00:00
Mark Goddard
9f41cefc15 CI: add Ubuntu overcloud deploy job
* Use source images
* Need to specify bash for &> syntax

Issues worked around:

* Manually configuring bridge via ip commands makes ifup fail to bring
  up the link. Adds a kayobe-network-bootstrap Zuul CI role that adds
  persistent configuration for the all-in-one network.

* bridge not active after interfaces role bounce. Added a pause, similar
  to https://github.com/michaelrigart/ansible-role-interfaces/pull/31

* fails installing docker python module for kolla user. WARNING: The
  repository located at mirror-int.ord.rax.opendev.org is not a trusted
  or secure host and is being ignored ERROR: No matching distribution
  found for docker===4.4.0 Adding trusted host for PyPI mirror.

* Tenks fails to create block devices - missing qemu-img (in qemu-utils)

* Tenks qemu emulator is different on Ubuntu

Remaining issues:

* Bare metal testing is unreliable on Ubuntu - some jobs see IPMI
  failures such as the following:

    ipmitool chassis bootdev pxe

    Error setting Chassis Boot Parameter 5\nError setting Chassis Boot
    Parameter 0\n

  Bare metal testing is disabled on Ubuntu for now.

Depends-On: https://review.opendev.org/766984
Depends-On: https://review.opendev.org/766958

Story: 2004960
Task: 29393

Change-Id: I1985efae7c18f55c3ff7c27c17d6242523904f3e
2021-03-01 17:57:51 +00:00
Zuul
a9bf637cc5 Merge "Ubuntu: support non-persistent veth configuration" 2021-03-01 17:44:04 +00:00
Zuul
7f02f629b8 Merge "Ubuntu: fix pip configuration for kolla user" 2021-03-01 17:43:57 +00:00
Zuul
8273788c8c Merge "Revert ironic custom configuration" 2021-03-01 15:22:12 +00:00
Mark Goddard
f9d9afcfba CI: Fix overcloud and seed VM jobs on vexxhost clouds
This partially reverts commit 47bbb96b29ab30764d6220cdd43e63a1d2072533
which triggered a retry on vexxhost clouds.

The issue was introduced in Ie8fd965165e8d347d27528a2c16d0647e412ccdc,
which applied some fixes for CentOS 8.3, and inadvertently removed
the Tenks variable that forces the use of qemu for 'bare metal' VMs.
This lead to autodetection of KVM, which does not work well when nested
in all CI cloud providers.

This change fixes the issue by forcing the use of qemu for the overcloud
once more. It also adds a similar option for the seed VM job.

Change-Id: I6bc8da2b8da903e09b97df8cd95c68a562c11db9
2021-02-26 11:11:18 +00:00
Pierre Riteau
5af7cac17e Revert ironic custom configuration
This is now merged into kayobe-config-dev [1].

[1] https://review.opendev.org/c/openstack/kayobe-config-dev/+/777076

Change-Id: I87b63966b55f04f80fd0255fbf2732d527732187
2021-02-26 09:56:18 +01:00
Piotr Parczewski
93f67ac478 Add support for custom shm_size for seed container(s)
It's now possible to change Docker's default 64M SHM size
for custom containers running on the seed.

Change-Id: Ic6c2ec38e8a22b8acc90e17a552e471aa8313f7d
2021-02-25 23:33:50 +01:00
Mark Goddard
47bbb96b29 CI: retry overcloud jobs that land on vexxhost clouds
Jobs that test baremetal deployment are currently failing when run on
Vexxhost infrastructure. The seed VM job also has trouble on Vexxhost,
although does sometimes pass. It's not clear why yet, and we are still
investigating. Until we have a solution, fail in the pre phase when we
land on vexxhost clouds, in order to trigger the zuul retry mechanism.

Also use the normal number (5) of attempts for upgrade jobs, since these
no longer deploy the previous release in the pre phase.

Finally, incorporate a fix from
https://review.opendev.org/c/openstack/kayobe-config-dev/+/777076 to
allow this to merge. This part can be reverted once the
kayobe-config-dev patch merges.

[1] http://lists.openstack.org/pipermail/openstack-discuss/2021-February/020685.html

Change-Id: Ie5ca04428855cbaf505adc57de76ea0b2d404080
2021-02-25 11:53:17 +00:00
Pierre Riteau
e23e47dd63 Report available entropy
Change-Id: I0c37ba259d96c351e03dba1c8343fce8a84eb53e
Depends-On: https://review.opendev.org/c/openstack/kayobe-config-dev/+/777076
2021-02-24 15:04:00 +01:00
Mark Goddard
25ae0be2f9 CI: display VM console log on ping or SSH failure
Also increase attempts to 12, in line with Kolla Ansible CI.

Change-Id: I81cabf27f44af3c8135efe8e427db1ffee5f0091
2021-02-24 11:54:49 +00:00
Pierre Riteau
303fd1d45c Ubuntu: fix deployment image build
The updated role fixes an issue with activation of the DIB virtualenv
and ensures the kpartx package is installed.

Change-Id: Idaedcc58e00d06caf4e5e360011d1c5c5c7dbe44
Story: 2004960
Task: 41710
2021-02-23 14:02:51 +01:00
Zuul
b19222e686 Merge "Update IPA docs and test build with extra-hardware" 2021-02-22 15:21:33 +00:00
Pierre Riteau
56c1a886f5 Add ipa_build_upper_constraints_file variable
This variable allows to customise the upper constraints file used to
install packages inside the ipa-build-dib virtual environment. This can
be used when we need a newer version of diskimage-builder than the one
available in upper constraints for the current release.

Change-Id: Idbe57e7edc3fae25153f5e24ad6b7847b1c4660c
2021-02-19 16:13:38 +01:00
Zuul
d14aa37cd3 Merge "Remove CentOS 7 image resolv.conf workaround" 2021-02-19 00:45:11 +00:00
Zuul
071ab36712 Merge "Test building seed deployment images in the seed job" 2021-02-17 10:45:01 +00:00
Zuul
7ba68f530f Merge "Make it clearer that hyphen replacement is not automatic" 2021-02-15 20:13:53 +00:00
Zuul
38409a7c1f Merge "Remove trailing whitespace" 2021-02-11 13:00:02 +00:00
Mark Goddard
bc415b7c7e Remove patch from kolla-ansible dependencies
This is a legacy from patching the kolla-ansible source code.

TrivialFix

Change-Id: Id5e130589f5f4a08d88fe340af0694f072c848b6
2021-02-11 12:04:16 +00:00
Mark Goddard
aaf9572d08 Wait for overcloud manage and provide state transitions
During the 'kayobe overcloud provision' command, wait for the
nodes to become manageable and available.

Adds two variables, 'wait_manageable_timeout' and
'wait_available_timeout', to control the wait timeout.

Change-Id: I7435bd06d58501e361312bacfa4e55394aba5b57
2021-02-11 12:03:24 +00:00
Zuul
b8ef36047c Merge "[docs] Improve contributor's automated setup document" 2021-02-11 11:17:43 +00:00
Zuul
e1e4f73673 Merge "Adapt to changes from the Bifrost Victoria release" 2021-02-11 10:17:34 +00:00
Pierre Riteau
d765fbc5eb Update IPA docs and test build with extra-hardware
Change-Id: Id5ed0b594d6270c4a03606caa776bbb291be2694
2021-02-11 10:50:43 +01:00