2516 Commits

Author SHA1 Message Date
Zuul
3fde908247 Merge "Fix an issue when 'acl' package can be forgotten" 2023-04-19 16:29:47 +00:00
Zuul
0f2262266a Merge "Fix maximum width of the DIB Multiline-YAML" 2023-04-19 16:29:44 +00:00
Zuul
cb50b0cbc0 Merge "Stop using kolla-ansible bootstrap-servers" 2023-04-18 15:49:59 +00:00
Matt Crees
bdaeed184b Build Ubuntu images with IPA when on Ubuntu
Change ``ipa_build_dib_elements_default`` and
``ipa_build_dib_env_default`` to use ``os_distribution`` and
``os_release`` by default. This allows for Ubuntu images to be built
when running on Ubuntu.

Rocky will still build CentOS images, as Rocky IPA images have not been
tested yet.

Change-Id: Iefd2d0b7a3a3e07f5c112d58e2ec0b3da0a747d3
2023-04-17 12:20:58 +02:00
Zuul
51a9019c6b Merge "Fix merge action plugins verbose output" 2023-04-14 07:28:04 +00:00
Zuul
107ee93544 Merge "Fix passwords.yml generation when parent directory doesn't exist" 2023-04-14 07:27:57 +00:00
Zuul
8dd280e80c Merge "Fix kayobe_config_path description in globals.yml" 2023-04-13 20:53:55 +00:00
Mark Goddard
5287083116 Fix passwords.yml generation when parent directory doesn't exist
Fixes an issue where generation of passwords.yml for Kolla Ansible
could fail if the directory containing the file does not exist. This is
typical in a multiple environment setup, when creating a new
environment.

Story: 2010293
Task: 46275
Closes-Bug: #2015093
Change-Id: I9dce73a8a205c0c0ad02eba3a10e02b82f5b191d
2023-04-13 16:41:27 +00:00
Maksim Malchuk
5cf750c313 Fix maximum width of the DIB Multiline-YAML
The dib_env_vars variable in the Bifrost's dib.yml file can contain
the DIB_BLOCK_DEVICE_CONFIG environment variable which is always the
Multiline-YAML data. By default, the format of the data is not
preserved while the configuration is merged and saved for the
bifrost-deploy container.

This is because Ansible uses the PyYAML library which has a default
80 symbol string length limit. The official Ansible documentation [1]
recommends using to_yaml or to_nice_yaml filters with width parameter.
This change adds the same ability to the merge_yaml Ansible plugin.

1. https://docs.ansible.com/ansible/latest/user_guide/playbooks_filters.html#formatting-data-yaml-and-json

The related change for the diskimage-builder to solve the issue with
incorrect data provided by Kolla-Ansible is also provided:
I3b74ede69eb064ad813a9108ec68a228e549e8bb

The related change for Kolla-Ansible is also provided:
Id79445c0311916ac6c1beb3986e14f652ee5a63c

Closes-Bug: #2014981
Related-Bug: #2014980
Change-Id: I339042d9ce405f59aba936dd98df7d89a88bb41e
Signed-off-by: Maksim Malchuk <maksim.malchuk@gmail.com>
2023-04-13 13:59:15 +03:00
Zuul
e6432ce671 Merge "CI: Add custom routing table output to logs." 2023-04-03 17:19:12 +00:00
Maksim Malchuk
2ab498f955 Fix kayobe_config_path description in globals.yml
This change fixes the description accidently copied from the
'kayobe_env_config_path' description.

TrivialFix

Change-Id: I7b9ced54ad886b3f92f7c757adc2efafa4cbfa4e
Signed-off-by: Maksim Malchuk <maksim.malchuk@gmail.com>
2023-04-02 01:36:59 +03:00
Maksim Malchuk
46000d4e05 Fix merge action plugins verbose output
This change fixes the output 'module_args' information of the plugins
'merge_configs' and 'merge_yaml' when Ansible is executed in maximum
verbose mode. Now all the plugin options are displayed instead of
standard 'copy' plugin options only.

Change-Id: Ie2d9a0501fe29bfd854eb31258f282b197855948
Signed-off-by: Maksim Malchuk <maksim.malchuk@gmail.com>
2023-04-02 00:39:02 +03:00
Bartosz Bezak
84fcc6ad0b CI: Add custom routing table output to logs.
Change-Id: Id86acf22cc548b37222a78300c1d5063f4527bf2
2023-03-31 12:08:49 +02:00
Mark Goddard
c9f8d80ba6 Stop using kolla-ansible bootstrap-servers
The 'kayobe * host configure' commands no longer use the 'kolla-ansible
bootstrap-servers' command, and associated 'baremetal' role in Kolla
Ansible. The functionality provided by the 'baremetal' role has been
extracted into the openstack.kolla Ansible collection, and split
into separate roles. This allows Kayobe to use it directly, and only the
necessary parts.

This change improves failure handling in these Kayobe commands, and aims
to reduce confusion over which '--limit' and '--tags' arguments to
provide.  This ensures that if a host fails during a host configuration
command, other hosts are able to continue to completion. Previously, if
any host failed during the Kayobe playbooks, the 'kolla-ansible
bootstrap-servers' command would not run. This is useful at scale, where
host failures occur more frequently.

This change has implications for configuration of Kayobe, since some
variables that were previously in Kolla Ansible are now in Kayobe.

Several parts of the baremetal role have been split out and used here:

* apparmor-libvirt: disable AppArmor rules for libvirt on Ubuntu.
* docker: Docker installation & configuration. The docker role in
  openstack.kolla combines functionality from kolla-ansible and kayobe.
* etc-hosts: it proved difficult to generalise this, so we have some
  almost duplicated the code from kolla-ansible here. Requires delegated
  fact gathering for the case when --limit is used.
* firewall: support to disable UFW, for feature parity.
* kolla-packages: miscellaneous package installs & removals.

The addition of the stack user to the docker group has been moved to the
user bootstrapping playbook, and the docker SDK installation has been
moved to the virtualenv setup playbook.

Depends-On: https://review.opendev.org/c/openstack/ansible-collection-kolla/+/829587

Story: 2009854
Task: 44505

Change-Id: I61a61ca59652b13687c2247d5881012b51f666a7
2023-03-30 13:52:54 +00:00
Bartosz Bezak
e5815017b5 Move to Launchpad for project management
Change-Id: I777579bb92041a0e9f7975e5820bda53deabe930
2023-03-28 16:51:49 +02:00
Michal Nasiadka
137e64b57c Fix opensearch container builds
Change-Id: I90dc4da947173e9f8b90d3049dca110838da1778
2023-03-21 17:15:46 +01:00
Zuul
a7669aae88 Merge "Add details of physical net configure --display" 2023-03-15 09:54:58 +00:00
Bartosz Bezak
e0ff9a0283 Fixes repositories files name in Rocky Linux 9
Distributions moved to lowercase names with RHEL 9 release.
This patch also removes previously created uppercase files.

Story: 2010637
Task: 47604
Change-Id: I8bf75ce44b9ec1fdd477fcddf2deebf2929d9fc1
2023-03-08 12:34:11 +00:00
Bartosz Bezak
f9fee1f17f CI: get repo directories from nodes for troubleshooting
Change-Id: I0f7a3dcb021f726693725f070d9a2ff80d84fe0e
2023-03-08 11:28:54 +01:00
Bartosz Bezak
068581456f use OS python to create kolla-ansible venv
Currently kayobe creates kolla-ansible venv using kayobe venv
python3. There are corner cases when creation k-a venv fails
while using kayobe venv created with python 3.6 buggy setuptools/
virtualenv command. Using OS python to create venv solves those
corner cases issues and preserves compatibilty.

Story: 2010634
Task: 47599

Change-Id: Ie0d9bf895f6714cbb8b0bd31a008eb388f4c51c2
2023-03-07 16:45:02 +01:00
Stig Telfer
f5529e6133 Add details of physical net configure --display
The --display parameter is very helpful but apparently undocumented.
Add it here.

Change-Id: I0e0e5ab8c2ca549d3278d7319ca6988c8790aef1
2023-03-06 17:22:58 +00:00
Pierre Riteau
77ca077195 CI: Disable disk image build in seed-upgrade jobs
This build takes time and can fail due to lack of disk space. It got
enabled when we changed overcloud_dib_build_host_images to true.

Also fix bifrost overrides which was wrongly applied, we need to use
dib.yml instead of bifrost.yml, like in kayobe-seed-base.

Change-Id: I1edafbb41a26587a5ef794b3b9886fdf189a0a1a
2023-03-03 18:21:07 +01:00
Maksim Malchuk
5e8a8233da Fix an issue when 'acl' package can be forgotten
This is folllowup on I69bf810632d09eddaa3983ae56e833debe9fd03b to
avoid user accidentely forgot the 'acl' package when override the
dev_tools_packages_default in their custom configuration. Also this
adds an ability to customise list of packages installed in addition
to the default list.

Change-Id: I03a826e98a18b158774ba100cfa2987299eb6c25
Signed-off-by: Maksim Malchuk <maksim.malchuk@gmail.com>
2023-02-21 20:49:56 +00:00
Zuul
db9ce40e81 Merge "docs: add information about enabling TLS to automated guide" 2023-02-21 17:44:46 +00:00
Zuul
8576e719cd Merge "dnf: improve task output readability" 2023-02-21 17:44:44 +00:00
Zuul
609b51d8a6 Merge "Use assert to test/validate condition" 2023-02-21 17:05:24 +00:00
Zuul
61ad986372 Merge "vips: assert shows what we're testing and when" 2023-02-21 16:39:04 +00:00
Erik Berg
e6bd07faf7
Use assert to test/validate condition
This test seems to have a fault, where the variable/list
kolla_ironic_enabled_console_interfaces could be undefined, the
test would not fail.

Anyway, using assert shows what we're testing, and doesn't list the
task as skipped when we meet the requirements.

Change-Id: Id9c4abc285be0240f9bdc21d21537d3a2d9bfd57
2023-02-17 07:40:17 +01:00
Zuul
be0a819623 Merge "Ubuntu: Fix networkd config for multiple VLANs without MTU" 2023-02-16 17:33:52 +00:00
Michal Nasiadka
7dc506ef48 CI: Don't run Heat and Horizon in overcloud jobs
Not only TLS jobs need that treatment, Rocky9/CentOS
Stream 9 jobs have the same issue - let's disable
Heat and Horizon in all overcloud jobs.

Change-Id: Iecab44969cea015b363ec6884ef6a7c9960a6b3f
2023-02-08 07:42:25 +00:00
Bartosz Bezak
094852e3c6 CI: add Rocky9 upgrade jobs
Change-Id: I1687ea33f27dee6ba145514db5cf213b28cc8cd2
2023-01-26 14:59:19 +01:00
Zuul
6f6c0d3bee Merge "Add Hashi Vault support for Kolla passwords" 2023-01-23 20:09:53 +00:00
Bartosz Bezak
059c223b32 CI: move ubuntu upgrade jobs to jammy
Change-Id: I0519b5251a743138fe64528d265607a919d04763
2023-01-17 09:14:20 +01:00
Zuul
7a78dda176 Merge "Apply TODOs for Antelope cycle" 2023-01-16 20:11:45 +00:00
Zuul
7f7026f6fa Merge "set previous_release to zed" 2023-01-16 17:51:47 +00:00
Erik Berg
b7c8c30bb3
vips: assert shows what we're testing and when
assert will also fail when we're not meeting the conditions, makes
clear what we're actually testing, and isn't listed as a skipped task
when the condition is ok.

Change-Id: I640207dd9e987cb6d5743e22cae6039a65d10566
2023-01-16 16:32:17 +01:00
Erik Berg
8b5168828a
dnf: improve task output readability
It's more informative to describe the tasks we are skipping by
adding a name section to the include_tasks. Otherwise it just
shows;

 TASK [dnf : include_tasks] *
 skipping: [controller-1]

The other include_tasks doesn't have a name section or a when clause
so switching to import_tasks.

Change-Id: Ie8d34a45aa4ebd0e2ea635208970acf18741aee5
2023-01-16 10:05:48 +01:00
Bartosz Bezak
0874242adf Apply TODOs for Antelope cycle
Change-Id: Ie88ca550d4ed619209c08719328ea69e10c274ad
2023-01-14 00:30:50 +00:00
Bartosz Bezak
717f4d9fe1 set previous_release to zed
Upgrade CI job needs clouds.yaml to be used from Zed

Newer version of ansible-collections-openstack uses different return
value. [1]

[1] https://review.opendev.org/c/openstack/ansible-collections-openstack/+/841224

Change-Id: Ic0608bc6033025cb47655d601ffaf3744637832f
2023-01-13 21:22:43 +01:00
Zuul
aed2461edd Merge "Revert "Use OpenStack Zed release"" 2023-01-13 18:09:15 +00:00
Bartosz Bezak
0c11102afe Revert "Use OpenStack Zed release"
This reverts commit 65c59b9f5939f19f5fb914dbcb0fc64cde99771b.

Reason for revert: Zed has been branched and released

Change-Id: I2d87017c27139b5e0154edef006ad61d665ede2a
2023-01-12 10:46:49 +00:00
Matt Crees
4af5fd172b Add command to run config validation
Adds the command ``kayobe overcloud service configuration validate`` to
run the ``oslo-config-validator`` on all hosts via Kolla-Ansible. The
output directory of the results is specified with the flag
``--output-dir``.

Change-Id: I5d5d16eeabe69e8659e33722165928df096b3559
2023-01-10 16:08:25 +00:00
Zuul
ebd5799fd4 Merge "Replace references to Docker Hub by Quay.io" 2023-01-09 11:22:27 +00:00
Pierre Riteau
8640fbd5c0 Sync kolla_tag with kolla-ansible
Without this change, Kayobe was tagging container images with `zed` when
kolla-ansible was expecting something like `zed-ubuntu-jammy`.

Change-Id: I23c409900db2c37105e7b218bbaedcfacb235787
2023-01-06 11:53:29 +01:00
Pierre Riteau
6e78aa8914 Replace references to Docker Hub by Quay.io
Kolla Ansible uses Quay.io as its default registry.

Change-Id: Ie1a56ebd6fe3283a2b5b077f658ff1cf3e006784
2023-01-06 11:11:46 +01:00
Pierre Riteau
ee25470b01 docs: add missing word
Change-Id: I0289a0868b916a14c69fbab414335e7de6b17380
2023-01-05 06:48:34 +01:00
Zuul
f23ce83a12 Merge "Support configuring VLANs with systemd-networkd syntax" 2023-01-03 13:08:12 +00:00
Zuul
315541a38c Merge "Add note about Zed upgrade using Rocky Linux 9" 2023-01-03 11:30:11 +00:00
Pierre Riteau
5e1e285384 Fix tox.ini for tox4
Depends-On: https://review.opendev.org/c/zuul/zuul-jobs/+/866943/

Change-Id: I66b3a85adfe2928b936006780fb20b5fc7cc802f
2022-12-28 14:52:29 +01:00
Pierre Riteau
5c1cdf889b Add note about Zed upgrade using Rocky Linux 9
This replaces the note about upgrading to CentOS Stream 8.

Change-Id: If550a604403fa67e3b6062428cd82032217e545c
2022-12-24 16:11:19 +01:00