kolla-ansible/tests/templates
Mark Goddard 99cd5ec10c Wait for mariadb to stop after shutdown
Stein only.

Currently the kolla-ansible-centos-source-upgrade-ceph job is failing on
the stable/stein branch.

The problem occurs with mariadb, when performing an upgrade to the Stein
release which has a new version of mariadb. It appears that when the
slave mariadb services are shut down, we do not wait for the container
to stop, so the service may not shut down cleanly. This prevents it from
starting up successfully.

This change waits for the container to stop after the shutdown command
has been executed. It also temporarily replaces the restart policy of
the container to prevent it from starting up again after the shutdown.

This is not required in other branches since the mariadb shutdown
workaround was only added in the stein branch for bug 1820325.

There is a second issue that is addressed here. The Stein release
switched from using xtrabackup to mariabackup for galera state syncing.
If we run both container versions at the same time on different hosts
then we can get an error such as the following:

sh: wsrep_sst_mariabackup: command not found

We therefore now stop the cluster and perform a recovery during an
upgrade, if we detect that xtrabackup is in use.

Finally, we now wait for the bootstrap host to report that it is in an
OPERATIONAL state. Without this we can see errors where the MariaDB
cluster is not ready when used by other services.

Change-Id: I513bcf31adaee8441d43c6b578ca06f66820e52b
Closes-Bug: #1834191
Related-Bug: #1820325
2019-07-04 14:02:39 +00:00
..
bifrost-dib-overrides.j2 Add a job for testing deployment of bifrost 2018-06-18 13:40:43 +01:00
ceph-overrides.j2 Enable multinode scenarios in zuulv3 2017-12-27 09:21:35 -08:00
docker_daemon.json.j2 Pull image from dockerhub rather than tarballs.o.o site 2017-11-16 15:44:24 +08:00
globals-default.j2 Wait for mariadb to stop after shutdown 2019-07-04 14:02:39 +00:00
inventory.j2 Merge "Add cyborg to kolla-ansible" 2019-03-28 08:20:13 +00:00
nova-compute-overrides.j2 Enable multinode gate 2017-06-05 11:35:20 -07:00