Add Deferred service events

This is a new feature for 21.04. It gets a new page.

The feature was not tested during the writing of this
documentation.

Some text was commented out as it depends on changes
to charms (READMEs), which are frozen at this time.

Change-Id: I612e34436bea4db2fbf213aa02e7a6b52ca8f0cb
This commit is contained in:
Peter Matulis 2021-04-22 12:50:27 -04:00
parent 2dd71d53d3
commit 9009de5660
2 changed files with 178 additions and 0 deletions

View File

@ -0,0 +1,177 @@
=======================
Deferred service events
=======================
Overview
--------
Operational or maintenance procedures applied to a cloud often lead to the
restarting of various OpenStack services and/or the calling of certain charm
hooks. Although normal, such events can be undesirable due to the service
interruptions they can cause.
The deferred service events feature allows the operator the choose to prevent
these service restarts and hook calls from occurring. These deferred events can
then be resolved by the operator at a more opportune time.
Situations in which these service events are prone to take place include:
* charm upgrades
* OpenStack upgrades (charm-managed)
* package upgrades (non-charm-managed)
* charm configuration option changes
Charms
------
Deferred service events are supported on a per-charm basis.
Here is the current list of deferred event-aware charms:
* neutron-gateway
* neutron-openvswitch
* ovn-central
* ovn-chassis
* ovn-dedicated-chassis
* rabbitmq-server
.. COMMENT # Comment this out until the READMEs have been updated
Deferred restarts are supported on a per-charm basis. This support will be
mentioned in a charm's README along with any charm-specific deferred restart
information.
Here is the current list of deferred restart-aware charms:
* `neutron-gateway`_
* `neutron-openvswitch`_
* `ovn-central`_
* `ovn-chassis`_
* `ovn-dedicated-chassis`_
* `rabbitmq-server`_
Enabling and disabling deferred service events
----------------------------------------------
To enable deferred service events for a charm make a configuration change:
.. code-block:: none
juju config <charm-name> enable-auto-restarts=False
By default the feature is disabled.
.. important::
The ``enable-auto-restarts`` option can only be set post-deployment.
To disable deferred service events:
.. code-block:: none
juju config <charm-name> enable-auto-restarts=True
Identifying and resolving deferred service events
-------------------------------------------------
The existence of a deferred service event is exposed in the output of the
:command:`juju status` command. The following two sections provide an example
of how to identify and resolve each type.
Service restarts
~~~~~~~~~~~~~~~~
Here the ``neutron-openvswitch/1`` unit is affected by a deferred service
restart:
.. code-block:: console
App Version Status Scale Charm Store Channel Rev OS Message
neutron-openvswitch 16.3.0 active 2 neutron-openvswitch charmstore 433 ubuntu Unit is ready
nova-compute 21.1.2 active 2 nova-compute charmstore 537 ubuntu Unit is ready.
Unit Workload Agent Machine Public address Ports Message
nova-compute/0* active idle 6 172.20.0.13 Unit is ready.
neutron-openvswitch/1 active idle 172.20.0.13 Unit is ready. Services queued for restart: openvswitch-switch
nova-compute/1 active idle 7 172.20.0.4 Unit is ready
neutron-openvswitch/0* active idle 172.20.0.4 Unit is ready
To see more detail the ``show-deferred-events`` action is used:
.. code-block:: none
juju run-action --wait neutron-openvswitch/1 show-deferred-events
unit-neutron-openvswitch-1:
UnitId: neutron-openvswitch/1
id: "67"
results:
Stdout: |
none
output: |
hooks: []
restarts:
- 1618896650 openvswitch-switch Package update
status: completed
timing:
completed: 2021-04-20 05:52:39 +0000 UTC
enqueued: 2021-04-20 05:52:32 +0000 UTC
started: 2021-04-20 05:52:33 +0000 UTC
In this example, the message "Package update" is displayed. This signifies that
the package management software of the host is responsible for the service
restart request.
Resolving deferred service restarts
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
To resolve a deferred service restart on a unit run the ``restart-services``
action:
.. code-block:: none
juju run-action --wait neutron-openvswitch/1 restart-services deferred-only=True
The argument ``deferred-only`` ensures that only the necessary services are
restarted (for a charm that manages multiple services).
.. note::
Alternatively, the service can be restarted manually on the unit. The status
message will be removed in due course by the charm (i.e. during the next
``update-status`` hook execution - a maximum delay of five minutes).
Hook calls
~~~~~~~~~~
Here the ``neutron-openvswitch/1`` unit is affected by a deferred hook call:
.. code-block:: console
App Version Status Scale Charm Store Channel Rev OS Message
neutron-openvswitch 16.3.0 active 2 neutron-openvswitch charmstore 433 ubuntu Unit is ready. Hooks skipped due to disabled auto restarts: config-changed
nova-compute 21.1.2 active 2 nova-compute charmstore 537 ubuntu Unit is ready
Unit Workload Agent Machine Public address Ports Message
nova-compute/0* active idle 6 172.20.0.13 Unit is ready
neutron-openvswitch/1 active idle 172.20.0.13 Unit is ready. Hooks skipped due to disabled auto restarts: config-changed
Resolving deferred hook calls
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
To resolve a deferred hook call on a unit run the ``run-deferred-hooks``
action:
.. code-block:: none
juju run-action --wait neutron-openvswitch/1 run-deferred-hooks
.. LINKS
.. CHARMS
.. _neutron-gateway: https://opendev.org/openstack/charm-neutron-gateway/src/branch/master/README.md#user-content-deferred-restarts
.. _neutron-openvswitch: https://opendev.org/openstack/charm-neutron-openvswitch/src/branch/master/README.md#user-content-deferred-restarts
.. _ovn-central: https://opendev.org/x/charm-ovn-central/src/branch/master/README.md#user-content-deferred-restarts
.. _ovn-chassis: https://opendev.org/x/charm-ovn-chassis/src/branch/master/README.md#user-content-deferred-restarts
.. _ovn-dedicated-chassis: https://opendev.org/x/charm-ovn-dedicated-chassis/src/branch/master/README.md#user-content-deferred-restarts
.. _rabbitmq-server: https://opendev.org/openstack/charm-rabbitmq-server/src/branch/master/README.md#user-content-deferred-restarts

View File

@ -76,6 +76,7 @@ OpenStack Charms usage. To help improve it you can `file an issue`_ or
app-managing-power-events
ceph-operations
deferred-events
.. toctree::
:caption: Storage