nova/releasenotes/notes/rbd-increase-timeout-c4e5a34cf5da7fdc.yaml
Sasha Andonov 6458c3dba5 rbd_utils: increase _destroy_volume timeout
If RBD backend is used for Nova ephemeral storage, Nova tries to remove
ephemeral storage volume from Ceph in a retry loop: 10 attempts at 1
second intervals, totaling 10 seconds overall - which, due to a thirty
second ceph watcher timeout, might result in intermittent volume
removal failures on Ceph side.
This patch adds params rbd_destroy_volume_retries, defaulting to 12, and
rbd_destroy_volume_retry_interval, defaulting to 5, which multiplied, give
Ceph reasonable amount of time to complete the operation successfully.

Closes-Bug: #1856845
Change-Id: Icfd55617f0126f79d9610f8a2fc6b4c817d1a2bd
2020-05-20 00:08:54 +00:00

20 lines
931 B
YAML

---
features:
- |
Added params ``[libvirt]/rbd_destroy_volume_retries``, defaulting to 12,
and ``[libvirt]/rbd_destroy_volume_retry_interval``, defaulting to 5, that
Nova will use when trying to remove a volume from Ceph in a retry loop
that combines these parameters together. Thus, maximum elapsing time is by
default 60 seconds.
fixes:
- |
Nova tries to remove a volume from Ceph in a retry loop of 10 attempts at
1 second intervals, totaling 10 seconds overall - which, due to 30 second
ceph watcher timeout, might result in intermittent object removal failures
on Ceph side (`bug 1856845`_). Setting default values for
``[libvirt]/rbd_destroy_volume_retries`` to 12 and
``[libvirt]/rbd_destroy_volume_retry_interval`` to 5, now gives Ceph
reasonable amount of time to complete the operation successfully.
.. _`bug 1856845`: https://bugs.launchpad.net/nova/+bug/1856845