kolla-ansible/ansible/roles
Mark Goddard 97e5c0e9b1 cadvisor: Set housekeeping interval to Prometheus scrape interval
The prometheus_cadvisor container has high CPU usage. On various
production systems I checked it sits around 13-16% on controllers,
averaged over the prometheus 1m scrape interval. When viewed with top we
can see it is a bit spikey and can jump over 100%.

There are various bugs about this, but I found
https://github.com/google/cadvisor/issues/2523 which suggests reducing
the per-container housekeeping interval. This defaults to 1s, which
provides far greater granularity than we need with the default
prometheus scrape interval of 60s.

Reducing the housekeeping interval to 60s on a production controller
reduced the CPU usage from 13% to 3.5% average. This still seems high,
but is more reasonable.

Change-Id: I89c62a45b1f358aafadcc0317ce882f4609543e7
Closes-Bug: #2048223
2024-01-05 11:02:41 +00:00
..
aodh enable quorum queues 2023-11-30 13:53:00 +00:00
barbican enable quorum queues 2023-11-30 13:53:00 +00:00
bifrost Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
blazar enable quorum queues 2023-11-30 13:53:00 +00:00
ceilometer enable quorum queues 2023-11-30 13:53:00 +00:00
ceph-rgw haproxy: support single external frontend 2023-06-29 01:44:00 +02:00
certificates Add support for LetsEncrypt-managed certs 2023-11-07 10:59:51 +01:00
cinder CI: fix two ansible-lint warnings 2023-12-18 19:15:38 +01:00
cloudkitty enable quorum queues 2023-11-30 13:53:00 +00:00
collectd Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
common Merge "post-deploy: add public-openrc.sh" 2024-01-04 17:11:59 +00:00
cyborg Merge "Add nova conf for cyborg" 2023-12-20 08:08:16 +00:00
designate Merge "Make designate bind9 cmdline configurable" 2023-12-28 15:17:16 +00:00
destroy Add container engine option to scripts 2023-04-28 16:16:55 +02:00
etcd etcd: update to v3.4 2023-11-29 17:43:33 +00:00
freezer Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
glance CI: fix two ansible-lint warnings 2023-12-18 19:15:38 +01:00
gnocchi Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
grafana Merge "Rename kolla_docker to kolla_container" 2023-11-28 12:06:09 +00:00
hacluster Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
haproxy-config Add support for LetsEncrypt-managed certs 2023-11-07 10:59:51 +01:00
heat enable quorum queues 2023-11-30 13:53:00 +00:00
horizon Fix broken list concatenation in horizon role 2023-12-05 16:59:20 +01:00
influxdb Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
ironic ironic: Remove enable_ironic_pxe_uefi bits 2024-01-04 10:21:35 +00:00
iscsi Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
keystone post-2023.1: Remove keystone admin endpoint bits 2023-12-28 09:39:18 +01:00
kuryr Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
letsencrypt Use service-images-pull role for letsencrypt and venus 2024-01-03 16:51:25 +00:00
loadbalancer haproxy: Fix single frontend after LE cert path change 2024-01-02 18:30:42 +01:00
loadbalancer-config Add proxysql-config role and wrap it in loadbalancer-config role 2022-08-09 12:16:16 +02:00
magnum magnum: Disable CAPI driver when kubeconfig missing 2024-01-02 17:22:39 +00:00
manila enable quorum queues 2023-11-30 13:53:00 +00:00
mariadb Merge "Fix wsrep sync status task while switched to TCP/IP" 2024-01-02 14:07:22 +00:00
masakari quorum: add missing octavia and masakari 2023-12-19 12:13:53 +01:00
memcached Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
mistral enable quorum queues 2023-11-30 13:53:00 +00:00
module-load Drop support for /etc/modules 2020-08-25 20:20:57 +01:00
multipathd Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
murano enable quorum queues 2023-11-30 13:53:00 +00:00
neutron Merge "Persist Neutron agent state files in volume" 2024-01-03 09:51:57 +00:00
nova Remove nova cell sync comment 2023-12-21 09:29:02 +00:00
nova-cell enable quorum queues 2023-11-30 13:53:00 +00:00
octavia quorum: add missing octavia and masakari 2023-12-19 12:13:53 +01:00
octavia-certificates Add support for checking Octavia cert expiration 2023-04-27 15:22:12 +01:00
opensearch Merge "Set a log retention policy for OpenSearch" 2023-12-21 15:17:32 +00:00
openvswitch Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
ovn-controller Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
ovn-db Merge "Rename kolla_docker to kolla_container" 2023-11-28 12:06:09 +00:00
ovs-dpdk Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
placement Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
prechecks enable quorum queues 2023-11-30 13:53:00 +00:00
prometheus cadvisor: Set housekeeping interval to Prometheus scrape interval 2024-01-05 11:02:41 +00:00
proxysql-config Fix issues introduced by ansible-lint 6.6.0 2022-09-21 14:34:54 +00:00
prune-images Add support of podman deployment 2023-10-20 17:51:52 +02:00
rabbitmq Rework quorum queues precheck 2023-12-19 14:26:05 +00:00
redis Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
sahara Fix Docker health check for sahara_engine 2023-12-14 09:53:03 +00:00
senlin enable quorum queues 2023-11-30 13:53:00 +00:00
service-cert-copy Add `kolla_externally_managed_cert` option 2021-03-02 18:09:06 +01:00
service-config-validate Integrate oslo-config-validator 2022-12-21 17:19:09 +00:00
service-images-pull Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
service-ks-register Fix loop label syntax error with ansible-core 2.15 2023-07-27 18:05:47 +00:00
service-precheck Add Ansible group check to prechecks 2020-02-28 16:23:14 +00:00
service-rabbitmq Fix loop label syntax error with ansible-core 2.15 2023-07-27 18:05:47 +00:00
service-stop/tasks Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
skyline Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
solum enable quorum queues 2023-11-30 13:53:00 +00:00
swift Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
tacker enable quorum queues 2023-11-30 13:53:00 +00:00
telegraf Rename kolla_docker to kolla_container 2023-11-15 13:54:57 +01:00
trove enable quorum queues 2023-11-30 13:53:00 +00:00
venus Use service-images-pull role for letsencrypt and venus 2024-01-03 16:51:25 +00:00
vitrage enable quorum queues 2023-11-30 13:53:00 +00:00
watcher enable quorum queues 2023-11-30 13:53:00 +00:00
zun enable quorum queues 2023-11-30 13:53:00 +00:00