openstack
/
kolla-ansible
Code Issues Proposed changes
kolla-ansible/ansible/roles
History
Mark Goddard 56a07702bc Performance: use a single config file for fluentd 
Currently we generate multiple fluentd configuration files for inputs,
filters, formatters and outputs.
These are then included from the main td-agent.conf configuration file.
With a large number of hosts, this can take a long time to template.

Benchmarking of templating is available at [1].

This change switches to a single fluentd configuration file, with the
include done locally. For the default template files included with Kolla
Ansible we use Jinja includes, but this does not work with templates in
a different directory. We therefore use the Ansible template lookup
plugin, which has a slightly higher overhead than a jinja include, but
far lower than generating multiple templates. This should drastically
improve the performance of this task.

[1] https://github.com/stackhpc/ansible-scaling/blob/master/doc/template.md

Partially-Implements: blueprint performance-improvements

Change-Id: Ia8623be0aa861fea3e54d2c9e1c971dfd8e3afa9
 		2020-07-28 12:14:48 +01:00
..
aodh Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
barbican Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
baremetal Remove chrony package if containerized chrony is enabled 2020-06-15 13:06:36 +02:00
bifrost Bifrost: Stop stopping RabbitMQ 2020-02-21 16:40:30 +00:00
blazar Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
ceilometer Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
certificates Replace internal and external VIP CA with root CA 2020-06-16 11:46:34 +01:00
chrony Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
cinder Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
cloudkitty Merge "Fix some CloudKitty API responses when behind SSL" 2020-07-24 10:38:57 +00:00
collectd Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
common Performance: use a single config file for fluentd 2020-07-28 12:14:48 +01:00
cyborg Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
designate Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
destroy Support setting Kafka storage volume 2020-03-30 11:00:03 +02:00
elasticsearch Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
etcd Merge "Add support for encrypting etcd service" 2020-07-24 07:53:50 +00:00
freezer Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
glance Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
gnocchi Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
grafana Improve Grafana DB bootstrap 2020-07-27 08:23:05 +00:00
haproxy Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
haproxy-config Merge "Avoid multiple haproxy restarts after reconfiguration" 2020-04-26 15:41:31 +00:00
heat Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
horizon Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
influxdb Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
ironic Merge "Revert "Remove the waiting for ironic-api to be accessible"" 2020-07-25 09:57:55 +00:00
iscsi Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
kafka Set Kafka default replication factor 2020-07-27 08:23:05 +00:00
karbor Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
keystone Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
kibana Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
kuryr Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
magnum Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
manila Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
mariadb Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
masakari Merge "Masakari: copy TLS certificates into containers" 2020-07-24 07:53:48 +00:00
memcached Merge "Add Ansible group check to prechecks" 2020-04-16 15:33:46 +00:00
mistral Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
module-load Rename main.yaml to main.yml in modules-load role 2020-01-25 21:47:04 +01:00
monasca Improve Grafana DB bootstrap 2020-07-27 08:23:05 +00:00
multipathd Merge "Add Ansible group check to prechecks" 2020-04-16 15:33:46 +00:00
murano Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
neutron Remove Hyper-V integration 2020-07-27 10:25:46 +01:00
nova Remove Hyper-V integration 2020-07-27 10:25:46 +01:00
nova-cell Merge "Make /dev/kvm permissions handling more robust" 2020-07-22 12:32:40 +00:00
octavia Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
openvswitch Merge "Performance: Run common role in a separate play" 2020-07-17 15:43:22 +00:00
ovn Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
ovs-dpdk Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
panko Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
placement Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
prechecks Ansible lint related fixes 2020-05-12 17:39:07 +00:00
prometheus Configure prometheus-openstack-exporter to use internal endpoints 2020-07-21 09:38:49 +02:00
prune-images Adds Docker image pruning command 2020-01-27 13:44:01 +03:00
qdrouterd Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
qinling Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
rabbitmq Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
rally Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
redis Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
sahara Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
searchlight Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
senlin Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
service-cert-copy/tasks Add support for encrypting backend Keystone HAProxy traffic 2020-04-09 09:22:55 +00:00
service-ks-register Remove delegate_to from service-ks-register tasks 2019-09-26 10:38:35 +01:00
service-precheck Add Ansible group check to prechecks 2020-02-28 16:23:14 +00:00
service-rabbitmq Configure RabbitMQ user tags in nova-cell role 2020-05-15 16:02:46 +01:00
service-stop/tasks Fix kolla-ansible stop with heterogeneous hosts 2020-03-23 17:21:53 +00:00
skydive Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
solum Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
storm Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
swift Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
tacker Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
telegraf Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
tempest Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
trove Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
vitrage Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
vmtp Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
watcher Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00
zookeeper Performance: Run common role in a separate play 2020-07-07 15:00:47 +00:00
zun Merge "Performance: remove unnecessary conditions from includes" 2020-07-24 07:52:37 +00:00