kolla-ansible/kolla_ansible
Mark Goddard 56a07702bc Performance: use a single config file for fluentd
Currently we generate multiple fluentd configuration files for inputs,
filters, formatters and outputs.
These are then included from the main td-agent.conf configuration file.
With a large number of hosts, this can take a long time to template.

Benchmarking of templating is available at [1].

This change switches to a single fluentd configuration file, with the
include done locally. For the default template files included with Kolla
Ansible we use Jinja includes, but this does not work with templates in
a different directory. We therefore use the Ansible template lookup
plugin, which has a slightly higher overhead than a jinja include, but
far lower than generating multiple templates. This should drastically
improve the performance of this task.

[1] https://github.com/stackhpc/ansible-scaling/blob/master/doc/template.md

Partially-Implements: blueprint performance-improvements

Change-Id: Ia8623be0aa861fea3e54d2c9e1c971dfd8e3afa9
2020-07-28 12:14:48 +01:00
..
cmd Improve error reporting in password utilities 2020-05-22 19:20:47 +01:00
tests Performance: use a single config file for fluentd 2020-07-28 12:14:48 +01:00
__init__.py Rename kolla namespace to kolla_ansible 2017-02-15 16:34:51 +08:00
exception.py Add custom filters for checking services 2019-09-16 12:48:52 +00:00
filters.py Fix service_mapped_to_host filter for common services 2020-04-14 14:15:54 +01:00
fluentd_filters.py Performance: use a single config file for fluentd 2020-07-28 12:14:48 +01:00
kolla_address.py Implement IPv6 support in the control plane 2019-10-16 10:24:35 +02:00
nova_filters.py Add unit tests for Nova Cells filters 2019-10-18 13:13:32 +00:00
put_address_in_context.py Implement IPv6 support in the control plane 2019-10-16 10:24:35 +02:00
version.py Rename kolla namespace to kolla_ansible 2017-02-15 16:34:51 +08:00