kolla-ansible/kolla_ansible
Mark Goddard c66f6a135f Performance: use a single config file for fluentd
Currently we generate multiple fluentd configuration files for inputs,
filters, formatters and outputs.
These are then included from the main td-agent.conf configuration file.
With a large number of hosts, this can take a long time to template.

Benchmarking of templating is available at [1].

This change switches to a single fluentd configuration file, with the
include done locally. For the default template files included with Kolla
Ansible we use Jinja includes, but this does not work with templates in
a different directory. We therefore use the Ansible template lookup
plugin, which has a slightly higher overhead than a jinja include, but
far lower than generating multiple templates. This should drastically
improve the performance of this task.

[1] https://github.com/stackhpc/ansible-scaling/blob/master/doc/template.md

Partially-Implements: blueprint performance-improvements

Change-Id: Ia8623be0aa861fea3e54d2c9e1c971dfd8e3afa9
(cherry picked from commit 56a07702bc)
2020-10-13 18:03:48 +00:00
..
cmd Improve error reporting in password utilities 2020-06-25 11:00:42 +00:00
tests Performance: use a single config file for fluentd 2020-10-13 18:03:48 +00:00
__init__.py Rename kolla namespace to kolla_ansible 2017-02-15 16:34:51 +08:00
exception.py Add custom filters for checking services 2019-09-16 12:48:52 +00:00
filters.py Fix kolla_address in IPv6 fully-routed topo case 2020-08-01 08:04:47 +00:00
fluentd_filters.py Performance: use a single config file for fluentd 2020-10-13 18:03:48 +00:00
helpers.py Fix kolla_address in IPv6 fully-routed topo case 2020-08-01 08:04:47 +00:00
kolla_address.py Fix kolla_address in IPv6 fully-routed topo case 2020-08-01 08:04:47 +00:00
nova_filters.py Add unit tests for Nova Cells filters 2019-10-18 13:13:32 +00:00
put_address_in_context.py Implement IPv6 support in the control plane 2019-10-16 10:24:35 +02:00
version.py Rename kolla namespace to kolla_ansible 2017-02-15 16:34:51 +08:00