This reverts commit a000d47ed172718ed72f9a62db9ae00b3b0c1644.
We have updated the crm processing to collapse indentical log files with
different paths or suffixes into a single file name for processing. This
should dramatically reduce disk consumption for crm114 learning making
it safe to use again.
Change-Id: I50aa5fa434de51c689e5c2e51070db0ee1a76bae
The logstash worker nodes are running out of disk because crm114 has
enough unique files to process that at 13MB per file we are still
filling up many gigabytes of data and filling out disks.
We will need to work on collapsing files (perhaps not use their full
path and just use their basename?) and work to eliminate log files that
are unique like those that have the hostname in them (as this means we
create a new file for every job run).
Change-Id: Ie729a3d2628f0ded65574c267e31c14f6b795b29
The mqtt username and password variables in the logstash work config
template were incorrect and didn't match what was being set in
logstash_worker.pp. This commit fixes it so everything matches.
Change-Id: I959fbd0cf1d7535ff75b42c228e5f74ada8fe5d3
This commit enables the mqtt notifications in the gearman worker. Most
of the setup was already there from our previous failed attempts to
leverage the logstash plugin directly. This just pivots that to use the
gearman worker instead.
Change-Id: I6becec12604c61fe50d3e6b9c7ed9f9e9be311ae
Depends-On: I0a17444cce18dd4b63f1f924e393483f6d8fe8eb
Depends-On: I43be3562780c61591ebede61f3a8929e8217f199