opendev/system-config
Code Issues Proposed changes

Disable crm114 on the logstash worker nodes

Browse Source 
The logstash worker nodes are running out of disk because crm114 has
enough unique files to process that at 13MB per file we are still
filling up many gigabytes of data and filling out disks.

We will need to work on collapsing files (perhaps not use their full
path and just use their basename?) and work to eliminate log files that
are unique like those that have the hostname in them (as this means we
create a new file for every job run).

Change-Id: Ie729a3d2628f0ded65574c267e31c14f6b795b29
This commit is contained in:
Clark Boylan 2017-11-01 10:09:22 -07:00
parent 2d5aa3bf6f
commit a000d47ed1
1 changed files with 3 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
modules/openstack_project/templates/logstash/jenkins-log-worker.yaml.erb
View File

@ -3,8 +3,9 @@ gearman-port: 4730
output-host: localhost
output-port: 9999
output-mode: tcp
crm114-script: /usr/local/bin/classify-log.crm
crm114-data: /var/lib/crm114
# Temporarily disabled as this is filling our worker node disks
#crm114-script: /usr/local/bin/classify-log.crm
#crm114-data: /var/lib/crm114
mqtt-host: <%= @mqtt_hostname %>
mqtt-port: <%= @mqtt_port %>
mqtt-topic: gearman-logstash/<%= @hostname %>