The combination of logscraper and logsender is working for a long time
in OpenDev infra and it never has any issue even during release time.
Change-Id: I1be94eca5d842b02c558e5ffda85c23fa66e6759
This change mitigates an issue with the builds api that does not
returns build by end_time, as previously thought.
Change-Id: I28357cbe888649b89705511942db70fb26ba0dde
The logsender tool will be used to parse the content downloaded
by logscraper tool with --download parameter and send it to the
Elasticsearch service.
By using logsender tool, services like: gearman client, gearman
worker and logstash are not necessary to maintain, because
the information are send directly to the Elasticsearch host.
Depends-On: https://review.opendev.org/c/openstack/ci-log-processing/+/830169
Change-Id: I3e28b847e7cafbf4742fb718ef09ce3e658f945f
The new option '--download' give possibility to download the log
files with additional Zuul information files, that later can be
used by other tool to send the content to next log processing service.
The option was proposed in other patch set [1], which is large and
it makes review more complex.
[1] https://review.opendev.org/c/openstack/ci-log-processing/+/830337
Change-Id: I88d39c8ca2e186f68296e0f21551eac2c550b5b8
Some improvements that were done:
- add the loggearman documentation
- add documtation for loggearman ansible
- changed title in loggearman ansible doc
- changed default port from 4731 to 4730
Change-Id: I6488bef19c1041e4a3a6e5a46251946ce6b8e8b4
This commit provides Zuul logscraper tool responsible for
getting newest logs by using Zuul API and pushing them to
log processing services.
Change-Id: Iff45fbcb6d4813cc60dc705c60e95f3045984b5c
