opendev/system-config
Code Issues Proposed changes
8ccab5e967
system-config/playbooks/roles/apache-ua-filter
History
Clark Boylan eb61767d1e Update user agent filter list 
We're see crawling on gitea impact service response time. The list of
user agents was compiled looking for requests that were obvious crawling
behavior, filtering out the UA strings, sorting by counts then removing
obvious bots that seem to be more well behaved. What we are left with is
a number of user agents making requests as older unsupported versions of
mobile clients. Filter those.

Change-Id: I6e774c83a66e25d1b1faefc7cacf39ffb77f509a
2023-05-02 10:18:41 -07:00
..
files Update user agent filter list 2023-05-02 10:18:41 -07:00
handlers Block restricted user agents for the tarballs site 2020-10-16 17:45:12 +00:00
tasks Block restricted user agents for the tarballs site 2020-10-16 17:45:12 +00:00
README.rst Block restricted user agents for the tarballs site 2020-10-16 17:45:12 +00:00

README.rst

Reject requests from problematic user agent strings

This role installs and configures a filter macro called UserAgentFilter which can be included in Apache vhosts

Role Variables