opendev/system-config
Code Issues Proposed changes
e9854d8bdc
system-config/modules/openstack_project
History
Clark Boylan eeac5467c3 Set up robots.txt on lists servers 
This sets up a robots.txt on our lists servers. To start this file
prevents SEMrush bot from indexing our lists as that has been causing
lists.openstack.org to OOM with many listinfo processes started by
Apache.

We've avoided this OOM by manually configuring this robots.txt. Other
things we have ruled out are bup and input email causes qrunner's to
grow unexpectedly large. Fairly confident this bot is the trigger.

Note this fixes testing by adding 'hieradata' to set listpassword var.

Depends-On: https://review.opendev.org/724389
Change-Id: Id4f6739a8cf6a01f9796fa54c86ba1af3e31fecf
2020-04-29 17:48:13 +00:00
..
files Set up robots.txt on lists servers 2020-04-29 17:48:13 +00:00
manifests Set up robots.txt on lists servers 2020-04-29 17:48:13 +00:00
templates status.openstack.org: send zuul link to opendev zuul 2020-04-27 09:42:11 +10:00
Gemfile Add beaker tests for openstack_project::server 2018-07-10 22:04:57 +02:00
metadata.json Update opendev git references in puppet modules 2019-04-20 18:26:07 +00:00
README Rename CI to Infra in MANY MANY places. 2012-12-16 17:30:47 +00:00

README 

This file stores config files specific to the OpenStack Infrastructure project.