opendev
/
system-config
Code Issues Proposed changes
system-config/modules/openstack_project/files
History
Clark Boylan eeac5467c3 Set up robots.txt on lists servers 
This sets up a robots.txt on our lists servers. To start this file
prevents SEMrush bot from indexing our lists as that has been causing
lists.openstack.org to OOM with many listinfo processes started by
Apache.

We've avoided this OOM by manually configuring this robots.txt. Other
things we have ruled out are bup and input email causes qrunner's to
grow unexpectedly large. Fairly confident this bot is the trigger.

Note this fixes testing by adding 'hieradata' to set listpassword var.

Depends-On: https://review.opendev.org/724389
Change-Id: Id4f6739a8cf6a01f9796fa54c86ba1af3e31fecf
 		2020-04-29 17:48:13 +00:00
..
ask ask.o.o : workaround old puppet-solr package 2019-05-20 17:25:20 +10:00
cacti Filter docker directories out of cacti 2019-08-27 15:54:49 +10:00
dashboard Puppet dashboard mysqld innodb_file_per_table. 2013-04-25 23:47:50 +00:00
git Add haproxy-statsd to haproxy server 2019-05-24 15:40:28 -07:00
logstash Ectomy some Jenkins out of the docs 2018-12-10 17:55:04 +00:00
mailman Set up robots.txt on lists servers 2020-04-29 17:48:13 +00:00
openafs Periodically release additional AFS volumes 2019-12-16 18:46:54 +11:00
pbx/asterisk Merge "Replace Wait(1) with Playback(silence/1)" 2016-03-25 13:43:43 +00:00
puppetmaster Update opendev git references in puppet modules 2019-04-20 18:26:07 +00:00
reprepro Add arm64 to reprepro updates file for UCA 2020-01-09 21:35:05 +00:00
ssl_cert_check Set up inventory and cert for Open Edge mirror 2020-03-07 00:24:20 +00:00
status Remove bugday from status.o.o 2019-05-24 14:56:50 -05:00
storyboard Switch storyboard to login.ubuntu.com 2016-12-13 11:21:35 -06:00
disallow_robots.txt Add back disallow_robots.txt 2015-05-07 09:37:57 -07:00
gem-mirror-update.sh Fixes to get gem mirror working 2016-12-23 13:22:26 -05:00
login.defs.debian Declare a non-overlapping dynamic UID/GID range 2015-01-30 21:48:52 +00:00
login.defs.redhat login.defs/redhat: set SYS_UID_MIN and SYS_GID_MIN 2016-03-03 23:33:32 -05:00
opendev.svg Rename gerrit logo file 2019-04-20 08:54:35 -07:00
openstack.png Move OpenStack branding and launchpad integration. 2012-07-23 14:46:55 -05:00
resync-hound-config.sh Fix codesearch stderr capturing 2017-12-20 16:02:38 +11:00