system-config/modules/openstack_project/manifests
Clark Boylan eeac5467c3 Set up robots.txt on lists servers
This sets up a robots.txt on our lists servers. To start this file
prevents SEMrush bot from indexing our lists as that has been causing
lists.openstack.org to OOM with many listinfo processes started by
Apache.

We've avoided this OOM by manually configuring this robots.txt. Other
things we have ruled out are bup and input email causes qrunner's to
grow unexpectedly large. Fairly confident this bot is the trigger.

Note this fixes testing by adding 'hieradata' to set listpassword var.

Depends-On: https://review.opendev.org/724389
Change-Id: Id4f6739a8cf6a01f9796fa54c86ba1af3e31fecf
2020-04-29 17:48:13 +00:00
..
storyboard Remove base.yaml things from openstack_project::server 2018-08-16 17:25:10 -05:00
afsdb.pp Pull o_p::server invocation out of afs roles 2015-04-17 09:33:10 -07:00
afsfs.pp Remove empty template class 2017-05-01 22:06:17 +02:00
afsrelease.pp Migrate AFS publishing to mirror-update.opendev.org 2020-02-11 16:14:43 +11:00
ask.pp Restart apache2 on logrotate on ask.o.o 2019-11-13 15:54:50 +00:00
ask_staging.pp Update opendev git references in puppet modules 2019-04-20 18:26:07 +00:00
backup_server.pp Use openstack_project::server class where possible 2017-04-07 21:56:17 +02:00
cacti.pp Add iptables role 2018-08-27 14:33:32 +00:00
codesearch.pp Split codesearch into its own playbook 2020-04-21 13:18:28 -05:00
eavesdrop.pp Split eavesdrop into its own playbook 2020-04-23 14:34:28 -05:00
elasticsearch_node.pp Keep only 7 days of records in ElasticSearch 2020-02-06 13:50:56 -08:00
ethercalc.pp Backup ethercalc to hostname specific location 2018-08-14 14:13:03 -07:00
firehose.pp Remove base.yaml things from openstack_project::server 2018-08-16 17:25:10 -05:00
gem_mirror.pp Added Gem Mirror to Infra 2016-12-13 20:16:19 -05:00
grafana.pp Install latest grafana 2019-03-21 13:43:02 -07:00
init.pp Fix up ssh key usage 2014-04-25 12:35:25 -07:00
kata_lists.pp Merge "Creates 'embargo-notice' list" 2018-09-27 21:54:01 +00:00
kdc.pp Make kdc03 the master kerberos kdc and admin server 2019-02-22 15:47:49 -08:00
lists.pp Set up robots.txt on lists servers 2020-04-29 17:48:13 +00:00
logstash.pp Remove graphite.openstack.org 2019-05-08 05:55:33 +10:00
logstash_worker.pp Update opendev git references in puppet modules 2019-04-20 18:26:07 +00:00
mirror.pp Mirror Ceph Nautilus for Debian based 2019-10-24 09:07:30 +11:00
mirror_update.pp Start mirroring focal, stop mirroring trusty 2020-04-17 13:40:44 -05:00
openstack_health_api.pp Set openstack-health cache_expiration to 5min 2016-05-31 15:29:00 -04:00
openstackid_dev.pp Added new param to IDP config 2020-03-25 11:32:17 -03:00
openstackid_prod.pp Openstack Id production deploy v3.0.9 2020-04-01 13:22:05 -03:00
paste.pp Pin lodgeit to the current version 2020-03-04 23:54:41 +00:00
pbx.pp Remove base.yaml things from openstack_project::server 2018-08-16 17:25:10 -05:00
planet.pp Update opendev git references in puppet modules 2019-04-20 18:26:07 +00:00
puppetmaster.pp Manage clouds.yaml files in ansible 2018-09-04 08:49:00 -07:00
reprepro.pp Skip backports for buster 2019-03-28 10:52:58 +11:00
reprepro_mirror.pp Move reprepro bits to reprepro_mirror.pp 2016-07-04 11:54:31 -04:00
server.pp Make kdc03 the master kerberos kdc and admin server 2019-02-22 15:47:49 -08:00
ssl_cert_check.pp Add ssl-cert-check to cacti server 2013-05-26 02:57:11 +00:00
status.pp Copy unminimized flot files 2020-01-28 16:41:07 -08:00
storyboard.pp Switch StoryBoard database backups to local 2018-12-06 20:30:59 +00:00
subunit_worker.pp Correct the ca-cert for mqtt on subunit worker 2017-04-25 17:41:39 -04:00
survey.pp Upgrade to LimeSurvey 3.15.6 2019-01-16 18:47:57 +00:00
translate.pp Upgrade translate.o.o to Zanata 4.3.3 2018-02-27 12:43:40 +01:00
translate_dev.pp Add iptables role 2018-08-27 14:33:32 +00:00
website.pp Use LE certs for zuul-ci.org 2020-01-07 15:25:32 -08:00
wiki.pp Merge "Manage the favicon.ico file for the wiki" 2018-12-17 16:36:32 +00:00