Add robots.txt

Use same setup as on docs.openstack.org to exclude draft content.

Change-Id: Ied68f5f357a110fe5411ca28831d5a113314eacf
This commit is contained in:
Andreas Jaeger 2015-04-25 15:40:38 +02:00
parent bafd7ef618
commit 7509562ac8

7
www/robots.txt Normal file
View File

@ -0,0 +1,7 @@
# openstack-manuals/www/robots.txt
User-agent: Googlebot
Disallow: /*.pdf$
# Keep OpenStack users from accidentally using docs for the upcoming release
User-agent: *
Disallow: /draft/