system-config/modules/openstack_project/files/disallow_robots.txt
James E. Blair 1875a89e4b Add robots.txt for logs and docs-draft.
Indexing build logs isn't particularly useful though it's a lot of data.
And indexing draft documentation is actually counter productive
(since it might be wrong).  So adopt a robots.txt for both vhosts.

Change-Id: I8a61a0e7dacb96b26217d31a89a6ae94d9c5f62e
Reviewed-on: https://review.openstack.org/18265
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2012-12-20 00:14:02 +00:00

3 lines
26 B
Plaintext

User-agent: *
Disallow: /