Jenkins c47df24295 Merge "[sitemap] respect the robots.txt policies"		2015-10-20 12:15:50 +00:00
..
spiders	[sitemap] introduce attribute to define start URLs	2015-10-16 11:22:05 +02:00
__init__.py	script to generate the sitemap.xml for docs.openstack.org	2014-05-29 01:29:18 +02:00
items.py	script to generate the sitemap.xml for docs.openstack.org	2014-05-29 01:29:18 +02:00
pipelines.py	[sitemap] resolve remaining ScrapyDeprecationWarning exceptions	2015-10-02 10:34:13 +02:00
settings.py	Merge "[sitemap] respect the robots.txt policies"	2015-10-20 12:15:50 +00:00