Remove Icehouse and Juno content from sitemap

Icehouse and Juno docs should not be accesed, so this updates the sitemap
generator tool to skip them. The sitemap can then be regenerated.

Partial-Bug: #1602647
Change-Id: I3117b114881c3a12b6a1a9565a0a720c9c8678b1
This commit is contained in:
Rebecca Finn 2016-07-14 16:35:38 +00:00
parent 03ee136c9d
commit ad80212a90
1 changed files with 3 additions and 1 deletions

View File

@ -48,7 +48,9 @@ class SitemapSpider(spiders.CrawlSpider):
deny=[
r'/trunk/',
r'/draft/',
r'/api/'
r'/api/',
r'/juno/',
r'/icehouse/'
]
),
follow=True, callback='parse_item'