Remove Icehouse and Juno content from sitemap
Icehouse and Juno docs should not be accesed, so this updates the sitemap generator tool to skip them. The sitemap can then be regenerated. Partial-Bug: #1602647 Change-Id: I3117b114881c3a12b6a1a9565a0a720c9c8678b1
This commit is contained in:
parent
03ee136c9d
commit
ad80212a90
|
@ -48,7 +48,9 @@ class SitemapSpider(spiders.CrawlSpider):
|
|||
deny=[
|
||||
r'/trunk/',
|
||||
r'/draft/',
|
||||
r'/api/'
|
||||
r'/api/',
|
||||
r'/juno/',
|
||||
r'/icehouse/'
|
||||
]
|
||||
),
|
||||
follow=True, callback='parse_item'
|
||||
|
|
Loading…
Reference in New Issue