www-infrastructure-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Henri Yandell (JIRA)" <j...@apache.org>
Subject [jira] Commented: (INFRA-2372) Produce sitemaps for services on Brutus
Date Wed, 30 Dec 2009 09:01:30 GMT

    [ https://issues.apache.org/jira/browse/INFRA-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795260#action_12795260
] 

Henri Yandell commented on INFRA-2372:
--------------------------------------

Total: 187,812, Indexed: 131,583

sitemaps/sitemap_activemq_1.xml.gz  	OK 	Sitemap 	Dec 30, 2009 	8,252 	7,857
sitemaps/sitemap_bugs.xml.gz 	OK 	Sitemap 	Dec 29, 2009 	31,955 	12,347
sitemaps/sitemap_jira_1.xml.gz 	OK 	Sitemap 	Dec 29, 2009 	50,000 	32,110
sitemaps/sitemap_jira_2.xml.gz 	OK 	Sitemap 	Dec 29, 2009 	50,000 	39,346
sitemaps/sitemap_jira_3.xml.gz 	OK 	Sitemap 	Dec 29, 2009 	33,634 	30,583
sitemaps/sitemap_sabugs.xml.gz 	OK 	Sitemap 	Dec 29, 2009 	6,266 	3,624
sitemaps/sitemap_struts_1.xml.gz 	OK 	Sitemap 	Dec 29, 2009 	7,705 	5,716

Mark had suggested that he felt the non-indexed items were the older ones - I think this makes
sense. If you view the main JIRA sitemaps, the %age covered goes up as they get newer.

> Produce sitemaps for services on Brutus
> ---------------------------------------
>
>                 Key: INFRA-2372
>                 URL: https://issues.apache.org/jira/browse/INFRA-2372
>             Project: Infrastructure
>          Issue Type: Improvement
>      Security Level: public(Regular issues) 
>          Components: Bugzilla, Confluence, JIRA
>            Reporter: Paul Querna
>
> We are currently seeing a massive draw of bandwidth to brutus.apache.org, almost entirely
from Googlebot / MSNbot.
> To resolve this without blocking the robots, we should produce XML sitemaps for Bugzilla,
Confluence, and Jira.
> For BZ/Jira, it should be as simple as putting every issue into the sitemap, with a last
modified time of the last comment.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message