www-infrastructure-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Henri Yandell (JIRA)" <j...@apache.org>
Subject [jira] Commented: (INFRA-2372) Produce sitemaps for services on Brutus
Date Thu, 24 Dec 2009 11:32:29 GMT

    [ https://issues.apache.org/jira/browse/INFRA-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794393#action_12794393
] 

Henri Yandell commented on INFRA-2372:
--------------------------------------

First attempt done for the JIRAs.

On Brutus:

/home/jira/sitemap/sitemaps

Assuming they look good, going live would be:

a) Switching that directory so it's being generated to http://issues.apache.org/sitemaps/
from a crontab (i.e. to the bugzilla content dir)
b) Adding "Sitemap: http://issues.apache.org/sitemaps/jira_sitemap_index.xml" to the robots.txt

That assumes that we're happy having two indexes in robots.txt. 

> Produce sitemaps for services on Brutus
> ---------------------------------------
>
>                 Key: INFRA-2372
>                 URL: https://issues.apache.org/jira/browse/INFRA-2372
>             Project: Infrastructure
>          Issue Type: Improvement
>      Security Level: public(Regular issues) 
>          Components: Bugzilla, Confluence, JIRA
>            Reporter: Paul Querna
>
> We are currently seeing a massive draw of bandwidth to brutus.apache.org, almost entirely
from Googlebot / MSNbot.
> To resolve this without blocking the robots, we should produce XML sitemaps for Bugzilla,
Confluence, and Jira.
> For BZ/Jira, it should be as simple as putting every issue into the sitemap, with a last
modified time of the last comment.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message