hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-3397) Web UIs should provide robots.txt
Date Thu, 15 May 2008 21:40:56 GMT
Web UIs should provide robots.txt

                 Key: HADOOP-3397
                 URL: https://issues.apache.org/jira/browse/HADOOP-3397
             Project: Hadoop Core
          Issue Type: Improvement
            Reporter: Allen Wittenauer
            Priority: Trivial

There is a potential that someone might have an internal corporate crawler that goes through
HDFS browser accidentally.  It might be a good idea to provide a default robots file that
disables crawling. [No, this didn't happen to us. :) ]

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message