[ https://issues.apache.org/jira/browse/HADOOP-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Wittenauer updated HADOOP-3397:
-------------------------------------
Component/s: dfs
Affects Version/s: 0.16.4
> Web UIs should provide robots.txt
> ---------------------------------
>
> Key: HADOOP-3397
> URL: https://issues.apache.org/jira/browse/HADOOP-3397
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.16.4
> Reporter: Allen Wittenauer
> Priority: Trivial
>
> There is a potential issue that someone might have an internal corporate crawler that
goes through HDFS browser accidentally. It might be a good idea to provide a default robots
file that disables crawling. [No, this didn't happen to us. :) ]
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
|