hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinayakumar B (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9651) All web UIs should include a robots.txt file
Date Wed, 20 Jan 2016 10:28:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108344#comment-15108344

Vinayakumar B commented on HDFS-9651:

bq. Do these files need a license header? If so I'll add one.
I think you can add them to apache-rat-plugin's exclude list. Similar to datanode/robot.txt
is added in hadoop-hdfs/pom.xml

> All web UIs should include a robots.txt file
> --------------------------------------------
>                 Key: HDFS-9651
>                 URL: https://issues.apache.org/jira/browse/HDFS-9651
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Lars Francke
>            Assignee: Lars Francke
>            Priority: Trivial
>         Attachments: HDFS-9651.1.patch
> Similar to HDFS-330. So that public UIs don't get crawled.
> I can provide a patch that includes a simple robots.txt. Another alternative is probably
a Filter that provides one automatically for all UIs but I don't have time to do that.
> If anyone wants to take over please go ahead.

This message was sent by Atlassian JIRA

View raw message