Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Wed, 14 Sep 2016 23:51:20 +0000 (UTC)
From: "Sidharta Seethana (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.12930187.1452790126000.575986.1473897080616@Atlassian.JIRA>
In-Reply-To: <JIRA.12930187.1452790126000@Atlassian.JIRA>
References: <JIRA.12930187.1452790126000@Atlassian.JIRA> <JIRA.12930187.1452790126073@arcas>
Subject: [jira] [Updated] (YARN-4591) YARN Web UIs should provide a
 robots.txt
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Wed, 14 Sep 2016 23:51:22 -0000


     [ https://issues.apache.org/jira/browse/YARN-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sidharta Seethana updated YARN-4591:
------------------------------------
    Attachment: YARN-4591.001.patch

Uploaded a patch that provides a robot.txt for all YARN web UIs that disallows crawling. Added a unit test and tested this manually with RM/NM web UIs. 

> YARN Web UIs should provide a robots.txt
> ----------------------------------------
>
>                 Key: YARN-4591
>                 URL: https://issues.apache.org/jira/browse/YARN-4591
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Lars Francke
>            Assignee: Sidharta Seethana
>            Priority: Trivial
>         Attachments: YARN-4591.001.patch
>
>
> To prevent well-behaved crawlers from indexing public YARN UIs.
> Similar to HDFS-330 / HDFS-9651.
> I took a quick look at the Webapp stuff in YARN and it looks complicated so I can't provide a quick patch. If anyone can point me in the right direction I might take a look.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org