hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-285) RM should be able to provide a tracking link for apps that have already been purged
Date Fri, 21 Dec 2012 23:07:14 GMT

    [ https://issues.apache.org/jira/browse/YARN-285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13538515#comment-13538515
] 

Vinod Kumar Vavilapalli commented on YARN-285:
----------------------------------------------

Meta comment. We need this only as a temporary solution, this isn't a long term fix. Can you
please file a follow up to fix the real issue. That may be blocked on ApplicationHistoryServer
but let's file it anyways.

Looks good overall. The MR specific plugin at MAPREDUCE-4899 will need to load mapred-site.xml
to read the correct history server address, so you may need to override setConf() in that
plugin to also load mapred-site.xml.

                
> RM should be able to provide a tracking link for apps that have already been purged
> -----------------------------------------------------------------------------------
>
>                 Key: YARN-285
>                 URL: https://issues.apache.org/jira/browse/YARN-285
>             Project: Hadoop YARN
>          Issue Type: Improvement
>    Affects Versions: 3.0.0, 0.23.5
>            Reporter: Derek Dagit
>            Assignee: Derek Dagit
>         Attachments: YARN-285-branch-0.23.patch, YARN-285-branch-0.23.patch, YARN-285-branch-0.23.patch,
YARN-285.patch, YARN-285.patch, YARN-285.patch
>
>
> As applications complete, the RM tracks their IDs in a completed list.  This list is
routinely truncated to limit the total number of application remembered by the RM.
> When a user clicks the History for a job, either the browser is redirected to the application's
tracking link obtained from the stored application instance.  But when the application has
been purged from the RM, an error is displayed.
> In very busy clusters the rate at which applications complete can cause applications
to be purged from the RM's internal list within hours, which breaks the proxy URLs users have
saved for their jobs.
> We would like the RM to provide valid tracking links persist so that users are not frustrated
by broken links.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message