hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-256) Increase retention of applications in AppManager without sending more applications to the UI
Date Tue, 04 Dec 2012 05:47:58 GMT

    [ https://issues.apache.org/jira/browse/YARN-256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13509526#comment-13509526
] 

Vinod Kumar Vavilapalli commented on YARN-256:
----------------------------------------------

I totally understand the issue at hand, but did we investigate how hard it is do the UI change
to not load all the applications? May be that is the first issue to fix? Once we can fix that,
increasing max-completed apps is an obvious solution.

Completed applications are explicitly managed by RMAppManager. That was always a short term
solution, the long term one being MAPREDUCE-3061.
                
> Increase retention of applications in AppManager without sending more applications to
the UI
> --------------------------------------------------------------------------------------------
>
>                 Key: YARN-256
>                 URL: https://issues.apache.org/jira/browse/YARN-256
>             Project: Hadoop YARN
>          Issue Type: Improvement
>    Affects Versions: 0.23.5
>            Reporter: Derek Dagit
>            Assignee: Derek Dagit
>
> In very busy clusters we would like to retain applications longer so that users' links
will not expire too soon.  Very often links to application history expire before they can
be followed.
> Simply increasing max-completed applications has an adverse performance impact on the
applications list in the web UI because it presents the entire list of applications with a
request.
> Therefore, we would like some way to be able to increase the retention of applications
without increasing the number of applications sent to the Web UI.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message