hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2448) RM should expose the name of the ResourceCalculator being used when AMs register
Date Mon, 25 Aug 2014 19:31:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-2448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14109603#comment-14109603
] 

Karthik Kambatla commented on YARN-2448:
----------------------------------------

May be I am missing your point. Why not have the MR AM request both CPU and memory? If the
RM/scheduler doesn't consider CPU, it will just ignore it. 

Related, but orthogonal point: In the case of FairScheduler, the policy depends on the queue
the app is submitted to. So, some queues might consider only CPU, some only memory, and some
both. So, exposing the ResourceCalculator doesn't really tell the AM anything, it has to look
at the queue configuration. 

> RM should expose the name of the ResourceCalculator being used when AMs register
> --------------------------------------------------------------------------------
>
>                 Key: YARN-2448
>                 URL: https://issues.apache.org/jira/browse/YARN-2448
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Varun Vasudev
>            Assignee: Varun Vasudev
>         Attachments: apache-yarn-2448.0.patch, apache-yarn-2448.1.patch
>
>
> The RM should expose the name of the ResourceCalculator being used when AMs register,
as part of the RegisterApplicationMasterResponse.
> This will allow applications to make better decisions when scheduling. MapReduce for
example, only looks at memory when deciding it's scheduling, even though the RM could potentially
be using the DominantResourceCalculator.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message