hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hitesh Shah (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities
Date Fri, 17 May 2013 16:41:16 GMT

    [ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13660840#comment-13660840
] 

Hitesh Shah commented on YARN-689:
----------------------------------

The assumption you seem to be making is that all applications will require the same minimum
headroom. This "may" be the case with all MR jobs but need not be true for other applications
running on the same cluster. This could be solved by just setting minimum allocation to 512
MB. 
                
> Add multiplier unit to resourcecapabilities
> -------------------------------------------
>
>                 Key: YARN-689
>                 URL: https://issues.apache.org/jira/browse/YARN-689
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: api, scheduler
>    Affects Versions: 2.0.4-alpha
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: YARN-689.patch
>
>
> Currently we overloading the minimum resource value as the actual multiplier used by
the scheduler.
> Today with a minimum memory set to 1GB, requests for 1.5GB are always translated to allocation
of 2GB.
> We should decouple the minimum allocation from the multiplier.
> The multiplier should also be exposed to the client via the RegisterApplicationMasterResponse

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message