hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandy Ryza (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-782) vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way
Date Tue, 11 Jun 2013 01:01:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13680109#comment-13680109
] 

Sandy Ryza commented on YARN-782:
---------------------------------

My opinion is that it would be best to remove the property altogether, as it's an unnecessary
layer of indirection.  Will upload a patch that does this.
                
> vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way 
> ---------------------------------------------------------------------------------
>
>                 Key: YARN-782
>                 URL: https://issues.apache.org/jira/browse/YARN-782
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager
>    Affects Versions: 2.0.4-alpha
>            Reporter: Sandy Ryza
>            Assignee: Sandy Ryza
>            Priority: Critical
>         Attachments: YARN-782.patch
>
>
> The vcores-pcores ratio functions differently from the vmem-pmem ratio in the sense that
the vcores-pcores ratio has an impact on allocations and the vmem-pmem ratio does not.
> If I double my vmem-pmem ratio, the only change that occurs is that my containers, after
being scheduled, are less likely to be killed for using too much virtual memory.  But if I
double my vcore-pcore ratio, my nodes will appear to the ResourceManager to contain double
the amount of CPU space, which will affect scheduling decisions.
> The lack of consistency will exacerbate the already difficult problem of resource configuration.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message