hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandy Ryza (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-782) vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way
Date Fri, 07 Jun 2013 02:24:20 GMT
Sandy Ryza created YARN-782:
-------------------------------

             Summary: vcores-pcores ratio functions differently from vmem-pmem ratio in misleading
way 
                 Key: YARN-782
                 URL: https://issues.apache.org/jira/browse/YARN-782
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: nodemanager
    Affects Versions: 2.0.4-alpha
            Reporter: Sandy Ryza
            Assignee: Sandy Ryza
            Priority: Critical


The vcores-pcores ratio functions differently from the vmem-pmem ratio in the sense that the
vcores-pcores ratio has an impact on allocations and the vmem-pmem ratio does not.

If I double my vmem-pmem ratio, the only change that occurs is that my already-scheduled containers
are less likely to be killed for using too much virtual memory.  But if I double my vcore-pcore
ratio, my nodes will appear to the ResourceManager to contain double the amount of CPU space,
which will affect scheduling decisions.

The lack of consistency will exacerbate the fundamentally difficult problem of resource configuration.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message