hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandy Ryza (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-782) vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way
Date Fri, 07 Jun 2013 02:26:20 GMT

     [ https://issues.apache.org/jira/browse/YARN-782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sandy Ryza updated YARN-782:
----------------------------

    Description: 
The vcores-pcores ratio functions differently from the vmem-pmem ratio in the sense that the
vcores-pcores ratio has an impact on allocations and the vmem-pmem ratio does not.

If I double my vmem-pmem ratio, the only change that occurs is that my containers, after being
scheduled, are less likely to be killed for using too much virtual memory.  But if I double
my vcore-pcore ratio, my nodes will appear to the ResourceManager to contain double the amount
of CPU space, which will affect scheduling decisions.

The lack of consistency will exacerbate the fundamentally difficult problem of resource configuration.


  was:
The vcores-pcores ratio functions differently from the vmem-pmem ratio in the sense that the
vcores-pcores ratio has an impact on allocations and the vmem-pmem ratio does not.

If I double my vmem-pmem ratio, the only change that occurs is that my already-scheduled containers
are less likely to be killed for using too much virtual memory.  But if I double my vcore-pcore
ratio, my nodes will appear to the ResourceManager to contain double the amount of CPU space,
which will affect scheduling decisions.

The lack of consistency will exacerbate the fundamentally difficult problem of resource configuration.


    
> vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way 
> ---------------------------------------------------------------------------------
>
>                 Key: YARN-782
>                 URL: https://issues.apache.org/jira/browse/YARN-782
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager
>    Affects Versions: 2.0.4-alpha
>            Reporter: Sandy Ryza
>            Assignee: Sandy Ryza
>            Priority: Critical
>
> The vcores-pcores ratio functions differently from the vmem-pmem ratio in the sense that
the vcores-pcores ratio has an impact on allocations and the vmem-pmem ratio does not.
> If I double my vmem-pmem ratio, the only change that occurs is that my containers, after
being scheduled, are less likely to be killed for using too much virtual memory.  But if I
double my vcore-pcore ratio, my nodes will appear to the ResourceManager to contain double
the amount of CPU space, which will affect scheduling decisions.
> The lack of consistency will exacerbate the fundamentally difficult problem of resource
configuration.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message