hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naganarasimha G R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3758) The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working as expected in FairScheduler
Date Thu, 04 Jun 2015 12:12:39 GMT

    [ https://issues.apache.org/jira/browse/YARN-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14572657#comment-14572657
] 

Naganarasimha G R commented on YARN-3758:
-----------------------------------------

Hi [~rohithsharma] This issue is similar to the issue raised in YARN-3525, I feel if {{yarn.scheduler.minimum-allocation-mb}}
is specific to capacity then better change it to {{yarn.scheduler.capacity.minimum-allocation-mb}}
similar to the suggestion in YARN-3525. So that there is less confusion. Thoughts ?

> The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working as expected
in FairScheduler
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-3758
>                 URL: https://issues.apache.org/jira/browse/YARN-3758
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.4.0
>            Reporter: skrho
>
> Hello there~~
> I have 2 clusters
> First cluster is 5 node , default 1 application queue, Capacity scheduler, 8G Physical
memory each node
> Second cluster is 10 node, 2 application queuey, fair-scheduler, 230G Physical memory
each node
> Wherever a mapreduce job is running, I want resourcemanager is to set the minimum memory
 256m to container
> So I was changing configuration in yarn-site.xml & mapred-site.xml
> yarn.scheduler.minimum-allocation-mb : 256
> mapreduce.map.java.opts : -Xms256m 
> mapreduce.reduce.java.opts : -Xms256m 
> mapreduce.map.memory.mb : 256 
> mapreduce.reduce.memory.mb : 256 
> In First cluster  whenever a mapreduce job is running , I can see used memory 256m in
web console( http://installedIP:8088/cluster/nodes )
> But In Second cluster whenever a mapreduce job is running , I can see used memory 1024m
in web console( http://installedIP:8088/cluster/nodes ) 
> I know default memory value is 1024m, so if there is not changing memory setting, the
default value is working.
> I have been testing for two weeks, but I don't know why mimimum memory setting is not
working in second cluster
> Why this difference is happened? 
> Am I wrong setting configuration?
> or Is there bug?
> Thank you for reading~~



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message