hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ray Chiang <rchi...@apache.org>
Subject Re: Yarn web UI shows more memory used than actual
Date Sat, 13 Aug 2016 17:44:18 GMT
The RM page will show the combined container memory usage.  If you have 
a significant difference between any or all of

1) actual process memory usage
2) JVM heap size
3) container maximum

then you will have significant memory underutilization.

-Ray

On 20160813 6:31 AM, Suresh V wrote:
> Hello,
>
> In our cluster when a MR job is running, in the 'Nodes of the cluster' 
> page, it shows the memory used as 84GB out of 87GB allocated to yarn 
> nodemanagers.
> However when I actually do a top or free command while logged in to 
> the node, it shows as only 23GB used and about 95GB or more free.
>
> I would imagine the memory used displayed in the Yarn web UI should 
> match the memory used shown by top or free command on the node.
>
> Please advise if this is right thinking or am I missing something?
>
> Thank you
> Suresh.
>
>


Mime
View raw message