hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted <r6squee...@gmail.com>
Subject Re: Child JVM memory allocation / Usage
Date Mon, 25 Mar 2013 01:27:46 GMT
did you set the min heap size == your max head size? if you didn't,
free memory only shows you the difference between used and commit, not
used and max.

On 3/24/13, nagarjuna kanamarlapudi <nagarjuna.kanamarlapudi@gmail.com> wrote:
> Hi,
>
> I configured  my child jvm heap to 2 GB. So, I thought I could really read
> 1.5GB of data and store it in memory (mapper/reducer).
>
> I wanted to confirm the same and wrote the following piece of code in the
> configure method of mapper.
>
> @Override
>
> public void configure(JobConf job) {
>
> System.out.println("FREE MEMORY -- "
>
> + Runtime.getRuntime().freeMemory());
>
> System.out.println("MAX MEMORY ---" + Runtime.getRuntime().maxMemory());
>
> }
>
>
> Surprisingly the output was
>
>
> FREE MEMORY -- 341854864  = 320 MB
> MAX MEMORY ---1908932608  = 1.9 GB
>
>
> I am just wondering what processes are taking up that extra 1.6GB of
> heap which I configured for the child jvm heap.
>
>
> Appreciate in helping me understand the scenario.
>
>
>
> Regards
>
> Nagarjuna K
>


-- 
Ted.

Mime
View raw message