Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of silvianhadoop@gmail.com
 designates 209.85.217.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAOcnVr2S_9qybqKUSDdehwL2hsLmswLSWE7NZDoUc=o-V9c-eQ@mail.gmail.com>
References: 
 <CAMWNowF_wd3zZSqKghLUWZocqSwnN4FgoVXQ5WY_vP3Siu4J+Q@mail.gmail.com>
	<CAOcnVr2S_9qybqKUSDdehwL2hsLmswLSWE7NZDoUc=o-V9c-eQ@mail.gmail.com>
Date: Fri, 12 Oct 2012 09:26:57 -0700
Message-ID: 
 <CAMWNowEJiL-g3iKwoS3ZnEgv_ui2K2JJ4Cpr9oRUYYiMXHEu1w@mail.gmail.com>
Subject: Re: Used Heap in Namenode & dfs.replication
From: Patai Sangbutsarakum <silvianhadoop@gmail.com>
To: user@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1

Thanks Harsh.

This is from webui
14591213 files and directories, 16191821 blocks = 30783034 total. Heap
Size is 9.3 GB / 34.72 GB (26%)

this is from jmx
"name": "java.lang:type=Memory",
"modelerType": "sun.management.MemoryImpl",
"Verbose": false,
"HeapMemoryUsage": {

    "committed": 24427036672,
    "init": 791179584,
    "max": 37282709504,
    "used": 21456071792

},

I'm hoping that i'm thinking if i looked at the right spot in the jmx page.
I put Xmx 40G but in jmx it said 37 ish G


Thanks

On Fri, Oct 12, 2012 at 9:03 AM, Harsh J <harsh@cloudera.com> wrote:
> Apache Hadoop 0.20.2 may not have accurate heap usage report on that
> web UI. See https://issues.apache.org/jira/browse/HDFS-94 for the fix
> we had to do. You may measure actual usage via either jmap -histo:live
> or via http://NNWebUI:PORT/jmx if thats available (shows some JVM
> metrics you can consume).
>
> On Fri, Oct 12, 2012 at 12:03 AM, Patai Sangbutsarakum
> <silvianhadoop@gmail.com> wrote:
>> Hi Hadoopers,
>>
>> I am looking at DFS' cluster summary.
>>
>> "14708427 files and directories, 16357951 blocks = 31066378 total"
>>
>> From White's book (2nd Edition) page 42. "As a rule of thumb, each
>> file, directory, and block takes about 150bytes".
>>
>> So, 31066378 * 150 byte => 4.34 GB
>>
>> The rest of the line is  Heap Size is 12.17 GB / 34.72 GB
>>
>> 12.17 vs. 4.34 is like 3 time bigger number. is that because of
>> replication of 3 ?
>>
>> Thanks
>> Patai
>>
>> I am on 0.20.2
>
>
>
> --
> Harsh J