Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: core-dev@hadoop.apache.org
Received-SPF: neutral (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns;
	h=received:user-agent:date:subject:from:to:message-id:
	thread-topic:thread-index:in-reply-to:mime-version:content-type:
	content-transfer-encoding:return-path:x-originalarrivaltime;
	b=QEFWWJi1Yf6PmgymFfWWhoVyiO2htMYZKFjvssK90JXzQt0AeC44s9I1kKRlDXy5
User-Agent: Microsoft-Entourage/12.15.0.081119
Date: Wed, 11 Feb 2009 10:16:20 -0800
Subject: Re: adding replication status to dfshealth.jsp
From: Hairong Kuang <hairong@yahoo-inc.com>
To: hadoop-dev <core-dev@hadoop.apache.org>
Message-ID: <C5B855F4.F810%hairong@yahoo-inc.com>
Thread-Topic: adding replication status to dfshealth.jsp
Thread-Index: AcmMdNaGnNbsBSFZLU6RCAQYldcYHQ==
In-Reply-To: <3b5f72030902110918v730992c0o828ad90757a942b2@mail.gmail.com>
Mime-version: 1.0
Content-type: text/plain;
	charset="US-ASCII"
Content-transfer-encoding: 7bit

It's available in 0.18. Remember that the file is saved at NameNode side. It
took me a while for me to figure out where the file was the first time I
used this tool.

Hairong


On 2/11/09 9:18 AM, "Bill Au" <bill.w.au@gmail.com> wrote:

> Thanks for the info.  What version(s) is "-metaSave" available for?  I am
> running 0.18.2 and it doesn't work there.
> 
> Bill
> 
> On Tue, Feb 10, 2009 at 9:04 PM, Raghu Angadi <rangadi@yahoo-inc.com> wrote:
> 
>> 
>> one more thing I forgot :
>> 
>> Another useful tool is 'bin/hadoop dfsadmin -metaSave'
>> 
>> This lists all the blocks that are under replicated. This is not very
>> official and not used much. It needs to be more user friendly (currently it
>> writes to a file on the NameNode)... I might improve (and/or rename) it as a
>> follow up to HADOOP-4103.
>> 
>> Stats like dfs.FSNamesystem.UnderReplicatedBlocks that Brain mentioned are
>> useful to find if there is some problem. And the commands like the one above
>> help in finding which specific blocks are in these states.
>> 
>> Raghu.
>> 
>> 
>> 
>> Bill Au wrote:
>> 
>>> I am in the process of setting up remote monitoring of my Hadoop cluster.
>>>  I
>>> seems to me that the replication status can only be obtained from the
>>> command line by the fsck command.  Has anyone though about adding
>>> replication status to the NameNode web UI in dfshealth.jsp?  Or is that
>>> something that I really shouldn't worry about since Hadoop will fix things
>>> all by itself?
>>> 
>>> Bill
>>> 
>>> 
>>