Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of maheswara@huawei.com designates
 206.16.17.211 as permitted sender)
Date: Mon, 17 Oct 2011 11:36:47 +0500
From: Uma Maheswara Rao G 72686 <maheswara@huawei.com>
Subject: Re: Missing Replicas and Under replicated blocks
In-reply-to: 
 <7D9AF4B98807C54EBADEA75DF6D5ACB77FF3FF34@NDA-HCLC-EVS04.HCLC.CORP.HCL.IN>
To: hdfs-user@hadoop.apache.org
Cc: "hdfs-user@hadoop.apache.org" <hdfs-user@hadoop.apache.org>
Message-id: <fe8cb2981ff1.1ff1fe8cb298@huawei.com>
MIME-version: 1.0
Content-type: text/plain; charset=us-ascii
Content-language: en
Content-transfer-encoding: 7BIT
Content-disposition: inline
Priority: normal
References: 
 <7D9AF4B98807C54EBADEA75DF6D5ACB77FF3FF34@NDA-HCLC-EVS04.HCLC.CORP.HCL.IN>

Hi Stuti,
You can set the replication factor to 3. So, that it can satisfy 100% replication with it.

 You can use FileSystem#setReplication API for setting it.

Regards,
Uma
----- Original Message -----
From: Stuti Awasthi <stutiawasthi@hcl.com>
Date: Monday, October 17, 2011 11:52 am
Subject: Missing Replicas and Under replicated blocks
To: "hdfs-user@hadoop.apache.org" <hdfs-user@hadoop.apache.org>

> Hi ,
> 
> I have a mini Hadoop cluster of 3 nodes with  DN and TT running on 
> each node and replication is set to 3.By mistake I tried to write 
> few files which requires replication of 10. When I checked the 
> HDFS status with FSCK utility it shows :
> 
> /root/Hadoop/hadoop-
> root/mapred/system/job_201109201112_0001/job.jar 2352841 bytes, 1 
> block(s):  Under replicated blk_-9220069752024407718_1546. Target 
> Replicas is 10 but found 3 replica(s).
> 0. blk_-9220069752024407718_1546 len=2352841 repl=3 
> [10.33.100.74:50010, 10.33.64.235:50010, 10.33.100.117:50010]
> 
> /root/Hadoop/hadoop-
> root/mapred/system/job_201109201112_0001/libjars <dir>
> /root/Hadoop/hadoop-
> root/mapred/system/job_201109201112_0001/libjars/hadoop-0.20.2-
> core.jar 2707856 bytes, 1 block(s):  Under replicated blk_-
> 4791859336845413240_1544. Target Replicas is 10 but found 3 
> replica(s).0. blk_-4791859336845413240_1544 len=2707856 repl=3 
> [10.33.100.74:50010, 10.33.64.235:50010, 10.33.100.117:50010]
> ....................................................
> Status: HEALTHY
> Total size:    45239704 B
> Total dirs:    101
> Total files:   88 (Files currently being written: 3)
> Total blocks (validated):      88 (avg. block size 514087 B) 
> (Total open file blocks (not validated): 3)
> Minimally replicated blocks:   88 (100.0 %)
> Over-replicated blocks:        0 (0.0 %)
> Under-replicated blocks:       20 (22.727272 %)
> Mis-replicated blocks:         0 (0.0 %)
> Default replication factor:    2
> Average block replication:     2.4318182
> Corrupt blocks:                0
> Missing replicas:              140 (65.42056 %)
> Number of data-nodes:          3
> Number of racks:               1
> 
> I wanted to know that can I fix :
>        1.     Under-replicated
>        2.     Missing replicas
> 
> Please Suggest
> Thanks
> Stuti
> 
> ::DISCLAIMER::
> -------------------------------------------------------------------
> ----------------------------------------------------
> 
> The contents of this e-mail and any attachment(s) are confidential 
> and intended for the named recipient(s) only.
> It shall not attach any liability on the originator or HCL or its 
> affiliates. Any views or opinions presented in
> this email are solely those of the author and may not necessarily 
> reflect the opinions of HCL or its affiliates.
> Any form of reproduction, dissemination, copying, disclosure, 
> modification, distribution and / or publication of
> this message without the prior written consent of the author of 
> this e-mail is strictly prohibited. If you have
> received this email in error please delete it and notify the 
> sender immediately. Before opening any mail and
> attachments please check them for viruses and defect.
> 
> -------------------------------------------------------------------
> ----------------------------------------------------
>