Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of stutiawasthi@hcl.com designates
 203.105.185.23 as permitted sender)
From: Stuti Awasthi <stutiawasthi@hcl.com>
To: "hdfs-user@hadoop.apache.org" <hdfs-user@hadoop.apache.org>
Date: Mon, 17 Oct 2011 11:51:34 +0530
Subject: Missing Replicas and Under replicated blocks
Thread-Topic: Missing Replicas and Under replicated blocks
Thread-Index: AcyMlAOm0IljiXy9RyiEVoVzJJD3fg==
Message-ID: 
 <7D9AF4B98807C54EBADEA75DF6D5ACB77FF3FF34@NDA-HCLC-EVS04.HCLC.CORP.HCL.IN>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Hi ,

I have a mini Hadoop cluster of 3 nodes with  DN and TT running on each nod=
e and replication is set to 3.By mistake I tried to write few files which r=
equires replication of 10. When I checked the HDFS status with FSCK utility=
 it shows :

/root/Hadoop/hadoop-root/mapred/system/job_201109201112_0001/job.jar 235284=
1 bytes, 1 block(s):  Under replicated blk_-9220069752024407718_1546. Targe=
t Replicas is 10 but found 3 replica(s).
0. blk_-9220069752024407718_1546 len=3D2352841 repl=3D3 [10.33.100.74:50010=
, 10.33.64.235:50010, 10.33.100.117:50010]

/root/Hadoop/hadoop-root/mapred/system/job_201109201112_0001/libjars <dir>
/root/Hadoop/hadoop-root/mapred/system/job_201109201112_0001/libjars/hadoop=
-0.20.2-core.jar 2707856 bytes, 1 block(s):  Under replicated blk_-47918593=
36845413240_1544. Target Replicas is 10 but found 3 replica(s).
0. blk_-4791859336845413240_1544 len=3D2707856 repl=3D3 [10.33.100.74:50010=
, 10.33.64.235:50010, 10.33.100.117:50010]
....................................................
Status: HEALTHY
 Total size:    45239704 B
 Total dirs:    101
 Total files:   88 (Files currently being written: 3)
 Total blocks (validated):      88 (avg. block size 514087 B) (Total open f=
ile blocks (not validated): 3)
 Minimally replicated blocks:   88 (100.0 %)
 Over-replicated blocks:        0 (0.0 %)
 Under-replicated blocks:       20 (22.727272 %)
 Mis-replicated blocks:         0 (0.0 %)
 Default replication factor:    2
 Average block replication:     2.4318182
 Corrupt blocks:                0
 Missing replicas:              140 (65.42056 %)
 Number of data-nodes:          3
 Number of racks:               1

I wanted to know that can I fix :
        1.     Under-replicated
        2.     Missing replicas

Please Suggest
Thanks
Stuti

::DISCLAIMER::
---------------------------------------------------------------------------=
--------------------------------------------

The contents of this e-mail and any attachment(s) are confidential and inte=
nded for the named recipient(s) only.
It shall not attach any liability on the originator or HCL or its affiliate=
s. Any views or opinions presented in
this email are solely those of the author and may not necessarily reflect t=
he opinions of HCL or its affiliates.
Any form of reproduction, dissemination, copying, disclosure, modification,=
 distribution and / or publication of
this message without the prior written consent of the author of this e-mail=
 is strictly prohibited. If you have
received this email in error please delete it and notify the sender immedia=
tely. Before opening any mail and
attachments please check them for viruses and defect.

---------------------------------------------------------------------------=
--------------------------------------------