Return-Path: 
 <user-return-9058-apmail-hadoop-common-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-user-archive@www.apache.org
Delivered-To: apmail-hadoop-common-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id BDB66CF73
	for <apmail-hadoop-common-user-archive@www.apache.org>;
 Mon,  1 Jul 2013 06:21:34 +0000 (UTC)
Received: (qmail 6887 invoked by uid 500); 1 Jul 2013 06:21:29 -0000
Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org
Received: (qmail 6311 invoked by uid 500); 1 Jul 2013 06:21:26 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 6297 invoked by uid 99); 1 Jul 2013 06:21:25 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Jul 2013 06:21:25 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
	tests=HTML_MESSAGE,MSGID_FROM_MTA_HEADER,RCVD_IN_DNSWL_NONE
X-Spam-Check-By: apache.org
Received-SPF: error (athena.apache.org: local policy)
Received: from [65.55.111.95] (HELO blu0-omc2-s20.blu0.hotmail.com)
 (65.55.111.95)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Jul 2013 06:21:18 +0000
Received: from BLU0-SMTP36 ([65.55.111.71]) by blu0-omc2-s20.blu0.hotmail.com
 with Microsoft SMTPSVC(6.0.3790.4675);
	 Sun, 30 Jun 2013 23:20:37 -0700
X-EIP: [xPyMiYyfZnrW7H0xP3Xu4H33LoElsBsd]
X-Originating-Email: [francis.hu@reachjunction.com]
Message-ID: <BLU0-SMTP36714932AE52E72B27954797710@phx.gbl>
Received: from testPC ([14.145.188.61]) by BLU0-SMTP36.phx.gbl over TLS
 secured channel with Microsoft SMTPSVC(6.0.3790.4675);
	 Sun, 30 Jun 2013 23:20:10 -0700
From: Francis.Hu <francis.hu@reachjunction.com>
To: <user@hadoop.apache.org>
Subject: a question about dfs.replication
Date: Mon, 1 Jul 2013 14:19:31 +0800
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_NextPart_000_000F_01CE7666.257E0280"
X-Mailer: Microsoft Office Outlook 12.0
Thread-Index: Ac52IvIJJrj6xQIuShWcIsE2D0rHmw==
Content-Language: en-us
x-cr-hashedpuzzle: AuBV Awzq A6sn BOkW BrZQ B5fH Cpqe DQU7 EEDh Ex3E E9dH Fo6P
 GPWO IT0/ IdEI
 JJZI;1;dQBzAGUAcgBAAGgAYQBkAG8AbwBwAC4AYQBwAGEAYwBoAGUALgBvAHIAZwA=;Sosha1_v1;7;{51929F68-6A1C-46D3-9073-660B55D66AB1};ZgByAGEAbgBjAGkAcwAuAGgAdQBAAHIAZQBhAGMAaABqAHUAbgBjAHQAaQBvAG4ALgBjAG8AbQA=;Mon,
 01 Jul 2013 06:19:30
 GMT;YQAgAHEAdQBlAHMAdABpAG8AbgAgAGEAYgBvAHUAdAAgAGQAZgBzAC4AcgBlAHAAbABpAGMAYQB0AGkAbwBuAA==
x-cr-puzzleid: {51929F68-6A1C-46D3-9073-660B55D66AB1}
X-OriginalArrivalTime: 01 Jul 2013 06:20:34.0016 (UTC)
 FILETIME=[18131600:01CE7623]
X-Virus-Checked: Checked by ClamAV on apache.org

------=_NextPart_000_000F_01CE7666.257E0280
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit

Hi, All

 

I am installing a cluster with Hadoop 2.0.5-alpha. I have one namenode and
two datanodes. The dfs.replication is set as 2 in hdfs-site.xml. After all
configuration work is done, I started all nodes. Then I saved a file into
HDFS through java client. nOW I can access hdfs web page: x.x.x.x:50070,and
also see the file is already listed in the hdfs list.

My question is:  The replication column in HDFS web page is showing as 3,
not 2.  Does anyone know What the problem is?

 

---Actual setting of hdfs-site.xml

<property>

<name>dfs.replication</name>

<value>2</value>

</property>

 

After that, I typed dfsamdin command to check the file:

hdfs fsck /test3/

The result of above command:

/test3/hello005.txt:  Under replicated
BP-609310498-192.168.219.129-1372323727200:blk_-1069303317294683372_1006.
Target Replicas is 3 but found 2 replica(s).

Status: HEALTHY

 Total size:    35 B

 Total dirs:    1

 Total files:   1

 Total blocks (validated):      1 (avg. block size 35 B)

 Minimally replicated blocks:   1 (100.0 %)

 Over-replicated blocks:        0 (0.0 %)

 Under-replicated blocks:       1 (100.0 %)

 Mis-replicated blocks:         0 (0.0 %)

 Default replication factor:    2

 Average block replication:     2.0

 Corrupt blocks:                0

 Missing replicas:              1 (33.333332 %)

 Number of data-nodes:          3

 Number of racks:               1

FSCK ended at Sat Jun 29 16:51:37 CST 2013 in 6 milliseconds

 

 

Thanks,

Francis Hu

 


------=_NextPart_000_000F_01CE7666.257E0280
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns=3D"http://www.w3.org/TR/REC-html40">

<head>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Dus-ascii">
<meta name=3DGenerator content=3D"Microsoft Word 12 (filtered medium)">
<style>
<!--
 /* Font Definitions */
 @font-face
	{font-family:\5B8B\4F53;
	panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
	{font-family:"\@\5B8B\4F53";
	panose-1:2 1 6 0 3 1 1 1 1 1;}
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0cm;
	margin-bottom:.0001pt;
	text-align:justify;
	text-justify:inter-ideograph;
	font-size:10.5pt;
	font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:purple;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:"Calibri","sans-serif";
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;}
 /* Page Definitions */
 @page Section1
	{size:612.0pt 792.0pt;
	margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.Section1
	{page:Section1;}
-->
</style>
<!--[if gte mso 9]><xml>
 <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
 <o:shapelayout v:ext=3D"edit">
  <o:idmap v:ext=3D"edit" data=3D"1" />
 </o:shapelayout></xml><![endif]-->
</head>

<body lang=3DZH-CN link=3Dblue vlink=3Dpurple =
style=3D'text-justify-trim:punctuation'>

<div class=3DSection1>

<p class=3DMsoNormal><span lang=3DEN-US>Hi, All<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US><o:p>&nbsp;</o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US>I am installing a cluster with =
Hadoop
2.0.5-alpha. I have one namenode and two datanodes. The dfs.replication =
is <span
style=3D'background:yellow;mso-highlight:yellow'>set as 2 in =
hdfs-site.xml</span>.
After all configuration work is done, I started all nodes. Then I saved =
a file
into HDFS through java client. nOW I can access hdfs web page:
x.x.x.x:50070,and also see the file is already listed in the hdfs =
list.<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US>My question is: &nbsp;<b>The =
replication
column in HDFS web page is showing as 3, not 2. &nbsp;Does anyone know =
What the
problem is?<o:p></o:p></b></span></p>

<p class=3DMsoNormal><b><span =
lang=3DEN-US><o:p>&nbsp;</o:p></span></b></p>

<p class=3DMsoNormal><span lang=3DEN-US>---Actual setting of =
hdfs-site.xml<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&lt;property&gt;<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&lt;name&gt;dfs.replication&lt;/name&gt;<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&lt;value&gt;2&lt;/value&gt;<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&lt;/property&gt;</span><span =
lang=3DEN-US><o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US><o:p>&nbsp;</o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US>After that, I typed dfsamdin =
command to
check the file:<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US>hdfs fsck =
/test3/<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US>The result of above =
command:<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>/test3/hello005.txt:&nbsp; Under replicated
BP-609310498-192.168.219.129-1372323727200:blk_-1069303317294683372_1006.=

Target Replicas is 3 but found 2 replica(s).<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>Status: HEALTHY<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Total size:&nbsp;&nbsp;&nbsp; 35 B<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Total dirs:&nbsp;&nbsp;&nbsp; 1<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Total files:&nbsp;&nbsp; 1<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Total blocks (validated):&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1 =
(avg.
block size 35 B)<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Minimally replicated blocks:&nbsp;&nbsp; 1 (100.0 =
%)<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Over-replicated =
blocks:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
0 (0.0 %)<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Under-replicated =
blocks:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1
(100.0 %)<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Mis-replicated
blocks:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 (0.0 =
%)<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Default replication factor:&nbsp;&nbsp;&nbsp; =
2<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Average block replication:&nbsp;&nbsp;&nbsp;&nbsp; =
2.0<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Corrupt
blocks:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;
0<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Missing
replicas:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;
1 (33.333332 %)<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Number of
data-nodes:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
3<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>&nbsp;Number of
racks:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;
1<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US =
style=3D'background:yellow;mso-highlight:
yellow'>FSCK ended at Sat Jun 29 16:51:37 CST 2013 in 6 =
milliseconds</span><span
lang=3DEN-US><o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US><o:p>&nbsp;</o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US><o:p>&nbsp;</o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US>Thanks,<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US>Francis Hu<o:p></o:p></span></p>

<p class=3DMsoNormal><span lang=3DEN-US><o:p>&nbsp;</o:p></span></p>

</div>

</body>

</html>

------=_NextPart_000_000F_01CE7666.257E0280--