Return-Path: 
 <user-return-6087-apmail-hadoop-hdfs-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id CF42FDEA2
	for <apmail-hadoop-hdfs-user-archive@minotaur.apache.org>;
 Sun, 17 Mar 2013 13:13:48 +0000 (UTC)
Received: (qmail 23960 invoked by uid 500); 17 Mar 2013 13:13:43 -0000
Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org
Received: (qmail 23807 invoked by uid 500); 17 Mar 2013 13:13:43 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 23794 invoked by uid 99); 17 Mar 2013 13:13:43 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 17 Mar 2013 13:13:43 +0000
X-ASF-Spam-Status: No, hits=1.7 required=5.0
	tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of bugcy013@gmail.com designates
 209.85.220.179 as permitted sender)
Received: from [209.85.220.179] (HELO mail-vc0-f179.google.com)
 (209.85.220.179)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 17 Mar 2013 13:13:37 +0000
Received: by mail-vc0-f179.google.com with SMTP id gf12so2284683vcb.24
        for <user@hadoop.apache.org>; Sun, 17 Mar 2013 06:13:16 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=x-received:mime-version:from:date:message-id:subject:to
         :content-type;
        bh=F7LvaxMAdxWmE7VmlJ6B/Z3X43+tPCKCLvODGLlVOcE=;
        b=bbhBxn5DgZp7f0Cm5zF7xXXEu90Bh5YnUggBhukDDdmIA25djiAkDBeIqLU0TD4vCG
         0t/Xd2CRKFTgoiDhBKcqjS/F22XT4ssWcoveVDkjPxxUtfc+BVw2du3rsHjR9jBI5e8n
         B0Os8zQHjatmH6DPvw7EpsDJcwThR1iheSX+AXwv5MTBXD88FrEptpGKGKrM3W2HKkxe
         xtwHWAXKpnEuNGQB2ZfcDDbjYwd1vT7aYZu5jpgFU8zChPswO6B1/mIFHZ9+k+wLOtQh
         cHFT3zcLZBHIwfjOm/72cPjWR0Iz4RrWyyyJmIiINeqJNM8NQEmfXy01cYT/kwmmC8Li
         d3Sw==
X-Received: by 10.52.98.5 with SMTP id ee5mr13257022vdb.102.1363525996368;
 Sun, 17 Mar 2013 06:13:16 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.58.207.69 with HTTP; Sun, 17 Mar 2013 06:12:56 -0700 (PDT)
From: Dhanasekaran Anbalagan <bugcy013@gmail.com>
Date: Sun, 17 Mar 2013 18:42:56 +0530
Message-ID: 
 <CAJzooYe+SxBv2LNzaCNtVu5hzYXx6AKdVnLvC_zaq-g5HHHorQ@mail.gmail.com>
Subject: Understand dfs.datanode.max.xcievers
To: cdh-user <cdh-user@cloudera.org>, user <user@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=20cf307f34a6a7dd6804d81ea22a
X-Virus-Checked: Checked by ClamAV on apache.org

--20cf307f34a6a7dd6804d81ea22a
Content-Type: text/plain; charset=UTF-8

Hi Guys,

We are having few data nodes in an inconsistent state.  frequently goes
dead state. Because of DataXceiver Error

In console we seen the Error.
*INFO hdfs.DFSClient: Could not obtain block*
blk_XXXXXXXXXXXXXXXXXXXXXX_YYYYYYYY from any node: java.io.IOException:

currently we have this value.
dfs.datanode.max.xcievers, dfs.datanode.max.transfer.threads = 4096

currently monitering our cluster JVM monitoring using openNMS,
http://i.imgur.com/E1u0fev.png

Not at all hit 4096 value this value for this week . But frequently
the particular node goes dead state why? log says DataXceiver Error.


 dfs.datanode.max.xcievers value set to the particular node or across the
cluster Please guide me.

-Dhanasekaran.




Did I learn something today? If not, I wasted it.

--20cf307f34a6a7dd6804d81ea22a
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div style><span style=3D"color:rgb(17,17,17);font-family:=
&#39;Lucida Sans&#39;,&#39;Lucida Grande&#39;,&#39;Lucida Sans Unicode&#39;=
,Arial,sans-serif;font-size:12px;line-height:16px;background-color:rgb(255,=
255,255)">Hi Guys,</span></div>

<div style><span style=3D"color:rgb(17,17,17);font-family:&#39;Lucida Sans&=
#39;,&#39;Lucida Grande&#39;,&#39;Lucida Sans Unicode&#39;,Arial,sans-serif=
;font-size:12px;line-height:16px;background-color:rgb(232,241,247)"><br>
</span></div>
<div style><span style=3D"font-size:13px;font-family:arial,sans-serif">We a=
re having few data nodes</span><span style=3D"font-size:13px;font-family:ar=
ial,sans-serif">=C2=A0in an inconsistent state. =C2=A0frequently goes dead =
state.=C2=A0</span><span style=3D"font-size:13px;font-family:arial,sans-ser=
if">Because of DataXceiver Error</span></div>

<div style><br></div><div style><font face=3D"arial, sans-serif">In console=
 we seen the Error.</font><font face=3D"arial, sans-serif"><br></font></div=
><div style><b style=3D"font-family:arial,sans-serif;font-size:13px">INFO h=
dfs.DFSClient: Could not obtain block</b><br style=3D"font-family:arial,san=
s-serif;font-size:13px">

<span style=3D"font-family:arial,sans-serif;font-size:13px">blk_XXXXXXXXXXX=
XXXXXXXXXXX_</span><span style=3D"font-family:arial,sans-serif;font-size:13=
px">YYYYYYYY from any node: java.io.IOException:</span><font face=3D"arial,=
 sans-serif"><br>

</font></div><div style><br></div><div style><font face=3D"arial, sans-seri=
f">currently we have this value.</font></div><div><span style=3D"color:rgb(=
17,17,17);font-family:&#39;Lucida Sans&#39;,&#39;Lucida Grande&#39;,&#39;Lu=
cida Sans Unicode&#39;,Arial,sans-serif;line-height:16px;background-color:r=
gb(232,241,247)">dfs.datanode.max.xcievers, dfs.datanode.max.transfer.threa=
ds =3D 4096</span><br>

</div><div><br></div><div style>currently monitering our cluster JVM=C2=A0m=
onitoring using openNMS,</div><div style><a href=3D"http://i.imgur.com/E1u0=
fev.png">http://i.imgur.com/E1u0fev.png</a></div><div style><br></div><div =
style>

Not at all hit 4096 value this value for this week . But frequently the=C2=
=A0particular=C2=A0node goes dead state why? log says DataXceiver Error.</d=
iv><div style><br></div><div style><br></div><div style>=C2=A0<span style=
=3D"background-color:rgb(232,241,247)"><font color=3D"#111111" face=3D"Luci=
da Sans, Lucida Grande, Lucida Sans Unicode, Arial, sans-serif"><span style=
=3D"line-height:16px">dfs.datanode.max.xcievers value set to the=C2=A0parti=
cular=C2=A0node or across the cluster Please guide me.</span></font></span>=
</div>

<div style><span style=3D"background-color:rgb(232,241,247);color:rgb(17,17=
,17);font-family:&#39;Lucida Sans&#39;,&#39;Lucida Grande&#39;,&#39;Lucida =
Sans Unicode&#39;,Arial,sans-serif;line-height:16px"><br></span></div><div =
style>

<span style=3D"background-color:rgb(232,241,247);color:rgb(17,17,17);font-f=
amily:&#39;Lucida Sans&#39;,&#39;Lucida Grande&#39;,&#39;Lucida Sans Unicod=
e&#39;,Arial,sans-serif;line-height:16px">-Dhanasekaran.</span></div><div s=
tyle>

<br></div><div style>=C2=A0</div><div><br></div><br clear=3D"all"><div>Did =
I learn something today? If not, I wasted it.</div>
</div>

--20cf307f34a6a7dd6804d81ea22a--