Return-Path: 
 <user-return-12124-apmail-hadoop-hdfs-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 76C23108ED
	for <apmail-hadoop-hdfs-user-archive@minotaur.apache.org>;
 Fri, 29 Nov 2013 08:58:49 +0000 (UTC)
Received: (qmail 12908 invoked by uid 500); 29 Nov 2013 08:58:42 -0000
Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org
Received: (qmail 12802 invoked by uid 500); 29 Nov 2013 08:58:42 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 12795 invoked by uid 99); 29 Nov 2013 08:58:41 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Nov 2013 08:58:41 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of kawa.adam@gmail.com designates
 209.85.223.173 as permitted sender)
Received: from [209.85.223.173] (HELO mail-ie0-f173.google.com)
 (209.85.223.173)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Nov 2013 08:58:34 +0000
Received: by mail-ie0-f173.google.com with SMTP id to1so15698966ieb.18
        for <user@hadoop.apache.org>; Fri, 29 Nov 2013 00:58:14 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        bh=zrbjXs5fiW4WPaXjlS4G8kmzgZ5bDRgv0QxeWgIlg44=;
        b=SmamLb1MyjEgdjHlQgf5H4XWstxK6pEH8Ivhok/Ldt/tjFKxd1REZVgyW9txWNOqCz
         9CIqwTZd3kwI1MYpmAC5c/I3LOC9HYPWd82VdJMp7HkRTtfOTa4cKMS6AI748UJZ8Sa/
         o9zw0fCyaEkY1r+bUHpe09EsMnb0w//whtZ7C4ZhCDVjpKEJZ7We6dSdz4OiWZ+FZa21
         BSM7c0Q3j0LLB4P4Yma+IFPWCRwp/QbKRK2JugJHDjZlmcn9caZ8rhuLBqaMbeUchsOE
         J/SkE8+zC5MKXwQo8/9ZtIOpmaM0KoOyV0N31uzc6oF+ybJ9ZS680pce6Bj/BdfEre3U
         VyOw==
MIME-Version: 1.0
X-Received: by 10.42.147.66 with SMTP id m2mr865085icv.59.1385715494103; Fri,
 29 Nov 2013 00:58:14 -0800 (PST)
Received: by 10.42.153.136 with HTTP; Fri, 29 Nov 2013 00:58:14 -0800 (PST)
In-Reply-To: <BAY407-EAS105D39480FFB19A255E3C03E0E90@phx.gbl>
References: <BAY407-EAS105D39480FFB19A255E3C03E0E90@phx.gbl>
Date: Fri, 29 Nov 2013 10:58:14 +0200
Message-ID: 
 <CAHodO=LAKHFOuNBM94m5DGUWDxQ9ZZKH5anZ64a0pWv3q+dWBQ@mail.gmail.com>
Subject: Re: Multiple nic interfaces on datanode
From: Adam Kawa <kawa.adam@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=90e6ba1efd32c9344e04ec4d071c
X-Virus-Checked: Checked by ClamAV on apache.org

--90e6ba1efd32c9344e04ec4d071c
Content-Type: text/plain; charset=ISO-8859-1

> I have 2 nics on my datanodes, is it possible to used the one dedicated
> for replication and other for all other comunication i.e with jt and
> namenodes ?


Please correct me, I am wrong, but I have never seen a support for that in
Hadoop. DataNodes uses limited number of threads for balancing (afaik, 5
maximally + dfs.datanode.balance.bandwidthPerSec), so this way resources
used for balancing can be limited.


> Also eventhough I am using rackawareness script and dfsreport shows the
> racks jobtracker shows all tasktracker in default rack, how to correct that.
>

We switched to YARN recently, so it is difficult for me to check it now.
Do you have rack-awareness script deployed on the JobTracker machine?

--90e6ba1efd32c9344e04ec4d071c
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><br><div class=3D"gmail_extra"><div class=3D"gmail_quote">=
<blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-=
left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;p=
adding-left:1ex">

I have 2 nics on my datanodes, is it possible to used the one dedicated for=
 replication and other for all other comunication i.e with jt and namenodes=
 ?</blockquote><div><br></div><div>Please correct me, I am wrong, but I hav=
e never seen a support for that in Hadoop. DataNodes uses limited number of=
 threads for balancing (afaik, 5 maximally + dfs.datanode.balance.bandwidth=
PerSec), so this way resources used for balancing can be limited.</div>
<div>=A0</div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px=
 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left=
-style:solid;padding-left:1ex">Also eventhough I am using rackawareness scr=
ipt and dfsreport shows the racks jobtracker shows all tasktracker in defau=
lt rack, how to correct that.<br>
</blockquote><div><br></div><div>We switched to YARN recently, so it is dif=
ficult for me to check it now.</div><div>Do you have rack-awareness script =
deployed on the JobTracker machine?</div></div><br></div></div>

--90e6ba1efd32c9344e04ec4d071c--