Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of sfhadoop@gmail.com designates
 209.85.217.175 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAH37JURX6kU=8JVhtxeDcG54Unvejypn1J1FJzbqut=6bZV81Q@mail.gmail.com>
References: 
 <CAH37JURX6kU=8JVhtxeDcG54Unvejypn1J1FJzbqut=6bZV81Q@mail.gmail.com>
Date: Thu, 9 Oct 2014 10:52:16 -0700
Message-ID: 
 <CA+tdLAr4su-P4AyBRcabMvW2TzqbnPwWjECz191KY_Nw_GTowg@mail.gmail.com>
Subject: Re: Standby Namenode and Datanode coexistence
From: SF Hadoop <sfhadoop@gmail.com>
To: "user@hadoop.apache.org" <user@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=001a11c31858d2cbbc05050117bc

--001a11c31858d2cbbc05050117bc
Content-Type: text/plain; charset=UTF-8

You can run any of the daemons on any machine you want, you just have to be
aware of the trade offs you are making with RAM allocation.

I am hoping this is a DEV cluster.  This is definitely not a configuration
you would want to use in production.  If you are asking in regards to a
production cluster, the NNs should live apart from the datanodes though it
is perfectly fine to run the journal node and zookeeper instances on the
NNs.  But again, you should NEVER have the NN and DN on the same machine
(unless you are in a DEV cluster and experimenting).


On Thu, Oct 9, 2014 at 4:19 AM, oc tsdb <oc.tsdb@gmail.com> wrote:

> Hi,
>
> We have cluster with 3 nodes (1 namenode + 2 datanodes).
> Cluster is running with hadoop 2.4.0 version.
>
> We would like to add High Availability(HA) to Namenode using the Quorum
> Journal Manager.
>
> As per the below link, we need two NN machines with same configuration.
>
>
> http://hadoop.apache.org/docs/r2.4.0/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html#Hardware
> resources
>
> Our query is:
>
> As we have existing cluster with 3 nodes (1 namenode + 2 datanodes), can
> we configure standby namenode on one of the datanodes? Will there be any
> issues if we run standby namenode and datanode together?
> Or we should add one more machine and configure it as standby namenode?
>
> Regarding Journal node, Can we run it on any machine (datanode and
> namenode)?
>
> Thanks in advance.
>
> Thanks
> oc.tsdb
>
>
>
>

--001a11c31858d2cbbc05050117bc
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">You can run any of the daemons on any machine you want, yo=
u just have to be aware of the trade offs you are making with RAM allocatio=
n.<div><br></div><div>I am hoping this is a DEV cluster.=C2=A0 This is defi=
nitely not a configuration you would want to use in production.=C2=A0 If yo=
u are asking in regards to a production cluster, the NNs should live apart =
from the datanodes though it is perfectly fine to run the journal node and =
zookeeper instances on the NNs.=C2=A0 But again, you should NEVER have the =
NN and DN on the same machine (unless you are in a DEV cluster and experime=
nting).</div><div><br></div></div><div class=3D"gmail_extra"><br><div class=
=3D"gmail_quote">On Thu, Oct 9, 2014 at 4:19 AM, oc tsdb <span dir=3D"ltr">=
&lt;<a href=3D"mailto:oc.tsdb@gmail.com" target=3D"_blank">oc.tsdb@gmail.co=
m</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margi=
n:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">=
Hi,<div><br></div><div>We have cluster with 3 nodes (1 namenode + 2 datanod=
es).</div><div>Cluster is running with hadoop 2.4.0 version.</div><div><br>=
</div><div>We would like to add High Availability(HA) to Namenode using the=
 Quorum Journal Manager.</div><div><br></div><div>As per the below link, we=
 need two NN machines with same configuration.</div><div><br></div><div><a =
href=3D"http://hadoop.apache.org/docs/r2.4.0/hadoop-project-dist/hadoop-hdf=
s/HDFSHighAvailabilityWithQJM.html#Hardware" target=3D"_blank">http://hadoo=
p.apache.org/docs/r2.4.0/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabili=
tyWithQJM.html#Hardware</a> resources<br></div><div><br></div><div>Our quer=
y is:</div><div><br></div><div>As we have existing cluster with 3 nodes (1 =
namenode + 2 datanodes), can we configure standby namenode on one of the da=
tanodes? Will there be any issues if we run standby namenode and datanode t=
ogether?</div><div>Or we should add one more machine and configure it as st=
andby namenode?</div><div><br></div><div>Regarding Journal node, Can we run=
 it on any machine (datanode and namenode)?=C2=A0</div><div><br></div><div>=
Thanks in advance.</div><div><br></div><div>Thanks</div><span class=3D"HOEn=
Zb"><font color=3D"#888888"><div>oc.tsdb=C2=A0</div><div><br></div><div><br=
></div><div><br></div></font></span></div>
</blockquote></div><br></div>

--001a11c31858d2cbbc05050117bc--