Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of mohajeri@gmail.com designates
 209.85.214.175 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <869970D71E26D7498BDAC4E1CA92226B86F1A3F9@MBX021-E3-NJ-2.exch021.domain.local>
References: 
 <869970D71E26D7498BDAC4E1CA92226B86F1A3F9@MBX021-E3-NJ-2.exch021.domain.local>
Date: Sat, 7 Jun 2014 10:12:03 -0400
Message-ID: 
 <CAO6JcpjsAcqQ9GAp9m4S+u0vbq4ZvmhSR=6P2pXRLggK0sEF3w@mail.gmail.com>
Subject: Re: Gathering connection information
From: Peyman Mohajerian <mohajeri@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=047d7bd75f24f86a1d04fb3f8f41

--047d7bd75f24f86a1d04fb3f8f41
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

In my experience you build a node called Edge Node which has all the
libraries and configuration setting in XML to connect to the cluster, it
just doesn't have any of the Hadoop daemons running.


On Wed, Jun 4, 2014 at 2:46 PM, John Lilley <john.lilley@redpoint.net>
wrote:

>  We=E2=80=99ve found that much of the Hadoop samples assume that running =
is being
> done form a cluster node, and that the connection information can be
> gleaned directly from a configuration object.  However, we always run our
> client from a remote computer, and our users must manually specify the
> NN/RM addresses and ports.  We=E2=80=99ve found this varies maddeningly b=
etween
> distros and especially on hosted virtual implementations.  Getting the
> wrong port results in various inscrutable errors with red-herring message=
s
> about security.  Is there a prescribed way to get the correct connection
> information more easily, like from a web API (where at least we=E2=80=99d=
 only need
> one address and port)?
>
>
>
> john
>
>
>

--047d7bd75f24f86a1d04fb3f8f41
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">In my experience you build a node called Edge Node which h=
as all the libraries and configuration setting in XML to connect to the clu=
ster, it just doesn&#39;t have any of the Hadoop daemons running.=C2=A0</di=
v><div class=3D"gmail_extra">
<br><br><div class=3D"gmail_quote">On Wed, Jun 4, 2014 at 2:46 PM, John Lil=
ley <span dir=3D"ltr">&lt;<a href=3D"mailto:john.lilley@redpoint.net" targe=
t=3D"_blank">john.lilley@redpoint.net</a>&gt;</span> wrote:<br><blockquote =
class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid=
;padding-left:1ex">


<div lang=3D"EN-US" link=3D"blue" vlink=3D"purple">
<div>
<p class=3D"MsoNormal">We=E2=80=99ve found that much of the Hadoop samples =
assume that running is being done form a cluster node, and that the connect=
ion information can be gleaned directly from a configuration object.=C2=A0 =
However, we always run our client from a remote
 computer, and our users must manually specify the NN/RM addresses and port=
s.=C2=A0 We=E2=80=99ve found this varies maddeningly between distros and es=
pecially on hosted virtual implementations.=C2=A0 Getting the wrong port re=
sults in various inscrutable errors with red-herring
 messages about security.=C2=A0 Is there a prescribed way to get the correc=
t connection information more easily, like from a web API (where at least w=
e=E2=80=99d only need one address and port)?<span class=3D"HOEnZb"><font co=
lor=3D"#888888"><u></u><u></u></font></span></p>
<span class=3D"HOEnZb"><font color=3D"#888888">
<p class=3D"MsoNormal"><u></u>=C2=A0<u></u></p>
<p class=3D"MsoNormal">john<u></u><u></u></p>
<p class=3D"MsoNormal"><u></u>=C2=A0<u></u></p>
</font></span></div>
</div>

</blockquote></div><br></div>

--047d7bd75f24f86a1d04fb3f8f41--