Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of oleg.zhurakousky@gmail.com
 designates 74.125.82.45 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CALEj8eMjtaEtY8DvXbbaMZgL4xtZCyjGKvYrMQ=fZ=ij+5TU3g@mail.gmail.com>
References: 
 <CALEj8eMjtaEtY8DvXbbaMZgL4xtZCyjGKvYrMQ=fZ=ij+5TU3g@mail.gmail.com>
Date: Fri, 25 Apr 2014 12:00:03 -0400
Message-ID: 
 <CA+POG05CeQWSGutMr2mZsUqF7_fPB4e6csQgkH_FSadh8ji18Q@mail.gmail.com>
Subject: Re: What configuration parameters cause a Hadoop 2.x job to run on
 the cluster
From: Oleg Zhurakousky <oleg.zhurakousky@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=047d7bfcfc98ffd70a04f7e00e53

--047d7bfcfc98ffd70a04f7e00e53
Content-Type: text/plain; charset=UTF-8

What version of Hadoop you are using? (YARN or no YARN)
To answer your question; Yes its possible and simple. All you need to to is
to have Hadoop JARs on the classpath with relevant configuration files on
the same  classpath pointing to the Hadoop cluster. Most often people
simply copy core-site.xml, yarn-site.xml etc from the actual cluster to the
application classpath and then you can run it straight from IDE.

Not a windows user so not sure about that second part of the question.

Cheers
Oleg


On Fri, Apr 25, 2014 at 11:46 AM, Steve Lewis <lordjoe2000@gmail.com> wrote:

> Assume I have a machine on the same network as a hadoop 2 cluster but
> separate from it.
>
> My understanding is that by setting certain elements of the config file or
> local xml files to point to the cluster I can launch a job without having
> to log into the cluster, move my jar to hdfs and start the job from the
> cluster's hadoop machine.
>
> Does this work?
> What Parameters need I sat?
> Where is the jar file?
> What issues would I see if the machine is running Windows with cygwin
> installed?
>
>

--047d7bfcfc98ffd70a04f7e00e53
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">What version of Hadoop you are using? (YARN or no YARN)<di=
v>To answer your question; Yes its possible and simple. All you need to to =
is to have Hadoop JARs on the classpath with relevant configuration files o=
n the same =C2=A0classpath pointing to the Hadoop cluster. Most often peopl=
e simply copy core-site.xml, yarn-site.xml etc from the actual cluster to t=
he application classpath and then you can run it straight from IDE.</div>
<div><br></div><div>Not a windows user so not sure about that second part o=
f the question.</div><div><br></div><div>Cheers</div><div>Oleg</div></div><=
div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote">On Fri, Apr 25=
, 2014 at 11:46 AM, Steve Lewis <span dir=3D"ltr">&lt;<a href=3D"mailto:lor=
djoe2000@gmail.com" target=3D"_blank">lordjoe2000@gmail.com</a>&gt;</span> =
wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr">Assume I have a machine on =
the same network as a hadoop 2 cluster but separate from it.=C2=A0<div><div=
><br></div>
<div>My understanding is that by setting certain elements of the config fil=
e or local xml files to point to the cluster I can launch a job without hav=
ing to log into the cluster, move my jar to hdfs and start the job from the=
 cluster&#39;s hadoop machine.</div>

<div><br></div><div>Does this work?</div><div>What Parameters need I sat?</=
div><div>Where is the jar file?</div><div>What issues would I see if the ma=
chine is running Windows with cygwin installed?</div><div><br></div>
</div></div>
</blockquote></div><br></div>

--047d7bfcfc98ffd70a04f7e00e53--