Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Reply-To:Subject:To:MIME-Version:Content-Type;
  b=fFBH/dYKwKZqlOZaOuiJ4YTpBq55U8IW0PtQTuPkwqiFDzaCPjB6lxFQla1Vt8LQQJTz/F5iy6bh8InTP+i90kY39OsuH7tR4O32GqJnFSVanMEfZuJSO9SGzVs7LiGwh1eVeG9X0zUHePmlI7wy4/ib29GyaNco36mD2NcLJpI=;
Message-ID: <1383490667.36054.YahooMailNeo@web141401.mail.bf1.yahoo.com>
Date: Sun, 3 Nov 2013 06:57:47 -0800 (PST)
From: fateme Abiri <fateme.abiri@yahoo.com>
Reply-To: fateme Abiri <fateme.abiri@yahoo.com>
Subject: submit job to remote hadoop cluster
To: "user@hadoop.apache.org" <user@hadoop.apache.org>
MIME-Version: 1.0
Content-Type: multipart/alternative;
 boundary="783862642-231341077-1383490667=:36054"

--783862642-231341077-1383490667=:36054
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

Hi=0A=0AI want to run a map reduce job from an IDE(NetBeans) and as a clien=
t, my hadoop=C2=A0 cluster is in different machine, so I set below code in =
my job conf to run a job in remote :=0A=0A=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =
=0A=C2=A0config =3D new Configuration();=0A=C2=A0config.set("fs.default.nam=
e", "hdfs://192.168.20.130:9000");=0A=C2=A0config.set("mapred.job.tracker",=
 "192.168.20.130:9001");=0AJob job =3D new Job(config, "myJob");=C2=A0 =0Aj=
ob.setJarByClass(MyMapReducClass.class); =0Ajob.setMapperClass(Mapper.class=
);=0Ajob.setReducerClass(Reducer.class);=0A=E2=80=A6...........=0A=0A=0A=C2=
=A0my Reducer.class &=C2=A0 Reducer.class is in=C2=A0 MyMapReducClass.class=
...=0A=0Aknow I want to run my code directly from IDE(NetBeans) , without u=
sing command: =0A$hadoop jar =E2=80=A6.=0AI mean I use ToolRunner.run(new M=
yMapReducClass() , args) in my code.=0A=0A=0Abut when I run the code I have=
 this Error:=0A=0A=C2=A0attempt_201311031101_0008_m_000008_0, Status : FAIL=
ED=0Ajava.lang.RuntimeException: java.lang.ClassNotFoundException:=0A=C2=A0=
MyMapReducClass$Mapper=0A=0A=C2=A0as I said I do : job.setJarByClass(MyMapR=
educClass.class);=0Aand the Mapper.class is in=C2=A0 MyMapReducClass!!!!=0A=
=0A=0AIf its necessary to set $Hadoop ClassPath, is it possible to set it f=
rom my IDE(NetBeans)? Because of some security reason I don't have any perm=
ission to ssh to hadoop cluster to set this parameter every time for all pr=
ogram execution !!!=0A=0Ain general: =0A=0Awhat pre-requirestics should I d=
o=C2=A0 to run map-reduce job from IDE(NetBeans) in mylocal machine on remo=
te cluster?=0AShould I copy the jar file of=C2=A0 my classes and library in=
 hadoop cluster? I have them only in my local machine and do not copy them =
on hadoop cluster!!!=0A=0Aplease say me what can I do?=0A=0A=E2=80=93 Tanx =
so much
--783862642-231341077-1383490667=:36054
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable

<html><body><div style=3D"color:#000; background-color:#fff; font-family:He=
lveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;fo=
nt-size:14pt"><div>Hi<br><br>I want to run a map reduce job from an IDE(Net=
Beans) and as a client, my hadoop&nbsp; cluster is in different machine, so=
 I set below code in my job conf to run a job in remote :<br><br>&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp; <br>&nbsp;config =3D new Configuration();<br>&nbsp;con=
fig.set("fs.default.name", "hdfs://192.168.20.130:9000");<br>&nbsp;config.s=
et("mapred.job.tracker", "192.168.20.130:9001");<br>Job job =3D new Job(con=
fig, "myJob");&nbsp; <br>job.setJarByClass(MyMapReducClass.class); <br>job.=
setMapperClass(Mapper.class);<br>job.setReducerClass(Reducer.class);<br>=E2=
=80=A6...........<br><br><br>&nbsp;my Reducer.class &amp;&nbsp; Reducer.cla=
ss is in&nbsp; MyMapReducClass.class...<br><br>know I want to run my code d=
irectly from IDE(NetBeans) , without using command: <br>$hadoop jar =E2=80=
=A6.<br>I
 mean I use ToolRunner.run(new MyMapReducClass() , args) in my code.<br><br=
><br>but when I run the code I have this Error:<br><br>&nbsp;attempt_201311=
031101_0008_m_000008_0, Status : FAILED<br>java.lang.RuntimeException: java=
.lang.ClassNotFoundException:<br>&nbsp;MyMapReducClass$Mapper<br><br>&nbsp;=
as I said I do : job.setJarByClass(MyMapReducClass.class);<br>and the Mappe=
r.class is in&nbsp; MyMapReducClass!!!!<br><br><br>If its necessary to set =
$Hadoop ClassPath, is it possible to set it from my IDE(NetBeans)? Because =
of some security reason I don't have any permission to ssh to hadoop cluste=
r to set this parameter every time for all program execution !!!<br><br>in =
general: <br><br>what pre-requirestics should I do&nbsp; to run map-reduce =
job from IDE(NetBeans) in mylocal machine on remote cluster?<br>Should I co=
py the jar file of&nbsp; my classes and library in hadoop cluster? I have t=
hem only in my local machine and do not copy them on hadoop
 cluster!!!<br><br>please say me what can I do?<br><br>=E2=80=93 Tanx so mu=
ch<br><br></div></div></body></html>
--783862642-231341077-1383490667=:36054--