hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chandraprakash Bhagtani <cpbhagt...@gmail.com>
Subject Re: Deploying my job jar on hadoop cluster
Date Sun, 29 Aug 2010 07:49:58 GMT
check whether the user from which you are running the job has permissions on
the jar or the jar is properly generated i.e. the class is present in the
jar or not

On Sun, Aug 29, 2010 at 11:45 AM, Deepika Khera <Deepika.Khera@avg.com>wrote:

> Thanks. I had tried running the command as you suggested but got a
> ClassNotFoundException exception(for the mapper class) in the task trackers.
> I did a
>
> bin/hadoop jar /root/myjob.jar
>
> (Already had the main class defined in manifest)
>
> There is probably something else that I am doing wrong.
>
> Appreciate your help.
>
> Thanks,
> Deepika
>
> -----Original Message-----
> From: Chandraprakash Bhagtani [mailto:cpbhagtani@gmail.com]
> Sent: Saturday, August 28, 2010 10:40 PM
> To: general@hadoop.apache.org
> Subject: Re: Deploying my job jar on hadoop cluster
>
> Deepika,
>
> You just have to run the following command on any of the cluster node
>
> HADOOP_HOME/bin/hadoop jar <job_jar_name> <class_name> <other_args>
>
> this command will automatically copy the jar on all the tasktrackers.
>
> On Sun, Aug 29, 2010 at 6:07 AM, Deepika Khera <Deepika.Khera@avg.com
> >wrote:
>
> > Hi,
> >
> > I want to deploy my map reduce job jar on the Hadoop cluster. I've always
> > done that by doing the following -
> >
> > 1. Copying the job jar to all datanodes
> > 2. Having the job jar on the hadoop classpath on all machines.
> >
> > Isn't hadoop capable of copying over the job jar to all machines in the
> > cluster? This is what I read (that job tracker copies the job jar, etc) ,
> > but if I don't do the above the task trackers cannot find the job. I know
> I
> > am missing something.
> >
> > Could someone please let me know how I can run my job without having to
> > copy it over all machines in the cluster?
> >
> > Thanks,
> > Deepika
> >
>
>
>
> --
> Thanks & Regards,
> Chandra Prakash Bhagtani,
> Nokia India Pvt. Ltd.
>



-- 
Thanks & Regards,
Chandra Prakash Bhagtani,
Nokia India Pvt. Ltd.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message