hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Deepika Khera <Deepika.Kh...@avg.com>
Subject RE: Deploying my job jar on hadoop cluster
Date Wed, 01 Sep 2010 02:17:26 GMT
Thanks! Added the line and it worked :)

-----Original Message-----
From: Angus He [mailto:angushe@gmail.com] 
Sent: Monday, August 30, 2010 1:41 AM
To: general@hadoop.apache.org
Subject: Re: Deploying my job jar on hadoop cluster

Did the Job.setJarByClass get called?  If not, just add it and take
another try.

On Sun, Aug 29, 2010 at 2:15 PM, Deepika Khera <Deepika.Khera@avg.com> wrote:
> Thanks. I had tried running the command as you suggested but got a ClassNotFoundException
exception(for the mapper class) in the task trackers. I did a
>
> bin/hadoop jar /root/myjob.jar
>
> (Already had the main class defined in manifest)
>
> There is probably something else that I am doing wrong.
>
> Appreciate your help.
>
> Thanks,
> Deepika
>
> -----Original Message-----
> From: Chandraprakash Bhagtani [mailto:cpbhagtani@gmail.com]
> Sent: Saturday, August 28, 2010 10:40 PM
> To: general@hadoop.apache.org
> Subject: Re: Deploying my job jar on hadoop cluster
>
> Deepika,
>
> You just have to run the following command on any of the cluster node
>
> HADOOP_HOME/bin/hadoop jar <job_jar_name> <class_name> <other_args>
>
> this command will automatically copy the jar on all the tasktrackers.
>
> On Sun, Aug 29, 2010 at 6:07 AM, Deepika Khera <Deepika.Khera@avg.com>wrote:
>
>> Hi,
>>
>> I want to deploy my map reduce job jar on the Hadoop cluster. I've always
>> done that by doing the following -
>>
>> 1. Copying the job jar to all datanodes
>> 2. Having the job jar on the hadoop classpath on all machines.
>>
>> Isn't hadoop capable of copying over the job jar to all machines in the
>> cluster? This is what I read (that job tracker copies the job jar, etc) ,
>> but if I don't do the above the task trackers cannot find the job. I know I
>> am missing something.
>>
>> Could someone please let me know how I can run my job without having to
>> copy it over all machines in the cluster?
>>
>> Thanks,
>> Deepika
>>
>
>
>
> --
> Thanks & Regards,
> Chandra Prakash Bhagtani,
> Nokia India Pvt. Ltd.
>



-- 
Regards
Angus

Mime
View raw message