Return-Path: Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: (qmail 15510 invoked from network); 1 Sep 2010 02:17:55 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 1 Sep 2010 02:17:55 -0000 Received: (qmail 18871 invoked by uid 500); 1 Sep 2010 02:17:54 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 18761 invoked by uid 500); 1 Sep 2010 02:17:54 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 18751 invoked by uid 99); 1 Sep 2010 02:17:54 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Sep 2010 02:17:54 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=10.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of Deepika.Khera@avg.com designates 193.85.188.248 as permitted sender) Received: from [193.85.188.248] (HELO ms.grisoft.cz) (193.85.188.248) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Sep 2010 02:17:48 +0000 Received: from deimos.cz.avg.com (unknown [192.168.200.161]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by ms.grisoft.cz (Postfix) with ESMTP id 5E66F382C8 for ; Wed, 1 Sep 2010 04:17:27 +0200 (CEST) Received: from miranda.us.avg.com (10.32.34.13) by deimos.cz.avg.com (192.168.200.161) with Microsoft SMTP Server (TLS) id 8.3.83.0; Wed, 1 Sep 2010 04:17:27 +0200 Received: from miranda.us.avg.com ([10.32.34.13]) by miranda ([10.32.34.13]) with mapi; Tue, 31 Aug 2010 22:17:25 -0400 From: Deepika Khera To: "general@hadoop.apache.org" Date: Tue, 31 Aug 2010 22:17:26 -0400 Subject: RE: Deploying my job jar on hadoop cluster Thread-Topic: Deploying my job jar on hadoop cluster Thread-Index: ActIH0J+vIZx/8HOQvuTgGChZ4b1ZABXHc2w Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org Thanks! Added the line and it worked :) -----Original Message----- From: Angus He [mailto:angushe@gmail.com]=20 Sent: Monday, August 30, 2010 1:41 AM To: general@hadoop.apache.org Subject: Re: Deploying my job jar on hadoop cluster Did the Job.setJarByClass get called? If not, just add it and take another try. On Sun, Aug 29, 2010 at 2:15 PM, Deepika Khera wrot= e: > Thanks. I had tried running the command as you suggested but got a ClassN= otFoundException exception(for the mapper class) in the task trackers. I di= d a > > bin/hadoop jar /root/myjob.jar > > (Already had the main class defined in manifest) > > There is probably something else that I am doing wrong. > > Appreciate your help. > > Thanks, > Deepika > > -----Original Message----- > From: Chandraprakash Bhagtani [mailto:cpbhagtani@gmail.com] > Sent: Saturday, August 28, 2010 10:40 PM > To: general@hadoop.apache.org > Subject: Re: Deploying my job jar on hadoop cluster > > Deepika, > > You just have to run the following command on any of the cluster node > > HADOOP_HOME/bin/hadoop jar > > this command will automatically copy the jar on all the tasktrackers. > > On Sun, Aug 29, 2010 at 6:07 AM, Deepika Khera wro= te: > >> Hi, >> >> I want to deploy my map reduce job jar on the Hadoop cluster. I've alway= s >> done that by doing the following - >> >> 1. Copying the job jar to all datanodes >> 2. Having the job jar on the hadoop classpath on all machines. >> >> Isn't hadoop capable of copying over the job jar to all machines in the >> cluster? This is what I read (that job tracker copies the job jar, etc) = , >> but if I don't do the above the task trackers cannot find the job. I kno= w I >> am missing something. >> >> Could someone please let me know how I can run my job without having to >> copy it over all machines in the cluster? >> >> Thanks, >> Deepika >> > > > > -- > Thanks & Regards, > Chandra Prakash Bhagtani, > Nokia India Pvt. Ltd. > --=20 Regards Angus