Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 41476 invoked from network); 29 Oct 2008 16:55:12 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 29 Oct 2008 16:55:12 -0000 Received: (qmail 96253 invoked by uid 500); 29 Oct 2008 16:55:12 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 96197 invoked by uid 500); 29 Oct 2008 16:55:12 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 96186 invoked by uid 99); 29 Oct 2008 16:55:12 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Oct 2008 09:55:12 -0700 X-ASF-Spam-Status: No, hits=3.2 required=10.0 tests=HTML_MESSAGE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [216.145.54.172] (HELO mrout2.yahoo.com) (216.145.54.172) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Oct 2008 16:53:54 +0000 Received: from SNV-EXBH01.ds.corp.yahoo.com (snv-exbh01.ds.corp.yahoo.com [207.126.227.249]) by mrout2.yahoo.com (8.13.6/8.13.6/y.out) with ESMTP id m9TGqkCt048462 for ; Wed, 29 Oct 2008 09:52:47 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=received:x-mimeole:content-class:mime-version: content-type:subject:date:message-id:x-ms-has-attach: x-ms-tnef-correlator:thread-topic:thread-index:references:from:to:return-path:x-originalarrivaltime; b=mNmhid/ZHlloKaatFnrNdBp0/aZRN6eEaCYDWc8hu8SmYgbY3JW44Km+A2Uar8TX Received: from SNV-EXVS05.ds.corp.yahoo.com ([207.126.227.225]) by SNV-EXBH01.ds.corp.yahoo.com with Microsoft SMTPSVC(6.0.3790.3959); Wed, 29 Oct 2008 09:52:46 -0700 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----_=_NextPart_001_01C939E6.B443D9DC" Subject: RE: How do I include customized InputFormat, InputSplit and RecordReader in a C++ pipes job? Date: Wed, 29 Oct 2008 09:52:18 -0700 Message-ID: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: How do I include customized InputFormat, InputSplit and RecordReader in a C++ pipes job? Thread-Index: Ack54riLe/RE9LwWQkivIjTHGg8GzgAAtfUA References: <375315.30170.qm@web36107.mail.mud.yahoo.com> From: "Peeyush Bishnoi" To: , X-OriginalArrivalTime: 29 Oct 2008 16:52:46.0893 (UTC) FILETIME=[C51B45D0:01C939E6] X-Virus-Checked: Checked by ClamAV on apache.org ------_=_NextPart_001_01C939E6.B443D9DC Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hello Zhengguo , Yes , -libjars is the new feature in Hadoop. This feature has been = available from Hadoop-0.17.x , but it is more stable from hadoop 0.18.x=20 example to use -libjars... hadoop jar -libjars ... Thanks , --- Peeyush -----Original Message----- From: Zhengguo 'Mike' SUN [mailto:zhengguosun@yahoo.com] Sent: Wed 10/29/2008 9:22 AM To: core-user@hadoop.apache.org Subject: Re: How do I include customized InputFormat, InputSplit and = RecordReader in a C++ pipes job? =20 Hi, Amareshwari, Is -libjars a new option in Hadoop 0.19? I am using 0.17.2. The only = option I see is -jar, which didn't work for me. And besides passing them = as jar file, is there any other ways to do that? Thanks Mike ________________________________ From: Amareshwari Sriramadasu To: core-user@hadoop.apache.org Sent: Tuesday, October 28, 2008 11:58:33 PM Subject: Re: How do I include customized InputFormat, InputSplit and = RecordReader in a C++ pipes job? Hi, How are you passing your classes to the pipes job? If you are passing=20 them as a jar file, you can use -libjars option. From branch 0.19, the=20 libjar files are added to the client classpath also. Thanks Amareshwari Zhengguo 'Mike' SUN wrote: > Hi, > > I implemented customized classes for InputFormat, InputSplit and = RecordReader in Java and was trying to use them in a C++ pipes job. The = customized InputFormat class could be included using the -inputformat = option, but it threw ClassNotFoundException for my customized InputSplit = class. It seemed the classpath has not been correctly set. Is there any = way that let me include my customized classes in a pipes job? > > > > =20 > =20 =20 ------_=_NextPart_001_01C939E6.B443D9DC--