Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 14324 invoked from network); 15 Jun 2010 05:03:50 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 15 Jun 2010 05:03:50 -0000 Received: (qmail 20997 invoked by uid 500); 15 Jun 2010 04:35:48 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 20578 invoked by uid 500); 15 Jun 2010 04:35:44 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 20569 invoked by uid 99); 15 Jun 2010 04:35:43 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Jun 2010 04:35:43 +0000 X-ASF-Spam-Status: No, hits=2.9 required=10.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.212.48] (HELO mail-vw0-f48.google.com) (209.85.212.48) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Jun 2010 04:35:37 +0000 Received: by vws4 with SMTP id 4so5807192vws.35 for ; Mon, 14 Jun 2010 21:35:16 -0700 (PDT) MIME-Version: 1.0 Received: by 10.224.72.72 with SMTP id l8mr2814810qaj.165.1276576516224; Mon, 14 Jun 2010 21:35:16 -0700 (PDT) Received: by 10.229.79.147 with HTTP; Mon, 14 Jun 2010 21:35:16 -0700 (PDT) Date: Mon, 14 Jun 2010 21:35:16 -0700 Message-ID: Subject: running elephant-bird in eclipse & codec property From: Kim Vogt To: common-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001636137b0cc738e004890a21e9 X-Virus-Checked: Checked by ClamAV on apache.org --001636137b0cc738e004890a21e9 Content-Type: text/plain; charset=ISO-8859-1 Hi peeps, I'm trying to run elephant-bird code in eclipse, specifically ( http://github.com/kevinweil/elephant-bird/blob/master/examples/src/pig/json_word_count.pig), but I'm not sure how to set the core-site.xml properties via eclipse. I tried adding them to VM args but am still getting the following error: 10/06/14 21:23:34 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= 10/06/14 21:23:34 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 10/06/14 21:23:34 INFO input.FileInputFormat: Total input paths to process : 2 10/06/14 21:23:34 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library 10/06/14 21:23:34 INFO lzo.LzoCodec: Successfully loaded & initialized native-lzo library [hadoop-lzo rev 916aeae88ceb6734a679ebf9b48a93bea4cd9a06] 10/06/14 21:23:34 INFO input.LzoInputFormat: Added LZO split for file:/home/kim/code/data/jsonData/json.txt.lzo[start=0, length=100] 10/06/14 21:23:34 INFO mapred.JobClient: Running job: job_local_0001 10/06/14 21:23:34 INFO input.FileInputFormat: Total input paths to process : 2 10/06/14 21:23:34 INFO input.LzoInputFormat: Added LZO split for file:/home/kim/code/data/jsonData/json.txt.lzo[start=0, length=100] 10/06/14 21:23:34 INFO mapred.MapTask: io.sort.mb = 100 10/06/14 21:23:34 INFO mapred.MapTask: data buffer = 79691776/99614720 10/06/14 21:23:34 INFO mapred.MapTask: record buffer = 262144/327680 10/06/14 21:23:34 WARN mapred.LocalJobRunner: job_local_0001 java.io.IOException: No codec for file file:/home/kim/code/data/jsonData/json.txt.lzo not found, cannot run at com.twitter.elephantbird.mapreduce.input.LzoRecordReader.initialize(LzoRecordReader.java:64) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:582) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:176) 10/06/14 21:23:35 INFO mapred.JobClient: map 0% reduce 0% 10/06/14 21:23:35 INFO mapred.JobClient: Job complete: job_local_0001 10/06/14 21:23:35 INFO mapred.JobClient: Counters: 0 Help appreciated :-) Thanks! -Kim --001636137b0cc738e004890a21e9--