Return-Path: Delivered-To: apmail-incubator-pig-dev-archive@locus.apache.org Received: (qmail 22691 invoked from network); 3 Apr 2008 18:42:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 3 Apr 2008 18:42:55 -0000 Received: (qmail 48112 invoked by uid 500); 3 Apr 2008 18:42:55 -0000 Delivered-To: apmail-incubator-pig-dev-archive@incubator.apache.org Received: (qmail 48090 invoked by uid 500); 3 Apr 2008 18:42:55 -0000 Mailing-List: contact pig-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: pig-dev@incubator.apache.org Delivered-To: mailing list pig-dev@incubator.apache.org Received: (qmail 48080 invoked by uid 99); 3 Apr 2008 18:42:55 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Apr 2008 11:42:55 -0700 X-ASF-Spam-Status: No, hits=-1998.5 required=10.0 tests=ALL_TRUSTED,WEIRD_PORT X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Apr 2008 18:42:22 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 58B0B234C0BA for ; Thu, 3 Apr 2008 11:40:24 -0700 (PDT) Message-ID: <1702526066.1207248024362.JavaMail.jira@brutus> Date: Thu, 3 Apr 2008 11:40:24 -0700 (PDT) From: "Arun C Murthy (JIRA)" To: pig-dev@incubator.apache.org Subject: [jira] Updated: (PIG-181) Shipping appears not working properly in this case In-Reply-To: <1231326266.1207183824393.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated PIG-181: ------------------------------ Status: Patch Available (was: Open) > Shipping appears not working properly in this case > -------------------------------------------------- > > Key: PIG-181 > URL: https://issues.apache.org/jira/browse/PIG-181 > Project: Pig > Issue Type: Bug > Reporter: Xu Zhang > Assignee: Arun C Murthy > Attachments: MySimpleStreamApp.pl, PIG-181_0_20080403.patch, script.pig > > > With the attached Pig script and the Perl script, I got IOException errors for being unable to find Perl script in the specified relative path. > {noformat} > I can't find HOD configuration for piglet, hopefully you weren't planning on using HOD. > 2008-04-02 17:35:38,686 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: wilbur11.labs.corp.sp1.yahoo.com:8020 > 2008-04-02 17:35:39,556 [main] INFO org.apache.pig.backend.hadoop.executionengine.POMapreduce - ----- MapReduce Job ----- > 2008-04-02 17:35:39,557 [main] INFO org.apache.pig.backend.hadoop.executionengine.POMapreduce - Input: [/user/pig/tests/data/singlefile/studenttab10k:org.apache.pig.builtin.PigStorage()] > 2008-04-02 17:35:39,557 [main] INFO org.apache.pig.backend.hadoop.executionengine.POMapreduce - Map: [[*]->org.apache.pig.impl.eval.StreamSpec@121ab80] > 2008-04-02 17:35:39,557 [main] INFO org.apache.pig.backend.hadoop.executionengine.POMapreduce - Group: [GENERATE {[PROJECT $0],[*]}] > 2008-04-02 17:35:39,558 [main] INFO org.apache.pig.backend.hadoop.executionengine.POMapreduce - Combine: null > 2008-04-02 17:35:39,558 [main] INFO org.apache.pig.backend.hadoop.executionengine.POMapreduce - Reduce: GENERATE {[COUNT(GENERATE {[PROJECT $1]->[PROJECT $0]})]} > 2008-04-02 17:35:39,558 [main] INFO org.apache.pig.backend.hadoop.executionengine.POMapreduce - Output: results_8:org.apache.pig.builtin.PigStorage > 2008-04-02 17:35:39,558 [main] INFO org.apache.pig.backend.hadoop.executionengine.POMapreduce - Split: null > 2008-04-02 17:35:39,559 [main] INFO org.apache.pig.backend.hadoop.executionengine.POMapreduce - Map parallelism: -1 > 2008-04-02 17:35:39,559 [main] INFO org.apache.pig.backend.hadoop.executionengine.POMapreduce - Reduce parallelism: -1 > 219190 hdfs://wilbur11.labs.corp.sp1.yahoo.com:8020/user/pig/tests/data/singlefile/studenttab10k > 2008-04-02 17:35:42,414 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Pig progress = 0% > 2008-04-02 17:36:05,527 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (map) tip_200803281454_0795_m_000000 java.lang.RuntimeException: java.io.IOException: Cannot run program "./streamingscript/MySimpleStreamApp.pl": java.io.IOException: error=2, No such file or directory > at org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:132) > at org.apache.pig.impl.eval.StreamSpec.setupDefaultPipe(StreamSpec.java:91) > at org.apache.pig.impl.eval.CompositeEvalSpec.setupDefaultPipe(CompositeEvalSpec.java:50) > at org.apache.pig.impl.eval.EvalSpec.setupPipe(EvalSpec.java:123) > at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.setupMapPipe(PigMapReduce.java:250) > at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.run(PigMapReduce.java:107) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208) > at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2071) > Caused by: java.io.IOException: Cannot run program "./streamingscript/MySimpleStreamApp.pl": java.io.IOException: error=2, No such file or directory > at java.lang.ProcessBuilder.start(ProcessBuilder.java:459) > at org.apache.pig.impl.streaming.ExecutableManager.exec(ExecutableManager.java:208) > at org.apache.pig.backend.hadoop.streaming.HadoopExecutableManager.exec(HadoopExecutableManager.java:110) > at org.apache.pig.impl.streaming.ExecutableManager.run(ExecutableManager.java:246) > at org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:127) > ... 7 more > Caused by: java.io.IOException: java.io.IOException: error=2, No such file or directory > at java.lang.UNIXProcess.(UNIXProcess.java:148) > at java.lang.ProcessImpl.start(ProcessImpl.java:65) > at java.lang.ProcessBuilder.start(ProcessBuilder.java:452) > ... 11 more > java.lang.RuntimeException: java.io.IOException: Cannot run program "./streamingscript/MySimpleStreamApp.pl": java.io.IOException: error=2, No such file or directory > at org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:132) > at org.apache.pig.impl.eval.StreamSpec.setupDefaultPipe(StreamSpec.java:91) > at org.apache.pig.impl.eval.CompositeEvalSpec.setupDefaultPipe(CompositeEvalSpec.java:50) > at org.apache.pig.impl.eval.EvalSpec.setupPipe(EvalSpec.java:123) > at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.setupMapPipe(PigMapReduce.java:250) > at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.run(PigMapReduce.java:107) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208) > at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2071) > Caused by: java.io.IOException: Cannot run program "./streamingscript/MySimpleStreamApp.pl": java.io.IOException: error=2, No such file or directory > at java.lang.ProcessBuilder.start(ProcessBuilder.java:459) > at org.apache.pig.impl.streaming.ExecutableManager.exec(ExecutableManager.java:208) > at org.apache.pig.backend.hadoop.streaming.HadoopExecutableManager.exec(HadoopExecutableManager.java:110) > at org.apache.pig.impl.streaming.ExecutableManager.run(ExecutableManager.java:246) > at org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:127) > ... 7 more > Caused by: java.io.IOException: java.io.IOException: error=2, No such file or directory > at java.lang.UNIXProcess.(UNIXProcess.java:148) > at java.lang.ProcessImpl.start(ProcessImpl.java:65) > at java.lang.ProcessBuilder.start(ProcessBuilder.java:452) > ... 11 more > java.lang.RuntimeException: java.io.IOException: Cannot run program "./streamingscript/MySimpleStreamApp.pl": java.io.IOException: error=2, No such file or directory > at org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:132) > at org.apache.pig.impl.eval.StreamSpec.setupDefaultPipe(StreamSpec.java:91) > at org.apache.pig.impl.eval.CompositeEvalSpec.setupDefaultPipe(CompositeEvalSpec.java:50) > at org.apache.pig.impl.eval.EvalSpec.setupPipe(EvalSpec.java:123) > at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.setupMapPipe(PigMapReduce.java:250) > at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.run(PigMapReduce.java:107) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208) > at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2071) > Caused by: java.io.IOException: Cannot run program "./streamingscript/MySimpleStreamApp.pl": java.io.IOException: error=2, No such file or directory > at java.lang.ProcessBuilder.start(ProcessBuilder.java:459) > at org.apache.pig.impl.streaming.ExecutableManager.exec(ExecutableManager.java:208) > at org.apache.pig.backend.hadoop.streaming.HadoopExecutableManager.exec(HadoopExecutableManager.java:110) > at org.apache.pig.impl.streaming.ExecutableManager.run(ExecutableManager.java:246) > at org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:127) > ... 7 more > Caused by: java.io.IOException: java.io.IOException: error=2, No such file or directory > at java.lang.UNIXProcess.(UNIXProcess.java:148) > at java.lang.ProcessImpl.start(ProcessImpl.java:65) > at java.lang.ProcessBuilder.start(ProcessBuilder.java:452) > ... 11 more > java.lang.RuntimeException: java.io.IOException: Cannot run program "./streamingscript/MySimpleStreamApp.pl": java.io.IOException: error=2, No such file or directory > at org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:132) > at org.apache.pig.impl.eval.StreamSpec.setupDefaultPipe(StreamSpec.java:91) > at org.apache.pig.impl.eval.CompositeEvalSpec.setupDefaultPipe(CompositeEvalSpec.java:50) > at org.apache.pig.impl.eval.EvalSpec.setupPipe(EvalSpec.java:123) > at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.setupMapPipe(PigMapReduce.java:250) > at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.run(PigMapReduce.java:107) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208) > at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2071) > Caused by: java.io.IOException: Cannot run program "./streamingscript/MySimpleStreamApp.pl": java.io.IOException: error=2, No such file or directory > at java.lang.ProcessBuilder.start(ProcessBuilder.java:459) > at org.apache.pig.impl.streaming.ExecutableManager.exec(ExecutableManager.java:208) > at org.apache.pig.backend.hadoop.streaming.HadoopExecutableManager.exec(HadoopExecutableManager.java:110) > at org.apache.pig.impl.streaming.ExecutableManager.run(ExecutableManager.java:246) > at org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:127) > ... 7 more > Caused by: java.io.IOException: java.io.IOException: error=2, No such file or directory > at java.lang.UNIXProcess.(UNIXProcess.java:148) > at java.lang.ProcessImpl.start(ProcessImpl.java:65) > at java.lang.ProcessBuilder.start(ProcessBuilder.java:452) > ... 11 more > 2008-04-02 17:36:05,533 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000000 > 2008-04-02 17:36:05,533 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000001 > 2008-04-02 17:36:05,533 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000002 > 2008-04-02 17:36:05,533 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000003 > 2008-04-02 17:36:05,533 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000004 > 2008-04-02 17:36:05,534 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000005 > 2008-04-02 17:36:05,534 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000006 > 2008-04-02 17:36:05,534 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000007 > 2008-04-02 17:36:05,534 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000008 > 2008-04-02 17:36:05,534 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000009 > 2008-04-02 17:36:05,534 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000010 > 2008-04-02 17:36:05,534 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000011 > 2008-04-02 17:36:05,535 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000012 > 2008-04-02 17:36:05,535 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000013 > 2008-04-02 17:36:05,535 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000014 > 2008-04-02 17:36:05,535 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000015 > 2008-04-02 17:36:05,535 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000016 > 2008-04-02 17:36:05,535 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000017 > 2008-04-02 17:36:05,535 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000018 > 2008-04-02 17:36:05,536 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Error message from task (reduce) tip_200803281454_0795_r_000019 > 2008-04-02 17:36:05,539 [main] ERROR org.apache.pig.tools.grunt.Grunt - java.io.IOException: Unable to store alias null > at org.apache.pig.impl.util.WrappedIOException.wrap(WrappedIOException.java:16) > at org.apache.pig.PigServer.registerQuery(PigServer.java:283) > at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:446) > at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:226) > at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:62) > at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:60) > at org.apache.pig.Main.main(Main.java:265) > Caused by: org.apache.pig.backend.executionengine.ExecException: java.io.IOException: Job failed > at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:288) > at org.apache.pig.PigServer.optimizeAndRunQuery(PigServer.java:400) > at org.apache.pig.PigServer.registerQuery(PigServer.java:280) > ... 5 more > Caused by: java.io.IOException: Job failed > at org.apache.pig.backend.hadoop.executionengine.POMapreduce.open(POMapreduce.java:179) > at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:274) > ... 7 more > 2008-04-02 17:36:05,539 [main] ERROR org.apache.pig.tools.grunt.Grunt - Unable to store alias null > {noformat} -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.