hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xu Zhang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-186) Pig appears to hang with this Pig script
Date Mon, 07 Apr 2008 18:21:24 GMT

    [ https://issues.apache.org/jira/browse/PIG-186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12586490#action_12586490
] 

Xu Zhang commented on PIG-186:
------------------------------

The "No such file or directory" exception is gone, but I got "broken pipe" exception instead.
 See the tasks UI for job_200804041056_0346 .

> Pig appears to hang with this Pig script
> ----------------------------------------
>
>                 Key: PIG-186
>                 URL: https://issues.apache.org/jira/browse/PIG-186
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Xu Zhang
>            Assignee: Arun C Murthy
>            Priority: Critical
>         Attachments: DataGuaranteeTest.pl
>
>
> Pig stoped at progress 56%.   It seemed there had been exceptions on the the reduce task
trackers (see below).  But waiting for 20 reduce tasks to time out themselves is excruciating
and blocking my other tests.
> Here is my Pig script:
> {code}
> define X `./home/xu/streamingscript/DataGuaranteeTest.pl -n 1` ship('/home/xu/streamingscript/DataGuaranteeTest.pl');
> A = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
> B = group A by name;
> C = foreach B generate flatten(A);
> D = stream C through X;
> store D into 'results_24';
> {code}
> Here is the exception on the reduce task trackers:
> {noformat}
> java.lang.RuntimeException: java.io.IOException: Cannot run program "./home/xu/streamingscript/DataGuaranteeTest.pl":
java.io.IOException: error=2, No such file or directory
> 	at org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:132)
> 	at org.apache.pig.impl.eval.StreamSpec.setupDefaultPipe(StreamSpec.java:91)
> 	at org.apache.pig.impl.eval.CompositeEvalSpec.setupDefaultPipe(CompositeEvalSpec.java:51)
> 	at org.apache.pig.impl.eval.EvalSpec.setupPipe(EvalSpec.java:123)
> 	at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.setupReducePipe(PigMapReduce.java:303)
> 	at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.reduce(PigMapReduce.java:140)
> 	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:333)
> 	at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2071)
> {noformat}
> I will attach DataGuaranteeTest.pl to the report

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message