hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xu Zhang (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-186) Pig appears to hang with this Pig script
Date Fri, 04 Apr 2008 01:27:24 GMT

     [ https://issues.apache.org/jira/browse/PIG-186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xu Zhang updated PIG-186:
-------------------------

    Attachment: DataGuaranteeTest.pl

> Pig appears to hang with this Pig script
> ----------------------------------------
>
>                 Key: PIG-186
>                 URL: https://issues.apache.org/jira/browse/PIG-186
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Xu Zhang
>            Assignee: Arun C Murthy
>            Priority: Critical
>         Attachments: DataGuaranteeTest.pl
>
>
> Pig stoped at progress 56%.   It seemed there had been exceptions on the the reduce task
trackers (see below).  But waiting for 20 reduce tasks to time out themselves is excruciating
and blocking my other tests.
> Here is my Pig script:
> {code}
> define X `./home/xu/streamingscript/DataGuaranteeTest.pl -n 1` ship('/home/xu/streamingscript/DataGuaranteeTest.pl');
> A = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
> B = group A by name;
> C = foreach B generate flatten(A);
> D = stream C through X;
> store D into 'results_24';
> {code}
> Here is the exception on the reduce task trackers:
> {noformat}
> java.lang.RuntimeException: java.io.IOException: Cannot run program "./home/xu/streamingscript/DataGuaranteeTest.pl":
java.io.IOException: error=2, No such file or directory
> 	at org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:132)
> 	at org.apache.pig.impl.eval.StreamSpec.setupDefaultPipe(StreamSpec.java:91)
> 	at org.apache.pig.impl.eval.CompositeEvalSpec.setupDefaultPipe(CompositeEvalSpec.java:51)
> 	at org.apache.pig.impl.eval.EvalSpec.setupPipe(EvalSpec.java:123)
> 	at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.setupReducePipe(PigMapReduce.java:303)
> 	at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.reduce(PigMapReduce.java:140)
> 	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:333)
> 	at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2071)
> {noformat}
> I will attach DataGuaranteeTest.pl to the report

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message