hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xu Zhang (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-186) Pig appears to hang with this Pig script
Date Mon, 07 Apr 2008 20:35:24 GMT

     [ https://issues.apache.org/jira/browse/PIG-186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xu Zhang updated PIG-186:
-------------------------

    Description: 
Pig stoped at progress 56%.   It seemed there had been exceptions on the the reduce task trackers
(see below).  But waiting for 20 reduce tasks to time out themselves is excruciating and blocking
my other tests.

Here is my Pig script:

{code}
define X `DataGuaranteeTest.pl -n 1` ship('/home/xu/streamingscript/DataGuaranteeTest.pl');
A = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
B = group A by name;
C = foreach B generate flatten(A);
D = stream C through X;
store D into 'results_24';
{code}

Here is the exception on the reduce task trackers:

{noformat}
java.lang.RuntimeException: java.io.IOException: Cannot run program "./home/xu/streamingscript/DataGuaranteeTest.pl":
java.io.IOException: error=2, No such file or directory
	at org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:132)
	at org.apache.pig.impl.eval.StreamSpec.setupDefaultPipe(StreamSpec.java:91)
	at org.apache.pig.impl.eval.CompositeEvalSpec.setupDefaultPipe(CompositeEvalSpec.java:51)
	at org.apache.pig.impl.eval.EvalSpec.setupPipe(EvalSpec.java:123)
	at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.setupReducePipe(PigMapReduce.java:303)
	at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.reduce(PigMapReduce.java:140)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:333)
	at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2071)
{noformat}

I will attach DataGuaranteeTest.pl to the report



  was:
Pig stoped at progress 56%.   It seemed there had been exceptions on the the reduce task trackers
(see below).  But waiting for 20 reduce tasks to time out themselves is excruciating and blocking
my other tests.

Here is my Pig script:

{code}
define X `./home/xu/streamingscript/DataGuaranteeTest.pl -n 1` ship('/home/xu/streamingscript/DataGuaranteeTest.pl');
A = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
B = group A by name;
C = foreach B generate flatten(A);
D = stream C through X;
store D into 'results_24';
{code}

Here is the exception on the reduce task trackers:

{noformat}
java.lang.RuntimeException: java.io.IOException: Cannot run program "./home/xu/streamingscript/DataGuaranteeTest.pl":
java.io.IOException: error=2, No such file or directory
	at org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:132)
	at org.apache.pig.impl.eval.StreamSpec.setupDefaultPipe(StreamSpec.java:91)
	at org.apache.pig.impl.eval.CompositeEvalSpec.setupDefaultPipe(CompositeEvalSpec.java:51)
	at org.apache.pig.impl.eval.EvalSpec.setupPipe(EvalSpec.java:123)
	at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.setupReducePipe(PigMapReduce.java:303)
	at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.reduce(PigMapReduce.java:140)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:333)
	at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2071)
{noformat}

I will attach DataGuaranteeTest.pl to the report




The second form of command is exactly what I used.  I just updated the description of the
bug.  Sorry for the confusion.

> Pig appears to hang with this Pig script
> ----------------------------------------
>
>                 Key: PIG-186
>                 URL: https://issues.apache.org/jira/browse/PIG-186
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Xu Zhang
>            Assignee: Arun C Murthy
>            Priority: Critical
>         Attachments: DataGuaranteeTest.pl
>
>
> Pig stoped at progress 56%.   It seemed there had been exceptions on the the reduce task
trackers (see below).  But waiting for 20 reduce tasks to time out themselves is excruciating
and blocking my other tests.
> Here is my Pig script:
> {code}
> define X `DataGuaranteeTest.pl -n 1` ship('/home/xu/streamingscript/DataGuaranteeTest.pl');
> A = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
> B = group A by name;
> C = foreach B generate flatten(A);
> D = stream C through X;
> store D into 'results_24';
> {code}
> Here is the exception on the reduce task trackers:
> {noformat}
> java.lang.RuntimeException: java.io.IOException: Cannot run program "./home/xu/streamingscript/DataGuaranteeTest.pl":
java.io.IOException: error=2, No such file or directory
> 	at org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:132)
> 	at org.apache.pig.impl.eval.StreamSpec.setupDefaultPipe(StreamSpec.java:91)
> 	at org.apache.pig.impl.eval.CompositeEvalSpec.setupDefaultPipe(CompositeEvalSpec.java:51)
> 	at org.apache.pig.impl.eval.EvalSpec.setupPipe(EvalSpec.java:123)
> 	at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.setupReducePipe(PigMapReduce.java:303)
> 	at org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.reduce(PigMapReduce.java:140)
> 	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:333)
> 	at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2071)
> {noformat}
> I will attach DataGuaranteeTest.pl to the report

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message