pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-174) Pig hangs at progress 0% in this case
Date Sat, 29 Mar 2008 16:34:24 GMT

    [ https://issues.apache.org/jira/browse/PIG-174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583338#action_12583338
] 

Olga Natkovich commented on PIG-174:
------------------------------------

Arun, couple of comments:

(1) I will check on Monday but my guess is that perl is there but not in /home/y/bin
(2) The main problem here is that we hang and almost bring the cluster down. This is the one
we need to figure out and resolve
(3) Xu was running on piglet so you can try it there to reproduce the problem. Please, don't
do it till Monday though as I am running some tests and this pretty much kills the cluster

> Pig hangs at progress 0% in this case
> -------------------------------------
>
>                 Key: PIG-174
>                 URL: https://issues.apache.org/jira/browse/PIG-174
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Xu Zhang
>            Assignee: Arun C Murthy
>
> Pig appears to hang at progress 0% with the following console output:
> {noformat}
> 2008-03-28 13:58:50,398 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine
- Connecting to hadoop file system at: wilbur11.labs.corp.sp1.yahoo.com:8020
> 2008-03-28 13:58:51,342 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce
- ----- MapReduce Job -----
> 2008-03-28 13:58:51,343 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce
- Input: [/user/pig/tests/data/singlefile/studenttab10k:org.apache.pig.builtin.PigStorage()]
> 2008-03-28 13:58:51,343 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce
- Map: [[*]->org.apache.pig.impl.eval.StreamSpec@16fa474]
> 2008-03-28 13:58:51,343 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce
- Group: null
> 2008-03-28 13:58:51,343 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce
- Combine: null
> 2008-03-28 13:58:51,344 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce
- Reduce: null
> 2008-03-28 13:58:51,344 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce
- Output: results_7:org.apache.pig.builtin.PigStorage
> 2008-03-28 13:58:51,344 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce
- Split: null
> 2008-03-28 13:58:51,344 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce
- Map parallelism: -1
> 2008-03-28 13:58:51,344 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce
- Reduce parallelism: -1
> 2008-03-28 13:58:54,245 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher
- Pig progress = 0%
> {noformat}
> The contents of the pig script used is as follows:
> {code}
> define X `./streamingscript/MySimpleStreamApp.pl` ship('./streamingscript/MySimpleStreamApp.pl');
> A = load '/user/pig/tests/data/singlefile/studenttab10k';
> B = stream A through X;
> store B into 'results_7';
> {code}
> The streaming script "MySimpleStreamApp.pl" is as follows and it is located under the
streamingscript directory in my home directory.  I issued the pig command from my home directory.
> {code}
> #!/home/y/bin/perl
> while (<>) {
>     chomp;
>     print "$_\n";
> }
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message