hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gianmarco De Francisci Morales (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-617) Using SUM with basic type fails
Date Sat, 08 May 2010 12:37:48 GMT

    [ https://issues.apache.org/jira/browse/PIG-617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12865455#action_12865455
] 

Gianmarco De Francisci Morales commented on PIG-617:
----------------------------------------------------

This issue has been solved in trunk


grunt> a = load 'data' as (i:int); 
grunt> b = foreach a generate SUM(i);
grunt> dump b;
2010-05-08 14:35:11,348 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1045: Could
not infer the matching function for org.apache.pig.builtin.SUM as multiple or none of them
fit. Please use an explicit cast.


> Using SUM with basic type fails
> -------------------------------
>
>                 Key: PIG-617
>                 URL: https://issues.apache.org/jira/browse/PIG-617
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.2.0
>            Reporter: Santhosh Srinivasan
>
> SUM is an aggregate function that expects a bag as an argument. When basic types are
used as arguments to SUM, Pig fails during run time. The typechecker should catch this error
and fail earlier.
> An example is given below:
> {code}
> grunt> a = load 'one' as (i: int);
> grunt> b = foreach a generate SUM(i);
> grunt> dump b;
> 2009-01-12 14:11:47,595 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 0% complete
> 2009-01-12 14:12:12,617 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Map reduce job failed
> 2009-01-12 14:12:12,618 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Job failed!
> 2009-01-12 14:12:12,623 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher
- Error message from task (map) task_200812151518_9683_m_000000java.lang.ClassCastException:
java.lang.Integer cannot be cast to org.apache.pig.data.DataBag
> 2009-01-12 14:12:12,623 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher
- Error message from task (map) task_200812151518_9683_m_000000java.lang.ClassCastException:
java.lang.Integer cannot be cast to org.apache.pig.data.DataBag
>         at org.apache.pig.builtin.IntSum.sum(IntSum.java:141)
>         at org.apache.pig.builtin.IntSum.exec(IntSum.java:41)
>         at org.apache.pig.builtin.IntSum.exec(IntSum.java:36)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:185)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:247)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:265)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:197)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:187)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:175)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.map(PigMapOnly.java:65)
>         at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207)
> ...
> 2009-01-12 14:12:12,629 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1066: Unable
to open iterator for alias b
> 2009-01-12 14:12:12,629 [main] ERROR org.apache.pig.tools.grunt.Grunt - org.apache.pig.impl.logicalLayer.FrontendException:
Unable to open iterator for alias b
>         at org.apache.pig.PigServer.openIterator(PigServer.java:425)
>         at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:271)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:178)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:84)
>         at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:72)
>         at org.apache.pig.Main.main(Main.java:302)
> Caused by: java.io.IOException: Job terminated with anomalous status FAILED
>         at org.apache.pig.PigServer.openIterator(PigServer.java:419)
>         ... 5 more
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message