hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] Assigned: (PIG-903) ILLUSTRATE fails on 'Distinct' operator
Date Mon, 13 Sep 2010 22:36:38 GMT

     [ https://issues.apache.org/jira/browse/PIG-903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Alan Gates reassigned PIG-903:
------------------------------

    Assignee: Yan Zhou

> ILLUSTRATE fails on 'Distinct' operator
> ---------------------------------------
>
>                 Key: PIG-903
>                 URL: https://issues.apache.org/jira/browse/PIG-903
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Dmitriy V. Ryaboy
>            Assignee: Yan Zhou
>             Fix For: 0.9.0
>
>
> Using the latest Pig from trunk (0.3+) in mapreduce mode, running through the tutorial
script script1-hadoop.pig works fine.
> However, executing the following illustrate command throws an exception:
> illustrate ngramed2
> Pig Stack Trace
> ---------------
> ERROR 2999: Unexpected internal error. Unrecognized logical operator.
> java.lang.RuntimeException: Unrecognized logical operator.
>         at org.apache.pig.pen.EquivalenceClasses.GetEquivalenceClasses(EquivalenceClasses.java:60)
>         at org.apache.pig.pen.DerivedDataVisitor.evaluateOperator(DerivedDataVisitor.java:368)
>         at org.apache.pig.pen.DerivedDataVisitor.visit(DerivedDataVisitor.java:226)
>         at org.apache.pig.impl.logicalLayer.LODistinct.visit(LODistinct.java:104)
>         at org.apache.pig.impl.logicalLayer.LODistinct.visit(LODistinct.java:37)
>         at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
>         at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
>         at org.apache.pig.pen.LineageTrimmingVisitor.init(LineageTrimmingVisitor.java:98)
>         at org.apache.pig.pen.LineageTrimmingVisitor.<init>(LineageTrimmingVisitor.java:90)
>         at org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:106)
>         at org.apache.pig.PigServer.getExamples(PigServer.java:724)
>         at org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.java:541)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:195)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
>         at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:75)
>         at org.apache.pig.Main.main(Main.java:361)
> ================================================================================
> This works:
> illustrate ngramed1;
> Although it does throw a few NPEs :
> java.lang.NullPointerException
> 	at org.apache.pig.pen.util.DisplayExamples.ShortenField(DisplayExamples.java:205)
> 	at org.apache.pig.pen.util.DisplayExamples.MakeArray(DisplayExamples.java:190)
> 	at org.apache.pig.pen.util.DisplayExamples.PrintTabular(DisplayExamples.java:86)
> [...]
> (illustrate also doesn't work on bzipped input, but that's a separate issue)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message