hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-1493) Column Pruner throw exception "inconsistent pruning"
Date Mon, 19 Jul 2010 17:13:49 GMT

     [ https://issues.apache.org/jira/browse/PIG-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daniel Dai updated PIG-1493:
----------------------------

          Status: Resolved  (was: Patch Available)
    Hadoop Flags: [Reviewed]
      Resolution: Fixed

Patch committed to both trunk and 0.7 branch.

> Column Pruner throw exception "inconsistent pruning"
> ----------------------------------------------------
>
>                 Key: PIG-1493
>                 URL: https://issues.apache.org/jira/browse/PIG-1493
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.8.0, 0.7.0
>
>         Attachments: PIG-1493-1.patch
>
>
> The following script fail:
> {code}
> a = load '1.txt' as (a0:chararray, a1:chararray, a2);
> b = foreach a generate CONCAT(a0,a1) as b0, a0, a2;
> c = foreach b generate a0, a2;
> dump c;
> {code}
> Error message:
> ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator
for alias c
>         at org.apache.pig.PigServer.openIterator(PigServer.java:698)
>         at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:595)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:291)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:162)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:138)
>         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
>         at org.apache.pig.Main.run(Main.java:451)
>         at org.apache.pig.Main.main(Main.java:103)
> Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to
store alias c
>         at org.apache.pig.PigServer.storeEx(PigServer.java:804)
>         at org.apache.pig.PigServer.store(PigServer.java:760)
>         at org.apache.pig.PigServer.openIterator(PigServer.java:680)
>         ... 7 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2212: Unable
to prune plan
>         at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:826)
>         at org.apache.pig.impl.logicalLayer.optimizer.LogicalOptimizer.optimize(LogicalOptimizer.java:240)
>         at org.apache.pig.PigServer.compileLp(PigServer.java:1180)
>         at org.apache.pig.PigServer.storeEx(PigServer.java:799)
>         ... 9 more
> Caused by: org.apache.pig.impl.plan.VisitorException: ERROR 2188: Cannot prune columns
for (Name: b: ForEach 1-50 Operator Key: 1-50)
>         at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:177)
>         at org.apache.pig.impl.logicalLayer.ColumnPruner.visit(ColumnPruner.java:202)
>         at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:132)
>         at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:47)
>         at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:69)
>         at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
>         at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:821)
>         ... 12 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2185: Column
$0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
>         at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:148)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message