hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-910) PushUpFilter: Filter after skew LOJoin generates an error
Date Thu, 06 Aug 2009 20:01:14 GMT

    [ https://issues.apache.org/jira/browse/PIG-910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12740229#action_12740229
] 

Hadoop QA commented on PIG-910:
-------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12415657/PIG-910-1.patch
  against trunk revision 801460.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit
warnings.

    +1 core tests.  The patch passed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/152/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/152/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/152/console

This message is automatically generated.

> PushUpFilter: Filter after skew LOJoin generates an error
> ---------------------------------------------------------
>
>                 Key: PIG-910
>                 URL: https://issues.apache.org/jira/browse/PIG-910
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.3.0
>            Reporter: Daniel Dai
>             Fix For: 0.4.0
>
>         Attachments: PIG-910-1.patch
>
>
> The script is:
> A = load 'a' as (user:chararray, action, timespent, query_term, ip_addr, timestamp, estimated_revenue,
page_info, page_links);
> alpha = load 'b' as (user:chararray, action, timespent, query_term, ip_addr, timestamp,
estimated_revenue, page_info, page_links);
> C = join A by user, alpha by user using "skewed" parallel 40;
> D = filter C by A::user == 'aaa';
> store D into 'L5out';
> Stack trace is:
> ERROR 1093: Swap supports swap of operators with at most one input. Found first operator
with 2 inputs.
> org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2151:  
> Internal error while pushing filters up.
> 	at org.apache.pig.impl.logicalLayer.optimizer.PushUpFilter.transform(PushUpFilter.java:
325)
> 	at org.apache.pig.impl.logicalLayer.optimizer.LogicalOptimizer.optimize(LogicalOptimizer.java:185)
> 	at org.apache.pig.PigServer.compileLp(PigServer.java:854)
> 	at org.apache.pig.PigServer.compileLp(PigServer.java:791)
> 	at org.apache.pig.PigServer.execute(PigServer.java:760)
> 	at org.apache.pig.PigServer.access$100(PigServer.java:95)
> 	at org.apache.pig.PigServer$Graph.execute(PigServer.java:943)
> 	at org.apache.pig.PigServer.executeBatch(PigServer.java:255)
> 	at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java: 112)
> 	at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java: 169)
> 	at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java: 141)
> 	at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89)
> 	at org.apache.pig.Main.main(Main.java:320)
> Caused by: org.apache.pig.impl.plan.PlanException: ERROR 1093: Swap  supports swap of
operators with at most one input. Found first  operator with 2 inputs.
> 	at org.apache.pig.impl.plan.OperatorPlan.swap(OperatorPlan.java:964)
> 	at org.apache.pig.impl.logicalLayer.optimizer.PushUpFilter.transform(PushUpFilter.java:
310)
> 	... 12 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message