hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Swati Jain (JIRA)" <j...@apache.org>
Subject [jira] Created: (PIG-1532) PIG Logical Optimization: Use CNF in FilterAboveForeach
Date Sun, 01 Aug 2010 00:27:16 GMT
PIG Logical Optimization: Use CNF in FilterAboveForeach

                 Key: PIG-1532
                 URL: https://issues.apache.org/jira/browse/PIG-1532
             Project: Pig
          Issue Type: Bug
          Components: impl
            Reporter: Swati Jain
            Priority: Minor

Consider the following program, ( g1-4 < 348 ) predicate should be pushed above LOForeach.
This would be possible if we convert the filter expression into CNF and push individual conjuncts
below LOForeach.

A = load 'f1' USING PigStorage(',') as (a1:int,a2:int,a3:int);
B = load 'f2' USING PigStorage(',') as (b1:int,b2:int);
G1 = GROUP A by a1, B by b1;
C = FOREACH G1 GENERATE group as g1, MAX(A.a2) as max_a2, COUNT_STAR(B.b2) as max_b2;
D = Filter C by (g1+max_a2 > 1 or g1 >= 23) and ( g1-4 < 348 );
explain D;

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message