hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Santhosh Srinivasan (JIRA)" <j...@apache.org>
Subject [jira] Created: (PIG-877) Push up filter does not account for added columns in foreach
Date Fri, 10 Jul 2009 00:38:14 GMT
Push up filter does not account for added columns in foreach
------------------------------------------------------------

                 Key: PIG-877
                 URL: https://issues.apache.org/jira/browse/PIG-877
             Project: Pig
          Issue Type: Bug
    Affects Versions: 0.3.1
            Reporter: Santhosh Srinivasan
             Fix For: 0.3.1


If a filter follows a foreach that produces an added column then push up filter fails with
a null pointer exception.

{code}
...
x = foreach w generate $0, COUNT($1);
y = filter x by $1 > 10;
{code}

In the above example, the column in the filter's expression is an added column. As a result,
the optimizer rule is not able to map it back to the input resulting in a null value. The
subsequent for loop is failing due to NPE.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message