pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yan Zhou (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1731) New Logical Plan: FILTER fails when there are multiple conditions
Date Wed, 17 Nov 2010 00:37:13 GMT

    [ https://issues.apache.org/jira/browse/PIG-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932732#action_12932732
] 

Yan Zhou commented on PIG-1731:
-------------------------------

If there is no AND in this test, the simplifier won't check for the equality of the two UDF
calls so it is ok too.

> New Logical Plan: FILTER fails when there are multiple conditions
> -----------------------------------------------------------------
>
>                 Key: PIG-1731
>                 URL: https://issues.apache.org/jira/browse/PIG-1731
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.8.0
>            Reporter: Sherry Chen
>            Assignee: Yan Zhou
>             Fix For: 0.8.0
>
>         Attachments: PIG-1731.patch
>
>
> Following pig script fails:
> ===========
> REGISTER string.jar;
> A = LOAD 'data' USING PigStorage() AS (a0:chararray, a1, a2);
> B = FOREACH A GENERATE a0;
> C = DISTINCT B;
> D = FILTER C BY string.LENGTH(a0) <= 50 AND string.LENGTH(a0) > 1; 
> STORE D INTO 'D';
> ===========
> 2010-11-16 22:11:38,097 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine
- pig.usenewlogicalplan is set to true. New logical plan will be used.
> 2010-11-16 22:11:38,202 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled
internal error. null
> But this one works:
> ===========
> REGISTER string.jar;
> A = LOAD 'data' USING PigStorage() AS (a0:chararray, a1, a2);
> B = FOREACH A GENERATE a0;
> C = DISTINCT B;
> D = FILTER C BY string.LENGTH(a0) <= 50;
> E = FILTER D BY string.LENGTH(a0) > 1; 
> STORE E INTO 'D';
> ===========
> Input data:
> ===========
> Jerry   Jerry   0.55
> Dave    David   0.15
> Danny   Dan     0.015
> S       Smith   0.2
> AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA        Amy     0.8
> ===========

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message