hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1165) Signature of loader does not set correctly for order by
Date Tue, 22 Dec 2009 00:28:18 GMT

    [ https://issues.apache.org/jira/browse/PIG-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793434#action_12793434
] 

Olga Natkovich commented on PIG-1165:
-------------------------------------

+1; changes look good!

> Signature of loader does not set correctly for order by
> -------------------------------------------------------
>
>                 Key: PIG-1165
>                 URL: https://issues.apache.org/jira/browse/PIG-1165
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.6.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.6.0
>
>         Attachments: PIG-1165-1.patch
>
>
> In pig, we need to set signature for each LoadFunc. Currently, we use alias of the LOAD
statement in Pig script of the signature of the LoadFunc. One use case we have is in LoadFunc,
we use signature to retrieve pruned columns of each specific loader. However, in "order by"
statement, we do not set signature for the loader correctly. In this case, we do not prune
the loader correctly. 
> For example, the following script produce wrong result:
> {code}
> a = load '1.txt' as (a0, a1);
> b = order a by a1;
> c = order b by a1;
> d = foreach c generate a1;
> dump d;
> {code}
> 1.txt:
> {code}
> 1       a
> 2       b
> 3       c
> 6       d
> 5       e
> {code}
> expected result:
> a
> b
> c
> d
> e
> current result:
> 1
> 2
> 3
> 5
> 6

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message