hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pradeep Kamath (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-922) Logical optimizer: push up project
Date Wed, 02 Dec 2009 20:12:20 GMT

    [ https://issues.apache.org/jira/browse/PIG-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12784985#action_12784985
] 

Pradeep Kamath commented on PIG-922:
------------------------------------

I reviewed the changes to pass the load signature to the slicer/Slice and PigStorage for column
pruning to work on the backend - the changes look good. The one change I wasn't clear about
was the use of signature in order by since currently LOSort's alias is used as the signature
and that would not be useful to the Slicer/slice or PigStorage in the backend since they would
expect the LOLoad's alias.

> Logical optimizer: push up project
> ----------------------------------
>
>                 Key: PIG-922
>                 URL: https://issues.apache.org/jira/browse/PIG-922
>             Project: Pig
>          Issue Type: New Feature
>          Components: impl
>    Affects Versions: 0.3.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.6.0
>
>         Attachments: PIG-922-p1_0.patch, PIG-922-p1_1.patch, PIG-922-p1_2.patch, PIG-922-p1_3.patch,
PIG-922-p1_4.patch, PIG-922-p2_preview.patch, PIG-922-p2_preview2.patch, PIG-922-p3_1.patch,
PIG-922-p3_10.patch, PIG-922-p3_11.patch, PIG-922-p3_12.patch, PIG-922-p3_13.patch, PIG-922-p3_2.patch,
PIG-922-p3_3.patch, PIG-922-p3_4.patch, PIG-922-p3_5.patch, PIG-922-p3_6.patch, PIG-922-p3_7.patch,
PIG-922-p3_8.patch, PIG-922-p3_9.patch
>
>
> This is a continuation work of [PIG-697|https://issues.apache.org/jira/browse/PIG-697].
We need to add another rule to the logical optimizer: Push up project, ie, prune columns as
early as possible.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message