pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rakesh Setty (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-802) PERFORMANCE: not creating bags for ORDER BY
Date Sat, 23 May 2009 00:40:45 GMT

     [ https://issues.apache.org/jira/browse/PIG-802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Rakesh Setty updated PIG-802:

    Attachment: OrderByOptimization.patch

Attaching the modified patch. The detachInput method in POPackageLite will set key and tupIter
to null. So ReadOnceBag maintains separate references to them. POPackageLite overloads the
getValueTuple method with the additional key parameter to use the one provided by ReadOnceBag.
The implementation of POPackage is untouched.

> PERFORMANCE: not creating bags for ORDER BY
> -------------------------------------------
>                 Key: PIG-802
>                 URL: https://issues.apache.org/jira/browse/PIG-802
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.2.0
>            Reporter: Olga Natkovich
>         Attachments: OrderByOptimization.patch
> Order by should be changed to not use POPackage to put all of the tuples in a bag on
the reduce side, as the bag is just immediately flattened. It can instead work like join does
for the last input in the join. 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message