hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pradeep Kamath (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-946) Combiner optimizer does not optimize when limit follow group, foreach
Date Thu, 10 Sep 2009 01:07:57 GMT

     [ https://issues.apache.org/jira/browse/PIG-946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Pradeep Kamath updated PIG-946:
-------------------------------

    Attachment: PIG-946-codechange-draft.patch

Attached patch has a first draft of the code changes required in CombinerOptiimizer.java.
This is a non tested draft patch - needs to be augmented with testcases - attaching it merely
for reference - should not be committed yet.

> Combiner optimizer does not optimize when limit follow group, foreach
> ---------------------------------------------------------------------
>
>                 Key: PIG-946
>                 URL: https://issues.apache.org/jira/browse/PIG-946
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.3.0
>            Reporter: Pradeep Kamath
>         Attachments: PIG-946-codechange-draft.patch
>
>
> The following script is combinable but is not optimized:
> a = load '/user/pig/tests/data/singlefile/studenttab10k';
> b = group a by $1;
> c = foreach b generate group, AVG(a.$2);
> d = limit c 10;
> dump d;

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message