hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-651) PERFORMANCE: Use specialized POForEachNoFlatten for cases where the foreach has no flattens
Date Fri, 18 Sep 2009 17:54:16 GMT

    [ https://issues.apache.org/jira/browse/PIG-651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757297#action_12757297
] 

Alan Gates commented on PIG-651:
--------------------------------

Is it worth adding this complexity to the code for a 2% speed up?  I'd vote no.

> PERFORMANCE: Use specialized POForEachNoFlatten for cases where the foreach has no flattens
> -------------------------------------------------------------------------------------------
>
>                 Key: PIG-651
>                 URL: https://issues.apache.org/jira/browse/PIG-651
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.2.0
>            Reporter: Pradeep Kamath
>            Assignee: Pradeep Kamath
>         Attachments: PIG-651.patch
>
>
> POForEach has lot of code to handle flattening (cross product) of the fields in the generate.
This is relevant only when atleast one field in the generate needs to be flattened. If all
fields in the generate do not need to be flattened, a more simplified and hopefully more efficient
POForEach can be used.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message