pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rohini Palaniswamy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-4406) Splits prevent optimized joins/groups
Date Mon, 02 Feb 2015 22:38:35 GMT

    [ https://issues.apache.org/jira/browse/PIG-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302076#comment-14302076

Rohini Palaniswamy commented on PIG-4406:

    Can you elaborate more on the cases with example scripts?  I know that the SecondaryKeyOptimizer
is turned off with a split making order by in a nested foreach after group by inefficient.
But what is the join case you are talking about?

> Splits prevent optimized joins/groups
> -------------------------------------
>                 Key: PIG-4406
>                 URL: https://issues.apache.org/jira/browse/PIG-4406
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Brian Johnson
> If you have either an explicit or plan generated split you can't do any optimized joins
or groups because it sees the split as the loader instead of the actual loader

This message was sent by Atlassian JIRA

View raw message