hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ying He (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-1135) skewed join partitioner returns negative partition index
Date Wed, 09 Dec 2009 01:58:18 GMT

     [ https://issues.apache.org/jira/browse/PIG-1135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ying He updated PIG-1135:
-------------------------

    Description: skewed join returns negative reducer index  (was: Fragmented replicated join
has a few limitations:
 - One of the tables needs to be loaded into memory
 - Join is limited to two tables

Skewed join partitions the table and joins the records in the reduce phase. It computes a
histogram of the key space to account for skewing in the input records. Further, it adjusts
the number of reducers depending on the key distribution.

We need to implement the skewed join in pig.)

> skewed join partitioner returns negative partition index 
> ---------------------------------------------------------
>
>                 Key: PIG-1135
>                 URL: https://issues.apache.org/jira/browse/PIG-1135
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Ying He
>            Assignee: Sriranjan Manjunath
>
> skewed join returns negative reducer index

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message