hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sriranjan Manjunath (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-962) Skewed join creates 3 map reduce jobs
Date Tue, 15 Sep 2009 20:53:57 GMT

     [ https://issues.apache.org/jira/browse/PIG-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sriranjan Manjunath updated PIG-962:
------------------------------------

    Attachment: skewedjoin2job.patch

The attached patch resolves this issue.

> Skewed join creates 3 map reduce jobs
> -------------------------------------
>
>                 Key: PIG-962
>                 URL: https://issues.apache.org/jira/browse/PIG-962
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Sriranjan Manjunath
>            Assignee: Sriranjan Manjunath
>         Attachments: skewedjoin2job.patch
>
>
> The first job is a load / store job which loads the data from PigStorage and stores it
in BinStorage. This hampers performance. The desired behavior is for the sampler to read from
PigStorage instead of relying on the first load/store job. Skewed join should thus be 2 M/R
jobs and not 3.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message