hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-878) Pig is returning too many blocks in the InputSplit
Date Mon, 20 Jul 2009 17:43:14 GMT

    [ https://issues.apache.org/jira/browse/PIG-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12733293#action_12733293
] 

Alan Gates commented on PIG-878:
--------------------------------

Should note also that I didn't add any tests because this was a fix for existing functionality,
and frankly I'm not exactly sure how to test it.

Also should have noted thanks to Milind for first brining this to our attention.

> Pig is returning too many blocks in the InputSplit
> --------------------------------------------------
>
>                 Key: PIG-878
>                 URL: https://issues.apache.org/jira/browse/PIG-878
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.3.0
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>            Priority: Critical
>             Fix For: 0.4.0
>
>         Attachments: PIG-878.patch
>
>
> When SlicerWrapper builds a slice, it currently returns the 3 locations for every block
in the file it is slicing, instead of the 3 locations for the block covered by that slice.
 This means Pig's odds of having its maps placed on nodes local to the data goes way down.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message