hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sangjin Lee (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5038) old API CombineFileInputFormat missing fixes that are in new API
Date Tue, 05 Mar 2013 22:26:13 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594002#comment-13594002

Sangjin Lee commented on MAPREDUCE-5038:

I filed MAPREDUCE-5046 to backport MAPREDUCE-1423, then found this.

I took a look at the patch here, but I'm not sure if it subsumes the changes contained in
MAPREDUCE-1423. Specifically, rackToNodes seems still static, which is a thread-safety problem.
Could you absorb the fix that's in MAPREDUCE-1423? I'd be happy to look at that if you want.
> old API CombineFileInputFormat missing fixes that are in new API 
> -----------------------------------------------------------------
>                 Key: MAPREDUCE-5038
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5038
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 1.1.1
>            Reporter: Sandy Ryza
>            Assignee: Sandy Ryza
>         Attachments: MAPREDUCE-5038.patch
> The following changes patched the CombineFileInputFormat in mapreduce, but neglected
the one in mapred
> MAPREDUCE-1597 enabled the CombineFileInputFormat to work on splittable files
> MAPREDUCE-2021 solved returning duplicate hostnames in split locations
> MAPREDUCE-1806 CombineFileInputFormat does not work with paths not on default FS
> In trunk this is not an issue as the one in mapred extends the one in mapreduce.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message