hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ivan Bella (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6275) Race condition in FileOutputCommitter v2 for user-specified task output subdirs
Date Wed, 18 Mar 2015 02:47:38 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366536#comment-14366536
] 

Ivan Bella commented on MAPREDUCE-6275:
---------------------------------------

I would have to say if someone is creating a reducer that creates both files and directories
of the same name, then the code will have to select one over the other or simply fail to merge.
 I would think failing would be a better choice but perhaps there was a reason for the original
choice.  In any case the original contract is being preserved here and that change should
be a separate Jira ticket.

> Race condition in FileOutputCommitter v2 for user-specified task output subdirs
> -------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6275
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6275
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Siqi Li
>            Assignee: Gera Shegalov
>            Priority: Critical
>         Attachments: MAPREDUCE-6275.002.patch, MAPREDUCE-6275.v1.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message