hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mingliang Liu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-12473) distcp's ignoring failures should be mutually exclusive with the atomic option
Date Wed, 18 Nov 2015 19:45:11 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Mingliang Liu updated HADOOP-12473:
-----------------------------------
    Hadoop Flags:   (was: Reviewed)

> distcp's ignoring failures should be mutually exclusive with the atomic option
> ------------------------------------------------------------------------------
>
>                 Key: HADOOP-12473
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12473
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: tools/distcp
>    Affects Versions: 2.7.1
>            Reporter: Mingliang Liu
>            Assignee: Mingliang Liu
>            Priority: Critical
>             Fix For: 2.8.0
>
>         Attachments: HADOOP-12473.000.patch, HADOOP-12473.001.patch, HADOOP-12473.002.patch
>
>
> In {{CopyMapper::handleFailure}}, the mapper handles failure and will ignore it if no
it's config key is on. Ignoring failures should be mutually exclusive with the atomic option
otherwise an incomplete dir is eligible for commit defeating the purpose.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message