hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6451) DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic
Date Fri, 30 Oct 2015 21:10:28 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14983321#comment-14983321
] 

Kihwal Lee commented on MAPREDUCE-6451:
---------------------------------------

bq did you forget the DynamicInputChunkContext class when you commit?
It is a Friday. :)  Fixed it. Thanks for reporting.

> DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6451
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6451
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: distcp
>    Affects Versions: 2.6.0
>            Reporter: Kuhu Shukla
>            Assignee: Kuhu Shukla
>             Fix For: 3.0.0, 2.7.2
>
>         Attachments: MAPREDUCE-6451-v1.patch, MAPREDUCE-6451-v2.patch, MAPREDUCE-6451-v3.patch,
MAPREDUCE-6451-v4.patch, MAPREDUCE-6451-v5.patch
>
>
> DistCp when used with dynamic strategy does not update the chunkFilePath and other static
variables any time other than for the first job. This is seen when DistCp::run() is used.

> A single copy succeeds but multiple jobs finish successfully without any real copying.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message