hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6248) Allow users to get the MR job information for distcp
Date Wed, 04 Mar 2015 15:36:07 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347033#comment-14347033

Hudson commented on MAPREDUCE-6248:

SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2072 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2072/])
MAPREDUCE-6248. Exposed the internal MapReduce job's information as a public API in DistCp.
Contributed by Jing Zhao. (vinodkv: rev 5af693fde26755b6f175bd65f93cf4a80de0d1e0)
* hadoop-mapreduce-project/CHANGES.txt
* hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCp.java

> Allow users to get the MR job information for distcp
> ----------------------------------------------------
>                 Key: MAPREDUCE-6248
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6248
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: distcp
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>             Fix For: 2.7.0
>         Attachments: MAPREDUCE-6248.000.patch, MAPREDUCE-6248.001.patch
> Currently the DistCp is acting as a tool and the corresponding MapReduce Job  is created
and used inside of its {{execute}} method. It is thus difficult for external services to query
its progress and counters. It may be helpful to persist the job id into a file inside its
staging directory.

This message was sent by Atlassian JIRA

View raw message