hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Zhang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1214) Add support for counters in Hadoop Local Mode
Date Mon, 14 Dec 2009 14:07:18 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12790166#action_12790166
] 

Jeff Zhang commented on MAPREDUCE-1214:
---------------------------------------

Hi Ankit,

I checked the code in pig, and find that you use the JobClient the HExecutionEngine, but actually
the JobClient in org.apache.hadoop.mapred.jobcontrol.Job submit the job. And each JobClient
will create a LocalJobRunner, so that means you use the wrong JobClient/LocalJobRunner to
get RunningJob. This won't affect the mapreduce mode, because you only have one master node
as the JobTracker.

Forgive me to attach the Pig patch here.
Ankit, do you have the JIRA for this issue in Pig, I can move the patch there.



> Add support for counters in Hadoop Local Mode
> ---------------------------------------------
>
>                 Key: MAPREDUCE-1214
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1214
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Ankit Modi
>         Attachments: MAPREDUCE-1214.patch
>
>
> Currently there is no support for counters ( Records and Bytes written ) in Hadoop Local
Mode.
> Pig requires to provide counters to user when running in Hadoop Local Mode.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message