hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: getting the process id of mapreduce tasks
Date Thu, 29 Sep 2011 04:42:00 GMT
Hello Bikash,

The tasks run on the tasktracker, so that is where you'll need to look
for the process ID -- not the JobTracker/client.

Crudely speaking,
$ ssh tasktracker01 # or whichever.
$ jps | grep Child | cut -d " " -f 1
# And lo, PIDs to play with.

On Thu, Sep 29, 2011 at 12:15 AM, bikash sharma <sharmabiks.07@gmail.com> wrote:
> Hi,
> Is it possible to get the process id of each task in a MapReduce job?
> When I run a mapreduce job and do a monitoring in linux using ps, i just see
> the id of the mapreduce job process but not its constituent map/reduce
> tasks.
> The use case is to monitor the resource usage of each task by using sar
> utility in linux with specific process id of task.
> Thanks,
> Bikash

Harsh J

View raw message