hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bikash sharma <sharmabiks...@gmail.com>
Subject Re: getting the process id of mapreduce tasks
Date Fri, 30 Sep 2011 12:52:02 GMT
Thanks so much Harsh!

On Thu, Sep 29, 2011 at 12:42 AM, Harsh J <harsh@cloudera.com> wrote:

> Hello Bikash,
>
> The tasks run on the tasktracker, so that is where you'll need to look
> for the process ID -- not the JobTracker/client.
>
> Crudely speaking,
> $ ssh tasktracker01 # or whichever.
> $ jps | grep Child | cut -d " " -f 1
> # And lo, PIDs to play with.
>
> On Thu, Sep 29, 2011 at 12:15 AM, bikash sharma <sharmabiks.07@gmail.com>
> wrote:
> > Hi,
> > Is it possible to get the process id of each task in a MapReduce job?
> > When I run a mapreduce job and do a monitoring in linux using ps, i just
> see
> > the id of the mapreduce job process but not its constituent map/reduce
> > tasks.
> > The use case is to monitor the resource usage of each task by using sar
> > utility in linux with specific process id of task.
> >
> > Thanks,
> > Bikash
> >
>
>
>
> --
> Harsh J
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message