hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shekhar Gupta <shkhr...@gmail.com>
Subject Re: How to get TaskId from ContainerId or ApplicationId or Request in Hadoop 0.23??
Date Thu, 23 Aug 2012 19:04:49 GMT
Thanks Vinod. Yes it's the second case where I am working with MR over yarn.

When I run a job then for a specific Machine I am trying to compute that
how much time the machine takes to execute mapping tasks and reduce tasks.
What I am doing now is that I compute time difference between container
assignment and container released steps. But I can't determine if that
container was assigned for a mapping or reduce task. I'll try to look into
ApplicationMaster if I can get this information.



On Thu, Aug 23, 2012 at 11:27 AM, Vinod Kumar Vavilapalli <
vinodkv@hortonworks.com> wrote:

>
> Moving to yarn-dev, as that is the right place for this discussion.
>
> Can you let us know more about what  you are trying to accomplish? Working
> with MapReduce over YARN or your own YARN application?
>
> If you are working with MR over YARN, you have to note that
> TaskId/TaskAttemptID/Map/Reduce tasks are MapReduce concepts. So
> ResourceManager has no idea about them. MapReduce ApplicationMaster is the
> place where you can obtain more such MR specific information.
>
> If it is the later, your question is moot.
>
> HTH,
> +Vinod
>
> On Aug 22, 2012, at 6:23 PM, Shekhar Gupta wrote:
>
> > In ResourceManager, is there any way to findout if the assigned container
> > is going to execute a mapping task or a reduce task? I can access objects
> > Container, Application and Request in ResourceManager, can I somehow get
> > TaskId by using any of these objects?? Please let me know a way.
> >
> > Thanks.
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message