giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pankaj Malhotra <pankajiit...@gmail.com>
Subject Re: Is it possible to know the mapper task a particular vertex is assigned to?
Date Thu, 06 Mar 2014 06:31:03 GMT
There is a vertex with a large outgoing edge-list. I wanted to compare the
memory usage, number of messages, and few other statistics for the worker
with this vertex and the average statistics across workers.

Does the mapping change within the same job?

Thanks,
Pankaj


On 6 March 2014 11:38, Roman Shaposhnik <shaposhnik@gmail.com> wrote:

> On Wed, Mar 5, 2014 at 9:53 PM, Pankaj Malhotra <pankajiitdyn@gmail.com>
> wrote:
> > Hi,
> >
> > How can I find the mapper task a particular vertex is assigned to?
> > I can do this by doing a sysout and then looking at the logs. But there
> must
> > be a smarter way to do this. Please suggest.
>
> That mapping is not static and can change. In theory you can rely on
> the info in ZK, but that would be relying on what is, essentially, an
> implementation detail of Giraph.
>
> What's the reason for you to need this info?
>
> Thanks,
> Roman.
>

Mime
View raw message