hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Piotr Praczyk <piotr.prac...@gmail.com>
Subject Re: Getting Task ID inside a Mapper
Date Thu, 18 Jun 2009 14:18:42 GMT
Hi
Why don't you provide a seed of random generator generated outside the task
? Then when the task fails, you can provide the same value stored somewhere
outside.
You could use the task configuration to do so.

I don't know anything about obtaining the task ID from within.


regards
Piotr

2009/6/18 Mark Desnoyer <mdesnoyer@gmail.com>

> Hi,
>
> I was wondering if it's possible to get a hold of the task id inside a
> mapper? I cant' seem to find a way by trolling through the API reference.
> I'm trying to implement a Map Reduce version of Latent Dirichlet Allocation
> and I need to be able to initialize a random number generator in a task
> specific way so that if the task fails and is rerun elsewhere, the results
> are the same. Thanks in advance.
>
> Cheers,
> Mark Desnoyer
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message