hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amareshwari Sri Ramadasu <amar...@yahoo-inc.com>
Subject Re: A unique number for every task (map/reduce)
Date Mon, 15 Feb 2010 04:23:20 GMT
You can get task attempt id, tipid, job id though the configuration properties  mapred.task.id,
mapred.tip.id and mapred.job.id respectively.

For e.g. the attempt attempt_201002092101_0063_m_000000_0 : attemptid - attempt_201002092101_0063_m_000000_0;
tipid - task_201002092101_0063_m_000000; jobid - job_201002092101_0063
Hope this helps!


On 2/12/10 10:37 PM, "Saptarshi Guha" <saptarshi.guha@gmail.com> wrote:

The name of a map task attempt is

attempt_201002092101_0063_m_N_X (N=1,.... # of map tasks)

and that of a reduce is

attempt_201002092101_0063_r_M_X where X is maybe 0,1,2 ..
(M =1 .... # o reduce tasks)

Thus during the map stage, the unique number is given by N or M.

Is there configuration variable so that I can get the name of this task file?
Then i can arrive at the components: date. job-number, task-#, task atempt #

Thank you

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message