hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Don Bosco <dawntowo...@gmail.com>
Subject Re: Pass the TaskId from map to Reduce
Date Thu, 18 Feb 2010 03:15:06 GMT

Hi Ankit,
For your problem, you can use "getJobId();" in reduce(), then you will have
the unique name and you can process the file in the map reduce.

> Hi,
> I was working on a scenario where in I am generating a file in close()
> function of my Map implementation.
> Since Map execution are worked concurrently, this file is overwritten.
> I was wondering how to name this file uniquely per map execution basic and
> then read in configure() function of reduce.
> I could give a task id as name of the file but dont know how will I read
> the same file in configure() as the task id would have changed
> Ankit

View this message in context: http://old.nabble.com/Pass-the-TaskId-from-map-to-Reduce-tp27575531p27633914.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.

View raw message