MultithreadedMapper doesn't update completion percentage before mapper is finished
----------------------------------------------------------------------------------
Key: MAPREDUCE-2319
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2319
Project: Hadoop Map/Reduce
Issue Type: Improvement
Affects Versions: 0.20.2
Reporter: Forest Tan
MultithreadedMapper runs multiple threads in one mapper, but it doesn't update the completion
percentage before all the threads are completed.
If is better to update the completion percentage when threads are running to reflect real
progress.
The code is like this:
runners = new ArrayList(numberOfThreads);
for(int i = 0; i < numberOfThreads; i++)
{
MapRunner thread = new MapRunner(context);
thread.start();
runners.add(i, thread);
}
for(int i = 0; i < numberOfThreads; i++)
{
MapRunner thread = (MapRunner)runners.get(i);
thread.join(); // wait
...
}
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
|