hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Forest Tan (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-2319) MultithreadedMapper doesn't update completion percentage before mapper is finished
Date Fri, 11 Feb 2011 08:16:57 GMT
MultithreadedMapper doesn't update completion percentage before mapper is finished
----------------------------------------------------------------------------------

                 Key: MAPREDUCE-2319
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2319
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
    Affects Versions: 0.20.2
            Reporter: Forest Tan


MultithreadedMapper runs multiple threads in one mapper, but it doesn't update the completion
percentage before all the threads are completed.

If is better to update the completion percentage when threads are running to reflect real
progress.

The code is like this:
runners = new ArrayList(numberOfThreads);
        for(int i = 0; i < numberOfThreads; i++)
        {
            MapRunner thread = new MapRunner(context);
            thread.start();
            runners.add(i, thread);
        }

        for(int i = 0; i < numberOfThreads; i++)
        {
            MapRunner thread = (MapRunner)runners.get(i);
            thread.join(); // wait
            ...       
        }

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message