hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-3427) In ReduceTask::fetchOutputs, wait for result can be improved slightly
Date Wed, 21 May 2008 12:59:55 GMT
In ReduceTask::fetchOutputs, wait for result can be improved slightly
---------------------------------------------------------------------

                 Key: HADOOP-3427
                 URL: https://issues.apache.org/jira/browse/HADOOP-3427
             Project: Hadoop Core
          Issue Type: Bug
          Components: mapred
            Reporter: Devaraj Das
            Assignee: Devaraj Das
             Fix For: 0.18.0


The getCopyResult call in ReduceTask::fetchOutputs waits for 2 seconds if the results list
is empty. This can be improved to wait only when sufficient number of fetches (above a certain
threshold) have been scheduled. The threshold should ensure that all the fetcher threads would
be busy enough, and in this case, the call to getCopyResult would return only when a fetcher
thread wakes it up.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message