hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-3446) The reduce task should not flush the in memory file system before starting the reducer
Date Mon, 26 May 2008 17:58:02 GMT
The reduce task should not flush the in memory file system before starting the reducer
--------------------------------------------------------------------------------------

                 Key: HADOOP-3446
                 URL: https://issues.apache.org/jira/browse/HADOOP-3446
             Project: Hadoop Core
          Issue Type: Improvement
          Components: mapred
            Reporter: Owen O'Malley
            Assignee: Owen O'Malley
            Priority: Critical


In the case where the entire reduce inputs fit in ram, we currently force the input to disk
and re-read it before giving it to the reducer. It would be much better if we merged from
the ramfs and any spills to feed the reducer its input.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message