hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-4699) Change TaskTracker.MapOutputServlet to send only the IFile segment, validate checksum in Reduce
Date Thu, 20 Nov 2008 22:38:44 GMT
Change TaskTracker.MapOutputServlet to send only the IFile segment, validate checksum in Reduce
-----------------------------------------------------------------------------------------------

                 Key: HADOOP-4699
                 URL: https://issues.apache.org/jira/browse/HADOOP-4699
             Project: Hadoop Core
          Issue Type: Improvement
            Reporter: Chris Douglas
            Assignee: Chris Douglas
             Fix For: 0.20.0


Instead of validating the checksum of the IFile segment in MapOutputServlet, validation may
be left to the reduce. While failures may not be detected until late in the reduce, the throughput
and CPU improvements should make up for it in the average case.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message