hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-4699) Change TaskTracker.MapOutputServlet to send only the IFile segment, validate checksum in Reduce
Date Fri, 12 Dec 2008 19:59:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chris Douglas updated HADOOP-4699:
----------------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

I just committed this.

> Change TaskTracker.MapOutputServlet to send only the IFile segment, validate checksum
in Reduce
> -----------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-4699
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4699
>             Project: Hadoop Core
>          Issue Type: Improvement
>            Reporter: Chris Douglas
>            Assignee: Chris Douglas
>             Fix For: 0.20.0
>
>         Attachments: 4699-0.patch
>
>
> Instead of validating the checksum of the IFile segment in MapOutputServlet, validation
may be left to the reduce. While failures may not be detected until late in the reduce, the
throughput and CPU improvements should make up for it in the average case.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message