hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-597) transmission errors to the reduce will cause map output to be considered lost
Date Wed, 11 Oct 2006 19:03:36 GMT
     [ http://issues.apache.org/jira/browse/HADOOP-597?page=all ]

Owen O'Malley updated HADOOP-597:
---------------------------------

    Attachment: map-output-protect-2.patch

Ok, as suggested by Doug, I inverted the check and wrapped the socket.write call with a specialized
check. Thanks!

> transmission errors to the reduce will cause map output to be considered lost
> -----------------------------------------------------------------------------
>
>                 Key: HADOOP-597
>                 URL: http://issues.apache.org/jira/browse/HADOOP-597
>             Project: Hadoop
>          Issue Type: Bug
>    Affects Versions: 0.7.0
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.7.1
>
>         Attachments: map-output-protect-2.patch, map-output-protect.patch
>
>
> When the mapOutput servlet gets an IOException from reading the map output file, it correctly
declares the map output lost. However, an IOException writing to the socket should NOT cause
the map output to be declared lost. Unfortunately, the current implementation always declares
the map output lost. When the map output is lost, the map is re-run on a different computer.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message