Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 94640 invoked from network); 11 Oct 2006 18:09:18 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 11 Oct 2006 18:09:18 -0000 Received: (qmail 20932 invoked by uid 500); 11 Oct 2006 18:09:18 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 20713 invoked by uid 500); 11 Oct 2006 18:09:17 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 20704 invoked by uid 99); 11 Oct 2006 18:09:17 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Oct 2006 11:09:17 -0700 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [209.237.227.198] (HELO brutus.apache.org) (209.237.227.198) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Oct 2006 11:09:17 -0700 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 30A6B7142DF for ; Wed, 11 Oct 2006 11:08:36 -0700 (PDT) Message-ID: <9499391.1160590116196.JavaMail.jira@brutus> Date: Wed, 11 Oct 2006 11:08:36 -0700 (PDT) From: "Doug Cutting (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Commented: (HADOOP-597) transmission errors to the reduce will cause map output to be considered lost In-Reply-To: <18614380.1160585915012.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N [ http://issues.apache.org/jira/browse/HADOOP-597?page=comments#action_12441520 ] Doug Cutting commented on HADOOP-597: ------------------------------------- Half the number of try/catch blocks would be required if you instead wrapped the outStream operations and use a badOutput boolean, no? > transmission errors to the reduce will cause map output to be considered lost > ----------------------------------------------------------------------------- > > Key: HADOOP-597 > URL: http://issues.apache.org/jira/browse/HADOOP-597 > Project: Hadoop > Issue Type: Bug > Affects Versions: 0.7.0 > Reporter: Owen O'Malley > Assigned To: Owen O'Malley > Fix For: 0.7.1 > > Attachments: map-output-protect.patch > > > When the mapOutput servlet gets an IOException from reading the map output file, it correctly declares the map output lost. However, an IOException writing to the socket should NOT cause the map output to be declared lost. Unfortunately, the current implementation always declares the map output lost. When the map output is lost, the map is re-run on a different computer. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira