Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 80005 invoked from network); 20 Nov 2008 22:39:39 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 20 Nov 2008 22:39:39 -0000 Received: (qmail 73500 invoked by uid 500); 20 Nov 2008 22:39:43 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 73484 invoked by uid 500); 20 Nov 2008 22:39:43 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 73464 invoked by uid 99); 20 Nov 2008 22:39:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Nov 2008 14:39:43 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Nov 2008 22:38:28 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 3E28F234C29A for ; Thu, 20 Nov 2008 14:38:44 -0800 (PST) Message-ID: <572601576.1227220724253.JavaMail.jira@brutus> Date: Thu, 20 Nov 2008 14:38:44 -0800 (PST) From: "Chris Douglas (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Created: (HADOOP-4699) Change TaskTracker.MapOutputServlet to send only the IFile segment, validate checksum in Reduce MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Change TaskTracker.MapOutputServlet to send only the IFile segment, validate checksum in Reduce ----------------------------------------------------------------------------------------------- Key: HADOOP-4699 URL: https://issues.apache.org/jira/browse/HADOOP-4699 Project: Hadoop Core Issue Type: Improvement Reporter: Chris Douglas Assignee: Chris Douglas Fix For: 0.20.0 Instead of validating the checksum of the IFile segment in MapOutputServlet, validation may be left to the reduce. While failures may not be detected until late in the reduce, the throughput and CPU improvements should make up for it in the average case. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.