Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 60F3D4734 for ; Mon, 6 Jun 2011 21:05:20 +0000 (UTC) Received: (qmail 73694 invoked by uid 500); 6 Jun 2011 21:05:20 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 73636 invoked by uid 500); 6 Jun 2011 21:05:20 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 73628 invoked by uid 99); 6 Jun 2011 21:05:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Jun 2011 21:05:20 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Jun 2011 21:05:19 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 46A2B104EEB for ; Mon, 6 Jun 2011 21:04:59 +0000 (UTC) Date: Mon, 6 Jun 2011 21:04:59 +0000 (UTC) From: "Todd Lipcon (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <1049999715.1908.1307394299286.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <607079061.22720.1305733788080.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (MAPREDUCE-2512) wait(5000) and notify() mechanism can be implemented instead of sleep(5000) in reduce task when there are no copies in progress and no new copies to schedule MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-2512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-2512: ----------------------------------- Status: Open (was: Patch Available) > wait(5000) and notify() mechanism can be implemented instead of sleep(5000) in reduce task when there are no copies in progress and no new copies to schedule > ------------------------------------------------------------------------------------------------------------------------------------------------------------- > > Key: MAPREDUCE-2512 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2512 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: task > Affects Versions: 0.20.2 > Reporter: Devaraj K > Assignee: Devaraj K > Fix For: 0.20.4 > > Attachments: MAPREDUCE-2512.patch > > > {code:title=ReduceTask.java|borderStyle=solid} > try { > if (numInFlight == 0 && numScheduled == 0) { > // we should indicate progress as we don't want TT to think > // we're stuck and kill us > reporter.progress(); > Thread.sleep(5000); > } > } catch (InterruptedException e) { } // IGNORE > {code} > Here if we have no copies in flight and we can't schedule anything new, it is going to wait for 5000 millis. Instead of waiting for 5000 millis, this thread can wait with timeout and GetMapEventsThread can notify it if gets new map completion events earlier than 5000 millis time. > -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira