Return-Path: Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: (qmail 72706 invoked from network); 19 Nov 2009 01:04:02 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 19 Nov 2009 01:04:02 -0000 Received: (qmail 47392 invoked by uid 500); 19 Nov 2009 01:04:02 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 47324 invoked by uid 500); 19 Nov 2009 01:04:02 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 47314 invoked by uid 99); 19 Nov 2009 01:04:02 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Nov 2009 01:04:02 +0000 X-ASF-Spam-Status: No, hits=-10.5 required=5.0 tests=AWL,BAYES_00,RCVD_IN_DNSWL_HI X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Nov 2009 01:03:59 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 8F7AE234C045 for ; Wed, 18 Nov 2009 17:03:39 -0800 (PST) Message-ID: <1323050980.1258592619582.JavaMail.jira@brutus> Date: Thu, 19 Nov 2009 01:03:39 +0000 (UTC) From: "Scott Chen (JIRA)" To: mapreduce-issues@hadoop.apache.org Subject: [jira] Commented: (MAPREDUCE-1198) Alternatively schedule different types of tasks in fair share scheduler In-Reply-To: <574506299.1257803493873.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779778#action_12779778 ] Scott Chen commented on MAPREDUCE-1198: --------------------------------------- My intention is that when a task type is rejected once, it should always be rejected. Since it is the first condition in || (or), if it is true the following condition checks will be skipped. But you are right, this will not change the logic if we remove it. If it is confusing, I think it is OK to remove it. > Alternatively schedule different types of tasks in fair share scheduler > ----------------------------------------------------------------------- > > Key: MAPREDUCE-1198 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1198 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: contrib/fair-share > Affects Versions: 0.22.0 > Reporter: Scott Chen > Assignee: Scott Chen > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1198-v1.patch, MAPREDUCE-1198-v2.patch > > > Matei has mentioned in MAPREDUCE-961 that the current scheduler will first try to launch map tasks until canLaunthTask() returns false then look for reduce tasks. This might starve reduce task. He also mention that alternatively schedule different types of tasks can solve this problem. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.