Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-issues@hadoop.apache.org
Message-ID: <1517195289.1257847227960.JavaMail.jira@brutus>
Date: Tue, 10 Nov 2009 10:00:27 +0000 (UTC)
From: "Amar Kamat (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Subject: [jira] Commented: (MAPREDUCE-1199) TaskInProgress should also
 consider blacklisted node while (re)scheduling failed tasks
In-Reply-To: <817140658.1257846988274.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MAPREDUCE-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12775360#action_12775360 ] 

Amar Kamat commented on MAPREDUCE-1199:
---------------------------------------

Consider an example where the cluster has 3 tasktrackers (t1,t2 and t3) and a tip tip1 runs on t1 and fails. Now the tip1 is rescheduled on t2 and fails again. Now if tracker t1 is blacklisted, then t1 will be removed from the active tracker list. Now if tracker t2 asks for a  task, tip1 will be scheduled on it as the total count of active tracker = 2 (t2, t3) and total-tip-failures = 2 (t1, t2) is same.

> TaskInProgress should also consider blacklisted node while (re)scheduling failed tasks
> --------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1199
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1199
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker
>    Affects Versions: 0.22.0
>            Reporter: Amar Kamat
>
> While rescheduling failed tasks, only the failure count is used. It should also consider the blacklisted trackers information too. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.