hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1199) TaskInProgress should also consider blacklisted node while (re)scheduling failed tasks
Date Tue, 10 Nov 2009 10:00:27 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12775360#action_12775360

Amar Kamat commented on MAPREDUCE-1199:

Consider an example where the cluster has 3 tasktrackers (t1,t2 and t3) and a tip tip1 runs
on t1 and fails. Now the tip1 is rescheduled on t2 and fails again. Now if tracker t1 is blacklisted,
then t1 will be removed from the active tracker list. Now if tracker t2 asks for a  task,
tip1 will be scheduled on it as the total count of active tracker = 2 (t2, t3) and total-tip-failures
= 2 (t1, t2) is same.

> TaskInProgress should also consider blacklisted node while (re)scheduling failed tasks
> --------------------------------------------------------------------------------------
>                 Key: MAPREDUCE-1199
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1199
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker
>    Affects Versions: 0.22.0
>            Reporter: Amar Kamat
> While rescheduling failed tasks, only the failure count is used. It should also consider
the blacklisted trackers information too. 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message