hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matei Zaharia (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-2210) Preemption does not obey job priority
Date Mon, 06 Dec 2010 07:16:11 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12967106#action_12967106

Matei Zaharia commented on MAPREDUCE-2210:

Which job scheduler are you using? The choice of tasks to preempt is entirely up to the scheduler,
so you should mark the issue as belonging to the particular scheduler that you're using.

> Preemption does not obey job priority
> -------------------------------------
>                 Key: MAPREDUCE-2210
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2210
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker
>            Reporter: Adam Kramer
> Preemption, as it currently works, kills running tasks that are "unfair" in terms of
the amount of task attention used by one job compared to another.
> The bug is that pre-emption occurs such that HIGH priority jobs have their tasks killed
when the cluster is filled with lower-priority jobs. Pre-emption should only be allowed to
kill tasks for jobs with equal or lower priority.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message