hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrzej Bialecki (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3687) Ability to pause/resume tasks
Date Mon, 14 Jul 2008 16:44:32 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12613366#action_12613366
] 

Andrzej Bialecki  commented on HADOOP-3687:
-------------------------------------------

I think it would be good to add to the Task interface something like onPause() / onUnpause()
methods. This way map / reduce tasks to be paused could prepare for this event (e.g. close
DB conections or close the side-effect files), and similarly restore their state on un-pause.

> Ability to pause/resume tasks
> -----------------------------
>
>                 Key: HADOOP-3687
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3687
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: mapred
>            Reporter: Chris Smith
>            Assignee: Chris Smith
>            Priority: Minor
>         Attachments: hadoop-pausing.8.trunk.patch
>
>
> It would be nice to be able to pause (and subsequently resume) tasks that are currently
running, in order to allow tasks from higher priority jobs to execute. At present it is quite
easy for long-running tasks from low priority jobs to block a task from a newer high priority
job, and there is no way to force the execution of the high priority task without killing
the low priority jobs.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message