hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4350) Ability to pause/resume jobs
Date Tue, 07 Oct 2008 21:18:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12637658#action_12637658
] 

Owen O'Malley commented on HADOOP-4350:
---------------------------------------

I think this is not a good direction to go. It would be much better to use the scheduler to
give priority to the jobs that need it. By pausing the jobs and tasks, you'll consume resources
that will block effective work by other jobs.

> Ability to pause/resume jobs
> ----------------------------
>
>                 Key: HADOOP-4350
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4350
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: mapred
>            Reporter: Amar Kamat
>            Assignee: Amar Kamat
>         Attachments: HADOOP-4350-v1.2.patch, HADOOP-4350-v1.3.patch
>
>
> Consider a case where the user job depends on some external entity/service like a database
or a web service. If the service needs restart or encounters a failure, the user should be
able to pause the job and resume only when the service is up. This will be better than re-executing
the whole job. Hence there should be some way to pause/resume jobs (from web-ui/command line)
etc.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message