hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3813) Support Application timeout feature in YARN.
Date Wed, 08 Jul 2015 20:24:06 GMT

    [ https://issues.apache.org/jira/browse/YARN-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619291#comment-14619291
] 

Vinod Kumar Vavilapalli commented on YARN-3813:
-----------------------------------------------

A few years ago when this came up, I recommended doing this on top of YARN. But I've seen
this enough in the wild to yield now.

It's a useful feature to come out of the box in YARN. Small enough, so I think we should go
ahead with the implementation - not a lot of design dimensions.

> Support Application timeout feature in YARN. 
> ---------------------------------------------
>
>                 Key: YARN-3813
>                 URL: https://issues.apache.org/jira/browse/YARN-3813
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: scheduler
>            Reporter: nijel
>         Attachments: YARN Application Timeout .pdf
>
>
> It will be useful to support Application Timeout in YARN. Some use cases are not worried
about the output of the applications if the application is not completed in a specific time.

> *Background:*
> The requirement is to show the CDR statistics of last few  minutes, say for every 5 minutes.
The same Job will run continuously with different dataset.
> So one job will be started in every 5 minutes. The estimate time for this task is 2 minutes
or lesser time. 
> If the application is not completing in the given time the output is not useful.
> *Proposal*
> So idea is to support application timeout, with which timeout parameter is given while
submitting the job. 
> Here, user is expecting to finish (complete or kill) the application in the given time.
> One option for us is to move this logic to Application client (who submit the job). 
> But it will be nice if it can be generic logic and can make more robust.
> Kindly provide your suggestions/opinion on this feature. If it sounds good, i will update
the design doc and prototype patch



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message