hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sunil G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3813) Support Application timeout feature in YARN.
Date Thu, 03 Sep 2015 11:58:47 GMT

    [ https://issues.apache.org/jira/browse/YARN-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728911#comment-14728911
] 

Sunil G commented on YARN-3813:
-------------------------------

As I see this, the trigger point to identify an application to be Timedout (or killed) is
based on the elapsed time (calculated from its submission time). If an application can be
registered to RMAppTimeOutMonitor after submission, I feel we may need not have to worry about
internal state. 

> Support Application timeout feature in YARN. 
> ---------------------------------------------
>
>                 Key: YARN-3813
>                 URL: https://issues.apache.org/jira/browse/YARN-3813
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: scheduler
>            Reporter: nijel
>            Assignee: nijel
>         Attachments: 0001-YARN-3813.patch, YARN Application Timeout .pdf
>
>
> It will be useful to support Application Timeout in YARN. Some use cases are not worried
about the output of the applications if the application is not completed in a specific time.

> *Background:*
> The requirement is to show the CDR statistics of last few  minutes, say for every 5 minutes.
The same Job will run continuously with different dataset.
> So one job will be started in every 5 minutes. The estimate time for this task is 2 minutes
or lesser time. 
> If the application is not completing in the given time the output is not useful.
> *Proposal*
> So idea is to support application timeout, with which timeout parameter is given while
submitting the job. 
> Here, user is expecting to finish (complete or kill) the application in the given time.
> One option for us is to move this logic to Application client (who submit the job). 
> But it will be nice if it can be generic logic and can make more robust.
> Kindly provide your suggestions/opinion on this feature. If it sounds good, i will update
the design doc and prototype patch



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message