hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5783) Verify applications are identified starved
Date Thu, 03 Nov 2016 05:18:58 GMT

    [ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15631629#comment-15631629

Karthik Kambatla commented on YARN-5783:

Good points, [~templedf].

Your last suggestion got me thinking. It seemed like mocking the preemption thread to consume
starved apps but not actually preempt would allow us to test starvation logic better. Did
the same. We could potentially add more advanced tests to verify starvation based on thresholds
and timeouts in a subsequent JIRA (YARN-5824).

By the way, this patch conflicts with YARN-5821 which is mostly cosmetic changes and I believe
is ready to go. 

> Verify applications are identified starved
> ------------------------------------------
>                 Key: YARN-5783
>                 URL: https://issues.apache.org/jira/browse/YARN-5783
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: fairscheduler
>    Affects Versions: 2.8.0
>            Reporter: Karthik Kambatla
>            Assignee: Karthik Kambatla
>              Labels: oct16-medium
>         Attachments: yarn-5783.YARN-4752.1.patch, yarn-5783.YARN-4752.2.patch, yarn-5783.YARN-4752.3.patch,
yarn-5783.YARN-4752.4.patch, yarn-5783.YARN-4752.5.patch
> JIRA to track unit tests to verify the identification of starved applications. An application
should be marked starved only when:
> # Cluster allocation is over the configured threshold for preemption.
> # Preemption is enabled for a queue and any of the following:
> ## The queue is under its minshare for longer than minsharePreemptionTimeout
> ## One of the queue’s applications is under its fairshare for longer than fairsharePreemptionTimeout.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message