hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sunil G (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-2009) Intra-queue preemption for app priority support ProportionalCapacityPreemptionPolicy
Date Fri, 28 Oct 2016 18:48:58 GMT

     [ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Sunil G updated YARN-2009:
    Attachment: YARN-2009.0016.patch

Thank you very much [~curino] for the comments.

bq.question: in TestProportionalCapacityPreemptionPolicyIntraQueue.testSimpleIntraQueuePreemption()
why is app4 seeing
app3 and app4 are of same priority. However app3 is added first to queue, and then app4. Hence
according to FIFO within same priority level, app4 is last submitted. Hence app4 will be selected
to preempt first.

bq.is maxIntraQueuePreemptableLimit set to 50% a reasonable default? it seems maybe high?
yes. Decreased to 20% now.

Thank [~eepayne]. Agreeing that this  patch is majorly concentrating in solving single user's
priority inversion problem

> Intra-queue preemption for app priority support ProportionalCapacityPreemptionPolicy
> ------------------------------------------------------------------------------------
>                 Key: YARN-2009
>                 URL: https://issues.apache.org/jira/browse/YARN-2009
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: capacityscheduler
>            Reporter: Devaraj K
>            Assignee: Sunil G
>              Labels: oct16-medium
>         Attachments: YARN-2009.0001.patch, YARN-2009.0002.patch, YARN-2009.0003.patch,
YARN-2009.0004.patch, YARN-2009.0005.patch, YARN-2009.0006.patch, YARN-2009.0007.patch, YARN-2009.0008.patch,
YARN-2009.0009.patch, YARN-2009.0010.patch, YARN-2009.0011.patch, YARN-2009.0012.patch, YARN-2009.0013.patch,
YARN-2009.0014.patch, YARN-2009.0015.patch, YARN-2009.0016.patch
> While preempting containers based on the queue ideal assignment, we may need to consider
preempting the low priority application containers first.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message