hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "wangwj (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.
Date Wed, 31 Jan 2018 10:24:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

wangwj updated YARN-7859:
    Attachment: YARN-7859-v1.patch

> New feature: add queue scheduling deadLine in fairScheduler.
> ------------------------------------------------------------
>                 Key: YARN-7859
>                 URL: https://issues.apache.org/jira/browse/YARN-7859
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: fairscheduler
>    Affects Versions: 3.0.0-alpha2
>         Environment:     The environment of my company is  hadoop2.6.0-cdh5.4.7
>            Reporter: wangwj
>            Priority: Major
>              Labels: fairscheduler, features, patch
>             Fix For: 2.9.0, 3.0.0-alpha2
>         Attachments: YARN-7859-v1.patch
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>      As everyone knows.In FairScheduler the phenomenon of queue scheduling starvation
often occurs when the number of cluster jobs is large.The App in one or more queue are pending.So
I have thought a way to solve this problem.Add queue scheduling deadLine in fairScheduler.When
a queue is not scheduled for FairScheduler within a specified time.We mandatory scheduler
>     Now the way of community solves queue scheduling to starvation is preempt container.But
this way may increases the failure rate of the job.
>     On the basis of the above, I propose this issue...

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message