hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yufei Gu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7280) Rescan fair-scheduler.xml every n seconds
Date Sun, 01 Oct 2017 22:12:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16187556#comment-16187556
] 

Yufei Gu commented on YARN-7280:
--------------------------------

Fair scheduler has supported that for quite a while.
{quote}
The allocation file is reloaded every 10 seconds, allowing changes to be made on the fly.
{quote}
Check fair scheduler doc for more details. https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/FairScheduler.html

> Rescan fair-scheduler.xml every n seconds
> -----------------------------------------
>
>                 Key: YARN-7280
>                 URL: https://issues.apache.org/jira/browse/YARN-7280
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: fairscheduler
>    Affects Versions: 3.0.0-alpha4
>            Reporter: Andras Piros
>            Assignee: Andras Piros
>
> Currently, the {{FairScheduler}} configuration file {{fair-scheduler.xml}} is loaded
only on ResourceManager startup.
> We need:
> * a mechanism to rescan / reload-if-changed this, often-changing piece of RM configuration
> * from classpath / configuration file:
> ** configuration file wins over classpath
> * rescan every {{n}} seconds, where:
> ** {{n <= 0}} means don't rescan
> ** {{n > 0}} means rescan every {{n}} seconds



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message