hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yufei Gu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-8639) Sort queue and apps in fair schduler using a separate thread
Date Thu, 09 Aug 2018 19:40:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575302#comment-16575302
] 

Yufei Gu commented on YARN-8639:
--------------------------------

We need to quantify a little bit before we'd make any non-trivial change. How many sub-queues/applications
will be considered as too many, and cause performance issue. The result won't only justify
why we need the change but also provide the guideline to tuning the queue settings. 

> Sort queue and apps in fair schduler using a separate thread
> ------------------------------------------------------------
>
>                 Key: YARN-8639
>                 URL: https://issues.apache.org/jira/browse/YARN-8639
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: yarn
>            Reporter: wan kun
>            Priority: Minor
>
> If fair scheduler have many queue and each queue have many active applications .
> For each assignContainer function, we need to sort all the queue, and all the applications
in each queue. For a large system,this may be cost too much time. So we can sort the queue
and applicationsĀ using a separate thread asynchronous.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message