hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yufei Gu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6546) SLS is slow while loading 10k queues
Date Wed, 18 Oct 2017 00:05:01 GMT

    [ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16208619#comment-16208619
] 

Yufei Gu commented on YARN-6546:
--------------------------------

Thanks [~haibo.chen] for the review and commit. Thanks for the review, [~miklos.szegedi@cloudera.com]
and [~grant.sohn].

> SLS is slow while loading 10k queues
> ------------------------------------
>
>                 Key: YARN-6546
>                 URL: https://issues.apache.org/jira/browse/YARN-6546
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: scheduler-load-simulator
>    Affects Versions: 3.0.0-alpha2
>            Reporter: Yufei Gu
>            Assignee: Yufei Gu
>             Fix For: 3.0.0
>
>         Attachments: Desktop.png, YARN-6546.001.patch, YARN-6546.002.patch
>
>
> It takes a long time (more than 10 minutes) to load 10k queues in SLS. The problem should
be in {{com.codahale.metrics.CsvReporter}} based on the result from profiler. SLS creates
14 .csv files for each leaf queue, and update them constantly during execution. It is not
necessary to log information for inactive queues. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message