hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tao Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.
Date Fri, 14 Jun 2019 06:45:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863745#comment-16863745
] 

Tao Yang commented on YARN-8995:
--------------------------------

Hi, [~zhuqi].

You can override the serviceInit method and make sure the conf you used has been initialized,
since getConf() in constructor should be null, and I think it's better for detailsInterval to
be calculated (* 1000) in serviceInit to match its name and avoid later calculations.

Moreover, could you please add a UT in TestAsyncDispatcher for this?

> Log the event type of the too big AsyncDispatcher event queue size, and add the information
to the metrics. 
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-8995
>                 URL: https://issues.apache.org/jira/browse/YARN-8995
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: metrics, nodemanager, resourcemanager
>    Affects Versions: 3.2.0
>            Reporter: zhuqi
>            Assignee: zhuqi
>            Priority: Major
>         Attachments: TestStreamPerf.java, YARN-8995.001.patch, YARN-8995.002.patch, YARN-8995.003.patch,
YARN-8995.004.patch
>
>
> In our growing cluster,there are unexpected situations that cause some event queues
to block the performance of the cluster, such as the bug of  https://issues.apache.org/jira/browse/YARN-5262
. I think it's necessary to log the event type of the too big event queue size, and add the
information to the metrics, and the threshold of queue size is a parametor which can be changed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message