hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yufei Gu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7207) Cache the local host name when getting application list in RM
Date Thu, 28 Sep 2017 01:51:01 GMT

    [ https://issues.apache.org/jira/browse/YARN-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183554#comment-16183554
] 

Yufei Gu commented on YARN-7207:
--------------------------------

There are different symptoms. Single call of getLocalHost is pretty slow due to some DNS issue,
which may cause issue in different components, not only in RM. I don't think this change will
hide anything. It is still observable in that situation. There is one case we observed is
that performance of single call is fine, you won't notice the slowness at all, then it gets
significant slow while you call it thousands of time with multiple threads. This change helps
a lot in that case. Yes, this patch hides the symptom in that case. To solve it, I filed YARN-7263.

> Cache the local host name when getting application list in RM
> -------------------------------------------------------------
>
>                 Key: YARN-7207
>                 URL: https://issues.apache.org/jira/browse/YARN-7207
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: RM
>    Affects Versions: 3.1.0
>            Reporter: Yufei Gu
>            Assignee: Yufei Gu
>         Attachments: YARN-7207.001.patch, YARN-7207.002.patch
>
>
> {{getLocalHostName()}} is invoked for generating the report for each application, which
means it is called 1000 times for each {{getApplications()}} if there are 1000 apps in RM.
Some user got a performance issue when {{getLocalHostName()}} is slow under some network envs.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message