hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hong Zhiguo (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-4001) normalizeHostName takes too much of execution time
Date Fri, 31 Jul 2015 02:10:04 GMT
Hong Zhiguo created YARN-4001:
---------------------------------

             Summary: normalizeHostName takes too much of execution time
                 Key: YARN-4001
                 URL: https://issues.apache.org/jira/browse/YARN-4001
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: nodemanager, resourcemanager
            Reporter: Hong Zhiguo
            Assignee: Hong Zhiguo
            Priority: Minor


For each NodeHeartbeatRequest, NetUtils.normalizeHostName is called under a lock.  I did profiling
for a very large cluster and found out NetUtils.normalizeHostName takes most execution time
of ResourceTrackerService.nodeHeartbeat(...).
We'd better have an option to use raw IP (plus port) as the Node identity to scale for large
clusters.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message