hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jose Miguel Arreola (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-6358) Cache the resolved hosts prevent calls to InetAddress.getByName and normalizeHost
Date Thu, 16 Mar 2017 23:01:41 GMT
Jose Miguel Arreola created YARN-6358:
-----------------------------------------

             Summary: Cache the resolved hosts prevent calls to InetAddress.getByName and
normalizeHost
                 Key: YARN-6358
                 URL: https://issues.apache.org/jira/browse/YARN-6358
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: resourcemanager, security
            Reporter: Jose Miguel Arreola


When running performance tests, we noticed that a lot of time is taken in resolving the host
address.
In our specific scenario, we saw the function org.apache.hadoop.security.SecurityUtil.getInetAddressByName
taking a lot of time to resolve the hosts, and the same function is called a lot of times.
I saw that org.apache.hadoop.yarn.server.resourcemanager.NodesListManager has a cached resolver
already because of the same reason.
So, the proposal is, to make this cache generic and use it to save some time in this functions
that we already know, but have it available so the cache can be used anywhere else.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org


Mime
View raw message