hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jose Miguel Arreola (JIRA)" <j...@apache.org>
Subject [jira] [Issue Comment Deleted] (HADOOP-14193) Cache the resolved hosts to prevent calls to InetAddress.getByName and normalizeHost
Date Thu, 16 Mar 2017 23:14:41 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-14193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Jose Miguel Arreola updated HADOOP-14193:
    Comment: was deleted

(was: [~aagarwal] i opened this ticket by mistake in HADOOP instead of YARN, so i closed this
as invalid, and created it in the right place in YARN, refer to this issue: https://issues.apache.org/jira/browse/YARN-6358)

> Cache the resolved hosts to prevent calls to InetAddress.getByName and normalizeHost
> ------------------------------------------------------------------------------------
>                 Key: HADOOP-14193
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14193
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: common
>            Reporter: Jose Miguel Arreola
>   Original Estimate: 24h
>  Remaining Estimate: 24h
> When running performance tests, we noticed that a lot of time is taken in resolving the
host address.
> In our specific scenario, we saw the function org.apache.hadoop.security.SecurityUtil.getInetAddressByName
taking a lot of time to resolve the hosts, and the same function is called a lot of times.
> I saw that org.apache.hadoop.yarn.server.resourcemanager.NodesListManager has a cached
resolver already because of the same reason.
> So, the proposal is, to make this cache generic and use it to save some time in this
functions that we already know, but have it available so the cache can be used anywhere else.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message