hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3813) RackResolver should maintain a cache to avoid repetitive lookups.
Date Mon, 06 Feb 2012 05:41:59 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13201046#comment-13201046

Allen Wittenauer commented on MAPREDUCE-3813:

If this is to cache hostname resolution, this shouldn't be necessary as Java already does
this for you for free.  See the discussion under HDFS-34.
> RackResolver should maintain a cache to avoid repetitive lookups.
> -----------------------------------------------------------------
>                 Key: MAPREDUCE-3813
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3813
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: mrv2, performance
>    Affects Versions: 0.23.0
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Vinod Kumar Vavilapalli
>             Fix For: 0.23.1
>         Attachments: MAPREDUCE-3813-20120205.txt
> With the current code, during task creation, we repeatedly resolve hosts and RackResolver
doesn't cache any of the results. Caching will improve performance.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message