hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-4229) Intern counter names in the JT
Date Fri, 04 May 2012 23:47:48 GMT
Todd Lipcon created MAPREDUCE-4229:
--------------------------------------

             Summary: Intern counter names in the JT
                 Key: MAPREDUCE-4229
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4229
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: jobtracker
    Affects Versions: 1.0.2
            Reporter: Todd Lipcon


In our experience, most of the memory in production JTs goes to storing counter names (String
objects and character arrays). Since most counter names are reused again and again, it would
be a big memory savings to keep a hash set of already-used counter names within a job, and
refer to the same object from all tasks.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message