hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-4565) Backport MR-2855 to branch-1: ResourceBundle lookup during counter name resolution takes a lot of time
Date Sat, 18 Aug 2012 19:22:37 GMT
Karthik Kambatla created MAPREDUCE-4565:
-------------------------------------------

             Summary: Backport MR-2855 to branch-1: ResourceBundle lookup during counter name
resolution takes a lot of time
                 Key: MAPREDUCE-4565
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4565
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 0.23.0
            Reporter: Karthik Kambatla
            Assignee: Siddharth Seth
             Fix For: 0.23.2


Loading a job status page in trunk takes a lot of time, and it seems like most of the time
is spent resolving counter names. Looking through the JDK source, ResourceBundle.getBundle(String)
ends up calling getClassContext() which is not very efficient. I think if we pass our own
classloader manually it will be faster. In Counters.incrAllCounters, we may also be able to
avoid setting the counter name if one is already set.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message