hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Scott Chen (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-2026) JobTracker.getJobCounters() should not hold JobTracker lock while calling JobInProgress.getCounters()
Date Sat, 21 Aug 2010 03:41:16 GMT
JobTracker.getJobCounters() should not hold JobTracker lock while calling JobInProgress.getCounters()
-----------------------------------------------------------------------------------------------------

                 Key: MAPREDUCE-2026
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2026
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
            Reporter: Scott Chen
            Assignee: Scott Chen
             Fix For: 0.22.0


JobTracker.getJobCounter() will lock JobTracker and call JobInProgress.getCounters().
JobInProgress.getCounters() can be very expensive because it aggregates all the task counters.
We found that from the JobTracker jstacks that this method is one of the bottleneck of the
JobTracker performance.

JobInProgress.getCounters() should be able to be called out side the JobTracker lock because
it already has JobInProgress lock.
For example, it is used by jobdetails.jsp without a JobTracker lock.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message