hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Scott Carey (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-1906) Lower minimum heartbeat interval for tasktracker > Jobtracker
Date Thu, 01 Jul 2010 17:09:49 GMT
Lower minimum heartbeat interval for tasktracker > Jobtracker

                 Key: MAPREDUCE-1906
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1906
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
    Affects Versions: 0.20.2, 0.20.1
            Reporter: Scott Carey

I get a 0% to 15% performance increase for smaller clusters by making the heartbeat throttle
stop penalizing clusters with less than 300 nodes.

Between 0.19 and 0.20, the default minimum heartbeat interval increased from 2s to 3s.   If
a JobTracker is throttled at 100 heartbeats / sec for large clusters, why should a cluster
with 10 nodes be throttled to 3.3 heartbeats per second?  

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message