hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-1906) Lower default minimum heartbeat interval for tasktracker > Jobtracker
Date Tue, 25 Sep 2012 15:33:12 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462875#comment-13462875
] 

Arun C Murthy commented on MAPREDUCE-1906:
------------------------------------------

Matt - if you don't mind, I'd like to merge this into branch-1.1 since it's been well baked-in.
Thoughts?
                
> Lower default minimum heartbeat interval for tasktracker > Jobtracker
> ---------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1906
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1906
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: jobtracker, performance, tasktracker
>    Affects Versions: 0.20.1, 0.20.2, 1.2.0
>            Reporter: Scott Carey
>            Assignee: Todd Lipcon
>             Fix For: 0.23.0, 1.2.0
>
>         Attachments: MAPREDUCE-1906-0.21.patch, MAPREDUCE-1906.branch-1.patch, mapreduce-1906.txt,
mapreduce-1906.txt
>
>
> I get a 0% to 15% performance increase for smaller clusters by making the heartbeat throttle
stop penalizing clusters with less than 300 nodes.
> Between 0.19 and 0.20, the default minimum heartbeat interval increased from 2s to 3s.
  If a JobTracker is throttled at 100 heartbeats / sec for large clusters, why should a cluster
with 10 nodes be throttled to 3.3 heartbeats per second?  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message