hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2208) Reduce frequency of Counter updates in the task tracker status
Date Thu, 15 Nov 2007 13:47:43 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542778

Owen O'Malley commented on HADOOP-2208:

Actually, I would also cap sending the counters to once every 10 seconds and when the task
changes state. That way, if you send an extra heartbeat to get a new task, you won't send
the counters.

> Reduce frequency of Counter updates in the task tracker status
> --------------------------------------------------------------
>                 Key: HADOOP-2208
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2208
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Amareshwari Sri Ramadasu
>            Assignee: Amareshwari Sri Ramadasu
> Currently,  We have counter updates from task tracker to job tracker on every heartbeat.
Both counter name and the values are updated for every heartbeat. This can be improved by
sending names and values for the first time and only the values after that.
> The frequency can be reduced by doing update only when the counters got changed. 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message