hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-2208) Reduce frequency of Counter updates in the task tracker status
Date Thu, 20 Dec 2007 10:57:43 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arun C Murthy updated HADOOP-2208:
----------------------------------

    Status: Open  (was: Patch Available)

I see a potential bug with this patch: the TaskTracker _caches_ counters sent by the child-task
till it's sent out to the JobTracker via the heartbeat. Hence, we need to *merge* the ones
received from the child in {{TaskStatus.statusUpdate}}, not just over-write them as-is today.

Minor nit: the merge of the counters probably belongs to {{TaskInProgress.recomputeProgress}}
rather than {{TaskInProgress.updateStatus}} ...

> Reduce frequency of Counter updates in the task tracker status
> --------------------------------------------------------------
>
>                 Key: HADOOP-2208
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2208
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Amareshwari Sri Ramadasu
>            Assignee: Amareshwari Sri Ramadasu
>             Fix For: 0.16.0
>
>         Attachments: patch-2208.txt, patch-2208.txt
>
>
> Currently,  We have counter updates from task tracker to job tracker on every heartbeat.
Both counter name and the values are updated for every heartbeat. This can be improved by
sending names and values for the first time and only the values after that.
> The frequency can be reduced by doing update only when the counters got changed. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message