hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5931) Collect information about number of tasks succeeded / total per time unit for a tasktracker.
Date Thu, 04 Jun 2009 15:29:40 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716297#action_12716297
] 

Hemanth Yamijala commented on HADOOP-5931:
------------------------------------------

I am assuming the moving window mechanism would be flexible enough to add new bucket sizes
as required.

Regarding having the computation on the tasktracker, and reporting the status via status,
one problem is that if we want to change the bucket size, it would involve a change in the
status object.

Also, one requirement for this is to store this information on the JobTracker. Can you describe
how this will be stored, mechanics with respect to lost tasktrackers etc  ? 

Will this information be available if the JobTracker restarts ?

> Collect information about number of tasks succeeded / total per time unit for a tasktracker.

> ---------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-5931
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5931
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Hemanth Yamijala
>
> Collecting information of number of tasks succeeded / total per tasktracker and being
able to see these counts per hour, day and since start time will help reason about things
like the blacklisting strategy.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message