hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sharad Agarwal (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5931) Collect information about number of tasks succeeded / total per time unit for a tasktracker.
Date Thu, 18 Jun 2009 10:23:12 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721168#action_12721168
] 

Sharad Agarwal commented on HADOOP-5931:
----------------------------------------

Had a discussion with Owen, following came up:
- Metric Api is an export interface, so we should not use it. We want to build the metrics
natively in Hadoop so it should not be exposed via metrics config file.
- It is better to do the collection in jobtracker. The restart concern will go away as at
some point we will have heartbeat transaction log. So recovery would be generic. Having it
in jobtracker will give us more control to make scheduling decisions.


> Collect information about number of tasks succeeded / total per time unit for a tasktracker.

> ---------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-5931
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5931
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Hemanth Yamijala
>            Assignee: Sharad Agarwal
>             Fix For: 0.21.0
>
>         Attachments: 5931_v1.patch, 5931_v2.patch
>
>
> Collecting information of number of tasks succeeded / total per tasktracker and being
able to see these counts per hour, day and since start time will help reason about things
like the blacklisting strategy.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message