hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2015) Job tracker should report the number of splits that are local to some task trackers
Date Wed, 24 Oct 2007 23:25:50 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12537455
] 

Owen O'Malley commented on HADOOP-2015:
---------------------------------------

I think for most users this is unwanted information. I'd be much happier if the information
was just logged on the JT where an interested sysadmin could mine the data, but where it wouldn't
confuse the user.

> Job tracker should report the number of splits that are local to some task trackers
> -----------------------------------------------------------------------------------
>
>                 Key: HADOOP-2015
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2015
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Runping Qi
>            Assignee: Runping Qi
>         Attachments: hadoop-2015.txt
>
>
> Right now, jon tracker keeps track the number of launched mappers with local data.
> However, it is not clear how many mappers that are potentially be launched with data
locality.
> This information is readily available in Job Tracker. It is just a matter to create a
separate global  counter 
> and set it at the Job Tracker initialization time.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message