hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nan Zhu <zhunans...@gmail.com>
Subject Re: modification to Hadoop Jobtracker
Date Fri, 18 Mar 2011 18:12:05 GMT
Hi, bikash

I also worked on this several months ago,

If I don't have a wrong memory, the involved files should be:
JobTracker.java, TaskTracker.java,

the most interesting functions should be JobTracker.heartbeat(), and
TaskTracker.transmitHeartbeat(), I think you will also need to add more
member variables in TaskTrackerStatus.java

take care about the write() and read() in TaskTrackerStatus.java,



On Sat, Mar 19, 2011 at 1:59 AM, bikash sharma <sharmabiks.07@gmail.com>wrote:

> Hi,
> For my research project, I need to modify Hadoop JobTracker to collect some
> statistics of TaskTracker nodes.
> For example, I would like to piggy-back heartbeat messages sent from
> TaskTrackers to JobTracker with some extra information related to the
> resource utilization and other statistics.
> I am able to checkout Hadoop common code base and build in Eclipse.
> Specifically, which files should I look at, and after the above mentioned
> modification, how to collect the statistics?
> Thanks,
> Bikash

Nan Zhu
School of Software,5501
Shanghai Jiao Tong University
800,Dongchuan Road,Shanghai,China
E-Mail: zhunansjtu@gmail.com

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message