Return-Path: 
 <common-user-return-26957-apmail-hadoop-common-user-archive=hadoop.apache.org@hadoop.apache.org>
Delivered-To: apmail-hadoop-common-user-archive@www.apache.org
Received: (qmail 41423 invoked from network); 18 Mar 2011 18:12:39 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3)
  by minotaur.apache.org with SMTP; 18 Mar 2011 18:12:39 -0000
Received: (qmail 71227 invoked by uid 500); 18 Mar 2011 18:12:34 -0000
Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org
Received: (qmail 71124 invoked by uid 500); 18 Mar 2011 18:12:34 -0000
Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-user@hadoop.apache.org>
List-Id: <common-user.hadoop.apache.org>
Reply-To: common-user@hadoop.apache.org
Delivered-To: mailing list common-user@hadoop.apache.org
Received: (qmail 71106 invoked by uid 99); 18 Mar 2011 18:12:34 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Mar 2011 18:12:34 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of zhunansjtu@gmail.com designates
 209.85.214.176 as permitted sender)
Received: from [209.85.214.176] (HELO mail-iw0-f176.google.com)
 (209.85.214.176)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Mar 2011 18:12:26 +0000
Received: by iwr19 with SMTP id 19so5719267iwr.35
        for <multiple recipients>; Fri, 18 Mar 2011 11:12:05 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=domainkey-signature:mime-version:in-reply-to:references:date
         :message-id:subject:from:to:cc:content-type;
        bh=KP/eXvBbYZxNS5KxPW0fKBYGbUQ5rxmfsA0uIWSXs1k=;
        b=k40yVjknhF/ckoTfaG1XKh0huo+Ddwfe7wGsS+NBRjUVgbDyPZgnOzo2+4B1JJ0pK/
         1Xr87NjQsizDkTtGb8aBSsabBzbjctwmzGiLVjM8LV5rIyYvjTLXCCuXXMJMp1H3Y4/O
         jFKJqXr6QmYRU1QiN6m+arQLvJ46Yl22tMHno=
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :cc:content-type;
        b=EOL7LwFa3i734/6nTJdwfo0h7G3HEpLlPa34q7gpYqdR3dt1Nqq5iFkj9oG93UwVMr
         9bwVVv+qM5Ef6bDwUVeIB/l+HVjowmPqny9KxQQn9o7hn1uMbxu2JukuUNzCBuVYvs5t
         NBhmgdjIXAcuvdJBld3MFUlv2OjnlG3zwcDSA=
MIME-Version: 1.0
Received: by 10.42.153.2 with SMTP id k2mr1930182icw.333.1300471925787; Fri,
 18 Mar 2011 11:12:05 -0700 (PDT)
Received: by 10.42.168.72 with HTTP; Fri, 18 Mar 2011 11:12:05 -0700 (PDT)
In-Reply-To: <AANLkTinYm5TkXGy1mpW9t7Wc=RWXuEm+OsWojtSKJzqc@mail.gmail.com>
References: <AANLkTinYm5TkXGy1mpW9t7Wc=RWXuEm+OsWojtSKJzqc@mail.gmail.com>
Date: Sat, 19 Mar 2011 02:12:05 +0800
Message-ID: <AANLkTi=F0Z9dmgmjD77Mh+MZKKdDfH3mt_nh9kS3c+8_@mail.gmail.com>
Subject: Re: modification to Hadoop Jobtracker
From: Nan Zhu <zhunansjtu@gmail.com>
To: common-user@hadoop.apache.org
Cc: bikash sharma <sharmabiks.07@gmail.com>, common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=90e6ba6e8c9c2d4e8a049ec5b73c
X-Virus-Checked: Checked by ClamAV on apache.org

--90e6ba6e8c9c2d4e8a049ec5b73c
Content-Type: text/plain; charset=ISO-8859-1

Hi, bikash

I also worked on this several months ago,

If I don't have a wrong memory, the involved files should be:
JobTracker.java, TaskTracker.java,

the most interesting functions should be JobTracker.heartbeat(), and
TaskTracker.transmitHeartbeat(), I think you will also need to add more
member variables in TaskTrackerStatus.java

take care about the write() and read() in TaskTrackerStatus.java,

Best,

Nan

On Sat, Mar 19, 2011 at 1:59 AM, bikash sharma <sharmabiks.07@gmail.com>wrote:

> Hi,
> For my research project, I need to modify Hadoop JobTracker to collect some
> statistics of TaskTracker nodes.
> For example, I would like to piggy-back heartbeat messages sent from
> TaskTrackers to JobTracker with some extra information related to the
> resource utilization and other statistics.
> I am able to checkout Hadoop common code base and build in Eclipse.
> Specifically, which files should I look at, and after the above mentioned
> modification, how to collect the statistics?
>
> Thanks,
> Bikash
>



-- 
Nan Zhu
School of Software,5501
Shanghai Jiao Tong University
800,Dongchuan Road,Shanghai,China
E-Mail: zhunansjtu@gmail.com

--90e6ba6e8c9c2d4e8a049ec5b73c--