Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id ED18DF91C for ; Fri, 3 May 2013 08:14:41 +0000 (UTC) Received: (qmail 85788 invoked by uid 500); 3 May 2013 08:14:37 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 84719 invoked by uid 500); 3 May 2013 08:14:32 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 84521 invoked by uid 99); 3 May 2013 08:14:30 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 May 2013 08:14:30 +0000 X-ASF-Spam-Status: No, hits=-2.8 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_HI,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of Nikhil.Agarwal@netapp.com designates 216.240.18.38 as permitted sender) Received: from [216.240.18.38] (HELO mx1.netapp.com) (216.240.18.38) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 May 2013 08:14:24 +0000 X-IronPort-AV: E=Sophos;i="4.87,602,1363158000"; d="scan'208,217";a="255938813" Received: from smtp2.corp.netapp.com ([10.57.159.114]) by mx1-out.netapp.com with ESMTP; 03 May 2013 01:14:02 -0700 Received: from vmwexceht02-prd.hq.netapp.com (vmwexceht02-prd.hq.netapp.com [10.106.76.240]) by smtp2.corp.netapp.com (8.13.1/8.13.1/NTAP-1.6) with ESMTP id r438E2t5023439 for ; Fri, 3 May 2013 01:14:02 -0700 (PDT) Received: from SACEXCMBX01-PRD.hq.netapp.com ([169.254.2.71]) by vmwexceht02-prd.hq.netapp.com ([10.106.76.240]) with mapi id 14.02.0342.003; Fri, 3 May 2013 01:14:01 -0700 From: "Agarwal, Nikhil" To: "user@hadoop.apache.org" Subject: Which data sets were processed by each tasktracker? Thread-Topic: Which data sets were processed by each tasktracker? Thread-Index: Ac5Hv+dMUNRmmzBqTm+W4X4EE+geVQ== Date: Fri, 3 May 2013 08:14:01 +0000 Message-ID: <7B0D51053A50034199FF706B2513104F09C42D08@SACEXCMBX01-PRD.hq.netapp.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.106.53.51] Content-Type: multipart/alternative; boundary="_000_7B0D51053A50034199FF706B2513104F09C42D08SACEXCMBX01PRDh_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_7B0D51053A50034199FF706B2513104F09C42D08SACEXCMBX01PRDh_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, I have a 3-node cluster, with JobTracker running on one machine and TaskTr= ackers on other two. Instead of using HDFS, I have written my own FileSyste= m implementation. I am able to run a MapReduce job on this cluster but I am= not able to make out from logs or TaskTracker UI, which data sets were exa= ctly processed by each of the two slaves. Can you please tell me some way to find out what exactly did each of my tas= ktracker do during the entire job execution? I am using Hadoop-1.0.4 source= code. Thanks & Regards, Nikhil --_000_7B0D51053A50034199FF706B2513104F09C42D08SACEXCMBX01PRDh_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi,

I have a 3-node cluster, with JobTracker runni= ng on one machine and TaskTrackers on other two. Instead of using HDFS, I h= ave written my own FileSystem implementation. I am able to run a MapReduce = job on this cluster but I am not able to make out from logs or TaskTracker UI, which data sets were exactly process= ed by each of the two slaves.

Can you please tell me some way to find out what exa= ctly did each of my tasktracker do during the entire job execution? I am us= ing Hadoop-1.0.4 source code.

Thanks & Regards,

Nikhil

--_000_7B0D51053A50034199FF706B2513104F09C42D08SACEXCMBX01PRDh_--