Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8C47C7BA0 for ; Sat, 3 Dec 2011 03:16:13 +0000 (UTC) Received: (qmail 17163 invoked by uid 500); 3 Dec 2011 03:16:12 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 16946 invoked by uid 500); 3 Dec 2011 03:16:10 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 16893 invoked by uid 99); 3 Dec 2011 03:16:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 03 Dec 2011 03:16:05 +0000 X-ASF-Spam-Status: No, hits=1.6 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of arunk786@gmail.com designates 209.85.213.176 as permitted sender) Received: from [209.85.213.176] (HELO mail-yx0-f176.google.com) (209.85.213.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 03 Dec 2011 03:15:59 +0000 Received: by yenm10 with SMTP id m10so2676347yen.35 for ; Fri, 02 Dec 2011 19:15:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:from:date:message-id:subject:to:content-type; bh=xOFPxEE84L3je+hUMydaPOVI2rhYQMTHPv2qa5/vMBw=; b=dlEP5WvLkqtDRRHf6l3Tp4QTTNHviuuRqWnZLHmUtTB+q8ZijzSu+G5dw4bcZU+HKq JwvTxruPiJFtPCA9Sx46TqhLzssYI47N3gTGWkj4G1iDAb+yL8NrNnekS+r51GrRJiEh ky5zW/xpoPsq2V8C6m07Xc/WTFabvNg0C+48Q= Received: by 10.236.183.138 with SMTP id q10mr264568yhm.128.1322882138250; Fri, 02 Dec 2011 19:15:38 -0800 (PST) MIME-Version: 1.0 Received: by 10.236.201.70 with HTTP; Fri, 2 Dec 2011 19:15:17 -0800 (PST) From: arun k Date: Sat, 3 Dec 2011 08:45:17 +0530 Message-ID: Subject: Capturing Map/reduce task run times and bytes read & Console Output Not seen To: mapreduce-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=20cf3056408fee1d9b04b3277f31 --20cf3056408fee1d9b04b3277f31 Content-Type: text/plain; charset=ISO-8859-1 Hi guys ! I have set up a single node cluster as per below link http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/#run-the-mapreduce-job I have tried to run Wordcount example. > I have given the sysout statements in Worcount.java, MapTask.java and LocalJobRunner.java. I have done - {HADOOP_HOME}$ ant build - started daemons - ran the Example but i don't see them on console output. I tried to find in logs but i couldn't find them. Where exactly can is see them ? > When the M/R job finishes is see that counters display Bytes read and written. Are these related a particular map task of the job or total bytes for both map and reduce task ? How do i get how many bytes were read and written by map and reduce task separately ? Thanks, Arun --20cf3056408fee1d9b04b3277f31 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi guys !

I have set up a single node c= luster as per below link

I have tried to run Wordcount e= xample.

> I have given the sysout st= atements in Worcount.java, MapTask.java and LocalJobRunner.java.
=A0 =A0I have done
=A0 - {HADOOP_HOM= E}$ ant build
=A0 - started daemons
=A0 - ran the = Example
=A0but i don't see them on console output. I tried to = find in logs but i couldn't find them. Where exactly can is see them ?<= /div>

> When the M/R job finishes = is see that counters display Bytes read and written. Are these related a pa= rticular map task of the job or total bytes for both map and reduce task ?<= /div>
=A0 =A0How do i= get how many bytes were read and written by map and reduce task=A0separate= ly ?

= Thanks,
Arun
<= span class=3D"Apple-style-span" style=3D"border-collapse: collapse;">
--20cf3056408fee1d9b04b3277f31--