Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EF891103E1 for ; Sun, 2 Jun 2013 18:38:39 +0000 (UTC) Received: (qmail 51861 invoked by uid 500); 2 Jun 2013 18:38:26 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 51761 invoked by uid 500); 2 Jun 2013 18:38:26 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 51750 invoked by uid 99); 2 Jun 2013 18:38:25 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Jun 2013 18:38:25 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of siddharth.tiwari@live.com designates 65.54.61.97 as permitted sender) Received: from [65.54.61.97] (HELO snt0-omc2-s46.snt0.hotmail.com) (65.54.61.97) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Jun 2013 18:38:21 +0000 Received: from SNT142-W38 ([65.55.90.73]) by snt0-omc2-s46.snt0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Sun, 2 Jun 2013 11:38:01 -0700 X-TMN: [RjAQCzIdu6aUs+ET5E0RnfZ4HgnaJyXF] X-Originating-Email: [siddharth.tiwari@live.com] Message-ID: Content-Type: multipart/alternative; boundary="_fa469492-4200-4456-8e57-b9efe1126557_" From: Siddharth Tiwari To: USers Hadoop Subject: RE: size of input files Date: Sun, 2 Jun 2013 18:38:00 +0000 Importance: Normal In-Reply-To: References: , MIME-Version: 1.0 X-OriginalArrivalTime: 02 Jun 2013 18:38:01.0101 (UTC) FILETIME=[4F69B3D0:01CE5FC0] X-Virus-Checked: Checked by ClamAV on apache.org --_fa469492-4200-4456-8e57-b9efe1126557_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Do the counters provide the input file size ? I mean is bytes read equal to= input file size ? Is there any log where I could find input file size subm= itted to each job. I believed that bytes read from fs is different from the= input file size to the job. *------------------------* =0A= Cheers !!! =0A= Siddharth Tiwari =0A= Have a refreshing day !!! "Every duty is holy=2C and devotion to duty is the highest form of worship = of God.=94=20 =0A= "Maybe other people will try to limit me but I don't limit myself" From: rahul.rec.dgp@gmail.com Date: Sun=2C 2 Jun 2013 23:26:08 +0530 Subject: Re: size of input files To: user@hadoop.apache.org Counters can help. Input to mr is a directory. The counters can point to th= e number of bytes read from that fs directory. =0A= =0A= Rahul On Sun=2C Jun 2=2C 2013 at 11:22 PM=2C Siddharth Tiwari wrote: =0A= =0A= =0A= =0A= =0A= Hi Friends=2C Is there a way to find out what was the size of the input file to each of t= he jobs from the logs or any other place for all jobs submitted ?=0A= =0A= Please help *------------------------* =0A= Cheers !!! =0A= Siddharth Tiwari =0A= Have a refreshing day !!! "Every duty is holy=2C and devotion to duty is the highest form of worship = of God.=94=20 =0A= =0A= =0A= "Maybe other people will try to limit me but I don't limit myself" =0A= =0A= =0A= = --_fa469492-4200-4456-8e57-b9efe1126557_ Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable
Do the counters provide the input file size ? I mean is bytes read = equal to input file size ? =3B
Is there any log where I could find input file size submitted t= o each job. I believed that bytes read from fs is different from the input = file size to the job.

*------= ------------------*
=0A= = Cheers !!!
=0A= = Siddharth Tiwari=0A= Have a r= efreshing day !!!"Every duty is holy=2C and devotion to duty is the highest form of wors= hip of God.=94
=0A= "Maybe other people will try to limit me but I do= n't limit myself"


From: rahul.rec.dgp@gmail.comDate: Sun=2C 2 Jun 2013 23:26:08 +0530
Subject: Re: size of input files=
To: user@hadoop.apache.org

Counters can help. Input to mr is a directory. The counters can point to t= he number of bytes read from that fs directory.

=0A= =0A=
Rahul


On Sun=2C Jun 2=2C 2013 at 11:22 = PM=2C Siddharth Tiwari <=3Bsiddharth.tiwari@live.com>=3B wrote:
=0A= =0A=
=0A= =0A= =0A=
Hi Friends=2C=

<= font color=3D"#17365D" face=3D"Tahoma">Is there a way to find out what was = the size of the input file to each of the jobs from the logs or any other p= lace for all jobs submitted ?
=0A= =0A=

Please help


*------------------------*
=0A= Cheers != !!
=0A= Siddharth T= iwariHave a refreshing d= ay !!!
"Every duty is holy=2C and = devotion to duty is the highest form of worship of God.=94
= =0A= =0A= =0A= "Maybe othe= r people will try to limit me but I don't limit myself"
=0A= =0A=
=0A=

= --_fa469492-4200-4456-8e57-b9efe1126557_--