Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4A77E6189 for ; Fri, 24 Jun 2011 20:46:27 +0000 (UTC) Received: (qmail 95529 invoked by uid 500); 24 Jun 2011 20:46:26 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 95471 invoked by uid 500); 24 Jun 2011 20:46:26 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 95463 invoked by uid 99); 24 Jun 2011 20:46:25 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Jun 2011 20:46:25 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of mapred.learn@gmail.com designates 209.85.210.48 as permitted sender) Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Jun 2011 20:46:19 +0000 Received: by pzk10 with SMTP id 10so2647102pzk.35 for ; Fri, 24 Jun 2011 13:45:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=jkkzyxCUe2xGLQCWUMIy7kXtavLeBSSVoVo3uD0P6wc=; b=Kq2TY1/pr5Vry9c5C2/M6XdqI3QvQLewsm6XrmiawK1HhF+jA6aM/TluMeXSDtatry LIss+PXmgQKUFQcp+3NIVSnSmWX4SkJfDcq1T4JO4/9dE27k9Y0fnq+b7MKV/SGyr4VK eDefGL3gLR227kkNd2wYJi2BAZe0mBfJOjdKI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=xZfuTIrmSUOeWW9DmAP3fRVDCBtG+e1k7ZohBOHItD0eeIh4SFuCHHU0LLS4kbcjqG 07MhB3Mo3tKKHmfExkJ9DZb+bWj1svaLM55Q4ZIaNz+lfP12UwCNsPJ9PEoiUm2jAOFL /nYHiTq7QDfg3KwunOqTNa3TUUI7PAS0Qvdmw= MIME-Version: 1.0 Received: by 10.143.63.3 with SMTP id q3mr785187wfk.25.1308948357622; Fri, 24 Jun 2011 13:45:57 -0700 (PDT) Received: by 10.142.254.1 with HTTP; Fri, 24 Jun 2011 13:45:57 -0700 (PDT) In-Reply-To: References: <40039DDC-79E5-4F13-99A4-CBE410EA0A69@cloudera.com> Date: Fri, 24 Jun 2011 13:45:57 -0700 Message-ID: Subject: Re: how to identify inputsplit that a mapper is failing on ? From: Mapred Learn To: "cdh-user@cloudera.org" Cc: "mapreduce-user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=000e0cd25136e2acdc04a67b49a6 X-Virus-Checked: Checked by ClamAV on apache.org --000e0cd25136e2acdc04a67b49a6 Content-Type: text/plain; charset=ISO-8859-1 Hi Ian, i think input split locations on WebGUI are the block locations in the cluster where input file is distributed while uploading to HDFS, not the physical split being processed by the mapper. On Fri, Jun 24, 2011 at 10:37 AM, Mapred Learn wrote: > Hi Ian, > I do not see the split in mapper GUI > I was avoiding logging in from mapper but looks like only option > > Thanks for the response ! > > Sent from my iPhone > > On Jun 24, 2011, at 10:28 AM, Ian Wrigley wrote: > > > Hi > > > > On Jun 24, 2011, at 10:19 AM, Mapred Learn wrote: > > > >> Hi, > >> One of the mappers in my job is failing and I cannot find out the input > split that it is failing on. How can I find this info ? > > > > Usually the Mapper's status in the Web UI will display the input split > that it is working on; otherwise you could log this from each Mapper. > > > > Regards > > > > Ian. > > > > > > --- > > Ian Wrigley > > Senior Instructor > > Cloudera, Inc > > Cell: (323) 819-4075 > > > > > > > > > --000e0cd25136e2acdc04a67b49a6 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi Ian,
i think input split locations on WebGUI are the block locations in the= cluster where input file is distributed while uploading to HDFS, not the p= hysical split being processed by the mapper.
=A0
=A0
On Fri, Jun 24, 2011 at 10:37 AM, Mapred Learn <= span dir=3D"ltr"><mapred.learn= @gmail.com> wrote:
Hi Ian,
I do not see the spli= t in mapper GUI
I was avoiding logging in from mapper but looks like onl= y option

Thanks for the response !

Sent from my iPhone

On Jun 24, 2011, at 10:28 AM, Ian Wrigley <ian@cloudera.com> wrote:

> Hi=
>
> On Jun 24, 2011, at 10:19 AM, Mapred Learn wrote:
><= br> >> Hi,
>> One of the mappers in my job is failing and I cann= ot find out the input split that it is failing on. How can I find this info= ?
>
> Usually the Mapper's status in the Web UI will displ= ay the input split that it is working on; otherwise you could log this from= each Mapper.
>
> Regards
>
> Ian.
>
>
> ---
&g= t; Ian Wrigley
> Senior Instructor
> Cloudera, Inc
> Cell= : (323) 819-407= 5
>
>
>
>

--000e0cd25136e2acdc04a67b49a6--