Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7179D9CAD for ; Mon, 13 Aug 2012 11:33:42 +0000 (UTC) Received: (qmail 22515 invoked by uid 500); 13 Aug 2012 11:33:36 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 22040 invoked by uid 500); 13 Aug 2012 11:33:28 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 22006 invoked by uid 99); 13 Aug 2012 11:33:27 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Aug 2012 11:33:27 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of subs.zero@gmail.com designates 209.85.212.48 as permitted sender) Received: from [209.85.212.48] (HELO mail-vb0-f48.google.com) (209.85.212.48) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Aug 2012 11:33:23 +0000 Received: by vbme21 with SMTP id e21so4099151vbm.35 for ; Mon, 13 Aug 2012 04:33:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=bvPKjRbpylTc/4VaJbfH86YXEoVQoA5QFqyQqK8rVJ4=; b=hkFdUHwCJX+KxTJa5O+En4w5hErIpORMOEMg6LKrOejW/IkUVbb9F2ATKsX4vhngvu bqdQ+crezBlw2kjHKftQC2eD8XGyQxuuo28wcuVPho5dkIMMH/wrmC5W+XPCpbN3EKbm xtyzSRteJZqMGMYSSztwUcJdSKgTSS20DSaicODDNcY8gELy2p1hbgkT4Pzdbc2UOQET Oa8dK9l6djE/+YBvcNXgPn0KC+JHP+TGcgjCqE1QIOacz3chUA1BaBkS3W/9LAIKL75P dX11q+idL7xk+RtIK19XcM3JDsQZ4oMks3mRJgM/YL4XIw7GfrBPf4YaLFoqYbIKOC/1 RCJg== Received: by 10.52.240.205 with SMTP id wc13mr7164007vdc.35.1344857582598; Mon, 13 Aug 2012 04:33:02 -0700 (PDT) MIME-Version: 1.0 Received: by 10.58.245.202 with HTTP; Mon, 13 Aug 2012 04:32:42 -0700 (PDT) In-Reply-To: References: <06006DDA5A27D541991944AC4117E7A95AA4B52A@szxeml524-mbx.china.huawei.com> From: Subho Banerjee Date: Mon, 13 Aug 2012 17:02:42 +0530 Message-ID: Subject: Re: Hadoop in Pseudo-Distributed To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=20cf307ac14d7bfbc004c7240e5d X-Virus-Checked: Checked by ClamAV on apache.org --20cf307ac14d7bfbc004c7240e5d Content-Type: text/plain; charset=ISO-8859-1 Hello Harsh, I tried setting it. But it doesnt seem to help. There is also something else that I found out.... The link http://localhost:50060/tasklog?plaintext=true&attemptid=attempt_201208131655_0001_m_000000_0&filter=stderr works and actually returns me the error, however http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208131655_0001_m_000000_0&filter=stderr gives me a 403 error. My IP on the LAN is 10.1.66.17. Could this be the problem? On Mon, Aug 13, 2012 at 2:47 PM, Harsh J wrote: > Subho, > > Can you try to tweak the "mapred.task.tracker.http.address" in > mapred-site.xml, and set it to always bind to localhost? (i.e. set it > to "localhost:50060", instead of default "0.0.0.0:50060") and then see > if you get this behavior? > > On Mon, Aug 13, 2012 at 12:37 PM, Subho Banerjee > wrote: > > Yes I did that already as I had mentioned in my previous mail, yet I am > > having the problem. > > > > I was just trying something, and I came across some really weird > behaviour, > > the moment I disconnect from my local network(unplug my LAN cable) and > try > > to run this, it works just fine. But when I am connected to my network, > it > > gives me the error I listed above. > > > > > > On Mon, Aug 13, 2012 at 11:11 AM, Devaraj k > wrote: > >> > >> Can you go through this issue > >> https://issues.apache.org/jira/browse/HADOOP-7489, It is discussed and > >> provided some workarounds for this problem. > >> > >> > >> > >> > >> > >> Thanks > >> > >> Devaraj > >> > >> ________________________________ > >> From: Subho Banerjee [subs.zero@gmail.com] > >> Sent: Monday, August 13, 2012 10:47 AM > >> To: user@hadoop.apache.org > >> Subject: Hadoop in Pseudo-Distributed > >> > >> Hello, > >> > >> I am running hadoop v1.0.3 in Mac OS X 10.8 with Java_1.6.0_33-b03-424 > >> > >> > >> When running hadoop on pseudo-distributed mode, the map seems to work, > but > >> it cannot compute the reduce. > >> > >> 12/08/13 08:58:12 INFO mapred.JobClient: Running job: > >> job_201208130857_0001 > >> 12/08/13 08:58:13 INFO mapred.JobClient: map 0% reduce 0% > >> 12/08/13 08:58:27 INFO mapred.JobClient: map 20% reduce 0% > >> 12/08/13 08:58:33 INFO mapred.JobClient: map 30% reduce 0% > >> 12/08/13 08:58:36 INFO mapred.JobClient: map 40% reduce 0% > >> 12/08/13 08:58:39 INFO mapred.JobClient: map 50% reduce 0% > >> 12/08/13 08:58:42 INFO mapred.JobClient: map 60% reduce 0% > >> 12/08/13 08:58:45 INFO mapred.JobClient: map 70% reduce 0% > >> 12/08/13 08:58:48 INFO mapred.JobClient: map 80% reduce 0% > >> 12/08/13 08:58:51 INFO mapred.JobClient: map 90% reduce 0% > >> 12/08/13 08:58:54 INFO mapred.JobClient: map 100% reduce 0% > >> 12/08/13 08:59:14 INFO mapred.JobClient: Task Id : > >> attempt_201208130857_0001_m_000000_0, Status : FAILED > >> Too many fetch-failures > >> 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer > >> returned HTTP response code: 403 for URL: > >> > http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout > >> 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer > >> returned HTTP response code: 403 for URL: > >> > http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr > >> 12/08/13 08:59:18 INFO mapred.JobClient: map 89% reduce 0% > >> 12/08/13 08:59:21 INFO mapred.JobClient: map 100% reduce 0% > >> 12/08/13 09:00:14 INFO mapred.JobClient: Task Id : > >> attempt_201208130857_0001_m_000001_0, Status : FAILED > >> Too many fetch-failures > >> > >> Here is what I get when I try to see the tasklog using the links given > in > >> the output > >> > >> > >> > http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr > >> ---> > >> 2012-08-13 08:58:39.189 java[74092:1203] Unable to load realm info from > >> SCDynamicStore > >> > >> > >> > http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout > >> ---> > >> > >> I have changed my hadoop-env.sh acoording to Mathew Buckett in > >> https://issues.apache.org/jira/browse/HADOOP-7489 > >> > >> Also this error of Unable to load realm info from SCDynamicStore does > not > >> show up when I do 'hadoop namenode -format' or 'start-all.sh' > >> > >> I am also attaching a zipped copy of my logs > >> > >> > >> Cheers, > >> > >> Subho. > >> > >> > > > > > > -- > Harsh J > --20cf307ac14d7bfbc004c7240e5d Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello Harsh,
I tried setting it. But it doesnt seem to help.
=
There is also something else that I found out....
=
The link=A0
works and actually returns me the error,=A0however
gives me a 403 error.

My IP on the LAN is=A01= 0.1.66.17. Could this be the problem?



On Mon, Aug 13, 2012 at 2:47 PM, Harsh J = <harsh@cloudera.com> wrote:
Subho,

Can you try to tweak the "mapred.task.tracker.http.address" in mapred-site.xml, and set it to always bind to localhost? (i.e. set it
to "localhost:50060", instead of default "0.0.0.0:50060") and then see
if you get this behavior?

On Mon, Aug 13, 2012 at 12:37 PM, Subho Banerjee <subs.zero@gmail.com> wrote:
> Yes I did that already as I had mentioned in my previous mail, yet I a= m
> having the problem.
>
> I was just trying something, and I came across some really weird behav= iour,
> the moment I disconnect from my local network(unplug my LAN cable) and= try
> to run this, it works just fine. But when I am connected to my network= , it
> gives me the error I listed above.
>
>
> On Mon, Aug 13, 2012 at 11:11 AM, Devaraj k <devaraj.k@huawei.com> wrote:
>>
>> Can you go through this issue
>> https://issues.apache.org/jira/browse/HADOOP-7489, It is = discussed and
>> provided some workarounds for this problem.
>>
>>
>>
>>
>>
>> Thanks
>>
>> Devaraj
>>
>> ________________________________
>> From: Subho Banerjee [subs.= zero@gmail.com]
>> Sent: Monday, August 13, 2012 10:47 AM
>> To: user@hadoop.apache.o= rg
>> Subject: Hadoop in Pseudo-Distributed
>>
>> Hello,
>>
>> I am running hadoop v1.0.3 in Mac OS X 10.8 with Java_1.6.0_33-b03= -424
>>
>>
>> When running hadoop on pseudo-distributed mode, the map seems to w= ork, but
>> it cannot compute the reduce.
>>
>> 12/08/13 08:58:12 INFO mapred.JobClient: Running job:
>> job_201208130857_0001
>> 12/08/13 08:58:13 INFO mapred.JobClient: map 0% reduce 0%
>> 12/08/13 08:58:27 INFO mapred.JobClient: map 20% reduce 0%
>> 12/08/13 08:58:33 INFO mapred.JobClient: map 30% reduce 0%
>> 12/08/13 08:58:36 INFO mapred.JobClient: map 40% reduce 0%
>> 12/08/13 08:58:39 INFO mapred.JobClient: map 50% reduce 0%
>> 12/08/13 08:58:42 INFO mapred.JobClient: map 60% reduce 0%
>> 12/08/13 08:58:45 INFO mapred.JobClient: map 70% reduce 0%
>> 12/08/13 08:58:48 INFO mapred.JobClient: map 80% reduce 0%
>> 12/08/13 08:58:51 INFO mapred.JobClient: map 90% reduce 0%
>> 12/08/13 08:58:54 INFO mapred.JobClient: map 100% reduce 0%
>> 12/08/13 08:59:14 INFO mapred.JobClient: Task Id :
>> attempt_201208130857_0001_m_000000_0, Status : FAILED
>> Too many fetch-failures
>> 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task output= Server
>> returned HTTP response code: 403 for URL:
>> http://10.1.66.17:50060/tasklog?plaintext=3Dtrue&attemptid= =3Dattempt_201208130857_0001_m_000000_0&filter=3Dstdout
>> 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task output= Server
>> returned HTTP response code: 403 for URL:
>> http://10.1.66.17:50060/tasklog?plaintext=3Dtrue&attemptid= =3Dattempt_201208130857_0001_m_000000_0&filter=3Dstderr
>> 12/08/13 08:59:18 INFO mapred.JobClient: map 89% reduce 0%
>> 12/08/13 08:59:21 INFO mapred.JobClient: map 100% reduce 0%
>> 12/08/13 09:00:14 INFO mapred.JobClient: Task Id :
>> attempt_201208130857_0001_m_000001_0, Status : FAILED
>> Too many fetch-failures
>>
>> Here is what I get when I try to see the tasklog using the links g= iven in
>> the output
>>
>>
>> http://10.1.66.17:50060/tasklog?plaintext=3Dtrue&attemptid= =3Dattempt_201208130857_0001_m_000000_0&filter=3Dstderr
>> --->
>> 2012-08-13 08:58:39.189 java[74092:1203] Unable to load realm info= from
>> SCDynamicStore
>>
>>
>> http://10.1.66.17:50060/tasklog?plaintext=3Dtrue&attemptid= =3Dattempt_201208130857_0001_m_000000_0&filter=3Dstdout
>> --->
>>
>> I have changed my hadoop-env.sh acoording to Mathew Buckett in
>> https://issues.apache.org/jira/browse/HADOOP-7489
>>
>> Also this error of Unable to load realm info from SCDynamicStore d= oes not
>> show up when I do 'hadoop namenode -format' or 'start-= all.sh'
>>
>> I am also attaching a zipped copy of my logs
>>
>>
>> Cheers,
>>
>> Subho.
>>
>>
>



--
Harsh J

--20cf307ac14d7bfbc004c7240e5d--