Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 385F5C833 for ; Mon, 13 Aug 2012 07:08:31 +0000 (UTC) Received: (qmail 29688 invoked by uid 500); 13 Aug 2012 07:08:26 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 28838 invoked by uid 500); 13 Aug 2012 07:08:19 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 28806 invoked by uid 99); 13 Aug 2012 07:08:18 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Aug 2012 07:08:18 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of subs.zero@gmail.com designates 209.85.220.176 as permitted sender) Received: from [209.85.220.176] (HELO mail-vc0-f176.google.com) (209.85.220.176) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Aug 2012 07:08:12 +0000 Received: by vcbfl11 with SMTP id fl11so3955201vcb.35 for ; Mon, 13 Aug 2012 00:07:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=3R1iuZve5zycCRxp8eJY9hs8ck0xKSbVihvd1xd468M=; b=RDl/5W0AySo5jTliChSTAX7iOpPF1eiYS1MPZLoNh3Cp6BMEJdqfZNpDnpAEVyYAKZ EdsXaoVtRVDBZ8AI+dzskZMfjVrr8H3mg08xC7VpcnXQ3m7oR+EOnVpGcPc9JsOolP2o xTzCmuvVZYmNOuK0qoupTqn026vY1Zt81O/jdhNl419Yh9YDf9HN3BHxBK45hQ98lFzE Khz5T7wbN5+si8uASIShEDdBax71QAB9aTbYkeYs/7WToozNVfePN/ZuSNIQspCCCtoV GwZRoQ9XA4AqJxw8ur2amCoQsvTcWhqbdXPfqqx3uAIwTIjGNJJJRUhvzTSwymFopFuH 1f3g== Received: by 10.220.149.79 with SMTP id s15mr7523290vcv.71.1344841672059; Mon, 13 Aug 2012 00:07:52 -0700 (PDT) MIME-Version: 1.0 Received: by 10.58.245.202 with HTTP; Mon, 13 Aug 2012 00:07:31 -0700 (PDT) In-Reply-To: <06006DDA5A27D541991944AC4117E7A95AA4B52A@szxeml524-mbx.china.huawei.com> References: <06006DDA5A27D541991944AC4117E7A95AA4B52A@szxeml524-mbx.china.huawei.com> From: Subho Banerjee Date: Mon, 13 Aug 2012 12:37:31 +0530 Message-ID: Subject: Re: Hadoop in Pseudo-Distributed To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=f46d043894ad246c7404c7205a6e X-Virus-Checked: Checked by ClamAV on apache.org --f46d043894ad246c7404c7205a6e Content-Type: text/plain; charset=ISO-8859-1 Yes I did that already as I had mentioned in my previous mail, yet I am having the problem. I was just trying something, and I came across some really weird behaviour, the moment I disconnect from my local network(unplug my LAN cable) and try to run this, it works just fine. But when I am connected to my network, it gives me the error I listed above. On Mon, Aug 13, 2012 at 11:11 AM, Devaraj k wrote: > Can you go through this issue > https://issues.apache.org/jira/browse/HADOOP-7489, It is discussed and > provided some workarounds for this problem. > > > > > > Thanks > > Devaraj > ------------------------------ > *From:* Subho Banerjee [subs.zero@gmail.com] > *Sent:* Monday, August 13, 2012 10:47 AM > *To:* user@hadoop.apache.org > *Subject:* Hadoop in Pseudo-Distributed > > Hello, > > I am running hadoop v1.0.3 in Mac OS X 10.8 with Java_1.6.0_33-b03-424 > > > When running hadoop on pseudo-distributed mode, the map seems to work, > but it cannot compute the reduce. > > 12/08/13 08:58:12 INFO mapred.JobClient: Running job: job_201208130857_0001 > 12/08/13 08:58:13 INFO mapred.JobClient: map 0% reduce 0% > 12/08/13 08:58:27 INFO mapred.JobClient: map 20% reduce 0% > 12/08/13 08:58:33 INFO mapred.JobClient: map 30% reduce 0% > 12/08/13 08:58:36 INFO mapred.JobClient: map 40% reduce 0% > 12/08/13 08:58:39 INFO mapred.JobClient: map 50% reduce 0% > 12/08/13 08:58:42 INFO mapred.JobClient: map 60% reduce 0% > 12/08/13 08:58:45 INFO mapred.JobClient: map 70% reduce 0% > 12/08/13 08:58:48 INFO mapred.JobClient: map 80% reduce 0% > 12/08/13 08:58:51 INFO mapred.JobClient: map 90% reduce 0% > 12/08/13 08:58:54 INFO mapred.JobClient: map 100% reduce 0% > 12/08/13 08:59:14 INFO mapred.JobClient: Task Id : > attempt_201208130857_0001_m_000000_0, Status : FAILED > Too many fetch-failures > 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer > returned HTTP response code: 403 for URL: > http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout > 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer > returned HTTP response code: 403 for URL: > http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr > 12/08/13 08:59:18 INFO mapred.JobClient: map 89% reduce 0% > 12/08/13 08:59:21 INFO mapred.JobClient: map 100% reduce 0% > 12/08/13 09:00:14 INFO mapred.JobClient: Task Id : > attempt_201208130857_0001_m_000001_0, Status : FAILED > Too many fetch-failures > > Here is what I get when I try to see the tasklog using the links given in > the output > > > http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr > ---> > 2012-08-13 08:58:39.189 java[74092:1203] Unable to load realm info from > SCDynamicStore > > > http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout > ---> > > I have changed my hadoop-env.sh acoording to Mathew Buckett in > https://issues.apache.org/jira/browse/HADOOP-7489 > > Also this error of Unable to load realm info from SCDynamicStore does not > show up when I do 'hadoop namenode -format' or 'start-all.sh' > > I am also attaching a zipped copy of my logs > > > Cheers, > > Subho. > > --f46d043894ad246c7404c7205a6e Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Yes I did that already as I had mentioned in my previous mail, yet I am hav= ing the problem.

I was just trying something, and I= came across some really weird=A0behaviour, the moment I disconnect from my= local network(unplug my LAN cable) and try to run this, it works just fine= . But when I am connected to my network, it gives me the error I listed abo= ve.


On Mon, Aug 1= 3, 2012 at 11:11 AM, Devaraj k <devaraj.k@huawei.com> wro= te:

Can you go through this issue https://issues.apache.org/jira/browse/HADOOP-7489, It is discussed and = provided some workarounds for this problem.

=A0

=A0

Thanks

Devaraj

Fro= m: Subho Banerjee [subs.zero@gmail.com]
Sent: Monday, August 13, 2012 10:47 AM
To: user= @hadoop.apache.org
Subject: Hadoop in Pseudo-Distributed

Hello,

I am running hadoop v1.0.3 in Mac OS X 10.8 with Java_1.6.0_33-b03-424


When running hadoop on pseudo-distributed mode, the map seems to work, but = it cannot compute the reduce.

12/08/13 08:58:12 INFO mapred.JobClient: Running job: job_201208130857_0001=
12/08/13 08:58:13 INFO mapred.JobClient: map 0% reduce 0%
12/08/13 08:58:27 INFO mapred.JobClient: map 20% reduce 0%
12/08/13 08:58:33 INFO mapred.JobClient: map 30% reduce 0%
12/08/13 08:58:36 INFO mapred.JobClient: map 40% reduce 0%
12/08/13 08:58:39 INFO mapred.JobClient: map 50% reduce 0%
12/08/13 08:58:42 INFO mapred.JobClient: map 60% reduce 0%
12/08/13 08:58:45 INFO mapred.JobClient: map 70% reduce 0%
12/08/13 08:58:48 INFO mapred.JobClient: map 80% reduce 0%
12/08/13 08:58:51 INFO mapred.JobClient: map 90% reduce 0%
12/08/13 08:58:54 INFO mapred.JobClient: map 100% reduce 0%
12/08/13 08:59:14 INFO mapred.JobClient: Task Id : attempt_201208130857_000= 1_m_000000_0, Status : FAILED
Too many fetch-failures
12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer re= turned HTTP response code: 403 for URL:=A0http://10.1.66.17:50060/tasklog?plaintext=3Dtrue&= attemptid=3Dattempt_201208130857_0001_m_000000_0&filter=3Dstdout 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer re= turned HTTP response code: 403 for URL:=A0http://10.1.66.17:50060/tasklog?plaintext=3Dtrue&= attemptid=3Dattempt_201208130857_0001_m_000000_0&filter=3Dstderr 12/08/13 08:59:18 INFO mapred.JobClient: map 89% reduce 0%
12/08/13 08:59:21 INFO mapred.JobClient: map 100% reduce 0%
12/08/13 09:00:14 INFO mapred.JobClient: Task Id : attempt_201208130857_000= 1_m_000001_0, Status : FAILED
Too many fetch-failures

Here is what I get when I try to see the tasklog using the links given in t= he output

http://10.1.66.17:50= 060/tasklog?plaintext=3Dtrue&attemptid=3Dattempt_201208130857_0001_m_00= 0000_0&filter=3Dstderr=A0--->
2012-08-13 08:58:39.189 java[74092:1203]=A0Unable to load real= m info from SCDynamicStore

http://10.1.66.17:50= 060/tasklog?plaintext=3Dtrue&attemptid=3Dattempt_201208130857_0001_m_00= 0000_0&filter=3Dstdout=A0--->

I have changed my hadoop-env.sh acoording to Mathew Buckett in=A0https://issues.apache.org= /jira/browse/HADOOP-7489

Also this error of Unable to load realm info from SCDynamicStore does not s= how up when I do 'hadoop namenode -format' or 'start-all.sh'= ;

I am also attaching a zipped copy of my logs


Cheers,

Subho.



--f46d043894ad246c7404c7205a6e--