Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A7C50E9AC for ; Wed, 6 Mar 2013 11:19:29 +0000 (UTC) Received: (qmail 56868 invoked by uid 500); 6 Mar 2013 11:19:24 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 56178 invoked by uid 500); 6 Mar 2013 11:19:17 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 56150 invoked by uid 99); 6 Mar 2013 11:19:16 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Mar 2013 11:19:16 +0000 X-ASF-Spam-Status: No, hits=-2.8 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_HI,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [81.252.56.12] (HELO airbus-sf4.airbus.gmessaging.net) (81.252.56.12) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Mar 2013 11:19:08 +0000 Received: from airbus-sf4.airbus.gmessaging.net (localhost.localdomain [127.0.0.1]) by localhost.airbus.gmessaging.net (Postfix) with SMTP id D3383164C588 for ; Wed, 6 Mar 2013 12:18:46 +0100 (CET) Received: from de0-mailhub-p04.res.airbus.corp (unknown [44.225.0.150]) by airbus-sf4.airbus.gmessaging.net (Postfix) with ESMTP id 8175C164C58F for ; Wed, 6 Mar 2013 12:18:46 +0100 (CET) Received: from DE0-MAILMBX-P21.res.airbus.corp ([44.225.3.150]) by de0-mailhub-p04.res.airbus.corp ([44.225.0.150]) with mapi; Wed, 6 Mar 2013 12:18:46 +0100 From: "AMARNATH, Balachandar" To: "user@hadoop.apache.org" Date: Wed, 6 Mar 2013 12:18:43 +0100 Subject: RE: store file gives exception Thread-Topic: store file gives exception Thread-Index: Ac4aUTOd4M1ut4x/QjK0XSalfck2NwACx61g Message-ID: <1569_1362568726_51372616_1569_5976_1_E6472BD072676843ADB8D37E50F4C88D0BF8656D8A@DE0-MAILMBX-P21.res.airbus.corp> References: <1569_1362563932_5137135C_1569_1450_1_E6472BD072676843ADB8D37E50F4C88D0BF8656C28@DE0-MAILMBX-P21.res.airbus.corp> In-Reply-To: <1569_1362563932_5137135C_1569_1450_1_E6472BD072676843ADB8D37E50F4C88D0BF8656C28@DE0-MAILMBX-P21.res.airbus.corp> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_E6472BD072676843ADB8D37E50F4C88D0BF8656D8ADE0MAILMBXP21_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_E6472BD072676843ADB8D37E50F4C88D0BF8656D8ADE0MAILMBXP21_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, I could successfully install hadoop cluster with three nodes (2 datanodes a= nd 1 namenode). However, when I tried to store a file, I get the following = error. 13/03/06 16:45:56 WARN hdfs.DFSClient: Error Recovery for block null bad da= tanode[0] nodes =3D=3D null 13/03/06 16:45:56 WARN hdfs.DFSClient: Could not get block locations. Sourc= e file "/user/bala/kumki/hosts" - Aborting... put: java.io.IOException: File /user/bala/kumki/hosts could only be replica= ted to 0 nodes, instead of 1 13/03/06 16:45:56 ERROR hdfs.DFSClient: Exception closing file /user/bala/k= umki/hosts : org.apache.hadoop.ipc.RemoteException: java.io.IOException: Fi= le /user/bala/kumki/hosts could only be replicated to 0 nodes, instead of 1 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAddit= ionalBlock(FSNamesystem.java:1558) at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(Nam= eNode.java:696) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAcce= ssorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe= thodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGro= upInformation.java:1121) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382) Any hint to fix this, Regards Bala From: AMARNATH, Balachandar [mailto:BALACHANDAR.AMARNATH@airbus.com] Sent: 06 March 2013 15:29 To: user@hadoop.apache.org Subject: store file gives exception Now I came out of the safe mode through admin command. I tried to put a fil= e into hdfs and encountered this error. org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /user/hado= op/hosts could only be replicated to 0 nodes, instead of 1 Any hint to fix this, This happens when the namenode is not datanode. Am I making sense? With thanks and regards Balachandar The information in this e-mail is confidential. The contents may not be dis= closed or used by anyone other than the addressee. Access to this e-mail by= anyone else is unauthorised. If you are not the intended recipient, please notify Airbus immediately and= delete this e-mail. Airbus cannot accept any responsibility for the accuracy or completeness of= this e-mail as it has been sent over public networks. If you have any conc= erns over the content of this message or its Accuracy or Integrity, please = contact Airbus immediately. All outgoing e-mails from Airbus are checked using regularly updated virus = scanning software but you should take whatever measures you deem to be appr= opriate to ensure that this message and any attachments are virus free. The information in this e-mail is confidential. The contents may not be dis= closed or used by anyone other than the addressee. Access to this e-mail by= anyone else is unauthorised. If you are not the intended recipient, please notify Airbus immediately and= delete this e-mail. Airbus cannot accept any responsibility for the accuracy or completeness of= this e-mail as it has been sent over public networks. If you have any conc= erns over the content of this message or its Accuracy or Integrity, please = contact Airbus immediately. All outgoing e-mails from Airbus are checked using regularly updated virus = scanning software but you should take whatever measures you deem to be appr= opriate to ensure that this message and any attachments are virus free. --_000_E6472BD072676843ADB8D37E50F4C88D0BF8656D8ADE0MAILMBXP21_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi,

 

I could successfully install hadoop cluster with three nodes (2 datan= odes and 1 namenode). However, when I tried to store a file, I get the foll= owing error.

 

<= p class=3DMsoNormal>13/03/06 16:45:56 WARN hdfs.DFSClient: Error Recovery for block = null bad datanode[0] nodes =3D=3D null

13/= 03/06 16:45:56 WARN hdfs.DFSClient: Could not get block locations. Source f= ile "/user/bala/kumki/hosts" - Aborting...

<= p class=3DMsoNormal>put: java.io.IOException: File /user/bala/kumki/hosts could only= be replicated to 0 nodes, instead of 1

13= /03/06 16:45:56 ERROR hdfs.DFSClient: Exception closing file /user/bala/kum= ki/hosts : org.apache.hadoop.ipc.RemoteException: java.io.IOException: File= /user/bala/kumki/hosts could only be replicated to 0 nodes, instead of 1

       &= nbsp;    at org.apache.hadoop.hdfs.server.namenode.FSNamesys= tem.getAdditionalBlock(FSNamesystem.java:1558)

            at = org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:696)=

       = ;     at sun.reflect.NativeMethodAccessorImpl.invoke0(N= ative Method)

    &nbs= p;       at sun.reflect.NativeMethodAccessorI= mpl.invoke(NativeMethodAccessorImpl.java:39)

            at s= un.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl= .java:25)

     &n= bsp;      at java.lang.reflect.Method.invoke(Metho= d.java:597)

     =        at org.apache.hadoop.ipc.RPC$Server.ca= ll(RPC.java:563)

    &= nbsp;       at org.apache.hadoop.ipc.Server$H= andler$1.run(Server.java:1388)

  = ;          at org.apache.hadoo= p.ipc.Server$Handler$1.run(Server.java:1384)

            at j= ava.security.AccessController.doPrivileged(Native Method)=

          = ;  at javax.security.auth.Subject.doAs(Subject.java:396)

         &= nbsp;  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGro= upInformation.java:1121)

   = ;         at org.apache.hadoop.ipc.= Server$Handler.run(Server.java:1382)

 

Any hint to fi= x this,

 

 

Regards

Bala

From: AMARNATH, Balachandar [mailto:BALACH= ANDAR.AMARNATH@airbus.com]
Sent: 06 March 2013 15:29
To: user@hadoop.apache.org
Subject: store file gives exception

 

Now= I came out of the safe mode through admin command. I tried to put a file i= nto hdfs and encountered this error.

 

<= p class=3DMsoNormal style=3D'margin-left:36.0pt'>org.apache.hadoop.ipc.RemoteExcepti= on: java.io.IOException: File /user/hadoop/hosts could only be replicated t= o 0 nodes, instead of 1

 

Any hint to fix this,

 

=

This happens when the n= amenode is not datanode. Am I making sense?

 

With thanks and regards=

Bala= chandar

 

 

 

The information in this e-mail is confidential. The contents may no=
t be disclosed or used by anyone other than the addressee. Access to this e=
-mail by anyone else is unauthorised.
If you are not the intended recipient, please notify Airbus im=
mediately and delete this e-mail.
Airbus cannot accept any responsibility for the accuracy or comple=
teness of this e-mail as it has been sent over public networks. If you have=
 any concerns over the content of this message or its Accuracy or Integrity=
, please contact Airbus immediately.
All outgoing e-mails from Airbus are checked using regularly up=
dated virus scanning software but you should take whatever measures you dee=
m to be appropriate to ensure that this message and any attachments are vir=
us free.
The information in this e-mail is confi=
dential. The contents may not be disclosed or used by anyone other than the=
 addressee. Access to this e-mail by anyone else is unauthorised.
If you are not the intended recipient, please notify Airbus immediately and=
 delete this e-mail.
Airbus cannot accept any responsibility for the accuracy or completeness of=
 this e-mail as it has been sent over public networks. If you have any conc=
erns over the content of this message or its Accuracy or Integrity, please =
contact Airbus immediately.
All outgoing e-mails from Airbus are checked using regularly updated virus =
scanning software but you should take whatever measures you deem to be appr=
opriate to ensure that this message and any attachments are virus free.
= --_000_E6472BD072676843ADB8D37E50F4C88D0BF8656D8ADE0MAILMBXP21_--