Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of write2kishore@gmail.com
 designates 209.85.223.173 as permitted sender)
MIME-Version: 1.0
Date: Mon, 6 May 2013 14:27:50 +0530
Message-ID: 
 <CAHg+sbPp1-1P3eOvi7grp0CzSHHTUpkjfJo0UyXuaMfhsXpcAA@mail.gmail.com>
Subject: Namenode going to safe mode on YARN
From: Krishna Kishore Bonagiri <write2kishore@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=bcaec51b1c7336260904dc08e5d1

--bcaec51b1c7336260904dc08e5d1
Content-Type: text/plain; charset=ISO-8859-1

Hi,

  I have been running application on my YARN cluster since around 20 days,
about 5000 applications a day. I am getting the following error today.
Please let me know how can I avoid this, is this happening because of a bug?

org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException):
Cannot create file/1066/AppMaster.jar. Name node is in safe mode.
The reported blocks 4775 needs additional 880 blocks to reach the threshold
0.9990 of total blocks 5660. Safe mode will be turned off automatically.
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal(FSNamesystem.java:1786)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.java:1737)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:1719)
        at
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:429)
        at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:271)
        at
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:40732)
        at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:454)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1014)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1741)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1737)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1478)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1735)


Thanks,
Kishore

--bcaec51b1c7336260904dc08e5d1
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi,=A0<div><br><div style>=A0 I have been running applicat=
ion on my YARN cluster since around 20 days, about 5000 applications a day.=
 I am getting the following error today. Please let me know how can I avoid=
 this, is this happening because of a bug?</div>
<div style><br></div><div style><div>org.apache.hadoop.ipc.RemoteException(=
org.apache.hadoop.hdfs.server.namenode.SafeModeException): Cannot create fi=
le/1066/AppMaster.jar. Name node is in safe mode.</div><div>The reported bl=
ocks 4775 needs additional 880 blocks to reach the threshold 0.9990 of tota=
l blocks 5660. Safe mode will be turned off automatically.</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem=
.startFileInternal(FSNamesystem.java:1786)</div><div>=A0 =A0 =A0 =A0 at org=
.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.=
java:1737)</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem=
.startFile(FSNamesystem.java:1719)</div><div>=A0 =A0 =A0 =A0 at org.apache.=
hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java=
:429)</div><div>
=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocol=
ServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.=
java:271)</div><div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.protocol.prot=
o.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(=
ClientNamenodeProtocolProtos.java:40732)</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$Prot=
oBufRpcInvoker.call(ProtobufRpcEngine.java:454)</div><div>=A0 =A0 =A0 =A0 a=
t org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1014)</div><div>=A0 =A0 =
=A0 =A0 at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1741)</di=
v>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.ipc.Server$Handler$1.run(Server.j=
ava:1737)</div><div>=A0 =A0 =A0 =A0 at java.security.AccessController.doPri=
vileged(Native Method)</div><div>=A0 =A0 =A0 =A0 at javax.security.auth.Sub=
ject.doAs(Subject.java:415)</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.security.UserGroupInformation.doA=
s(UserGroupInformation.java:1478)</div><div>=A0 =A0 =A0 =A0 at org.apache.h=
adoop.ipc.Server$Handler.run(Server.java:1735)</div><div><br></div><div><br=
></div><div style>
Thanks,</div><div style>Kishore</div></div></div></div>

--bcaec51b1c7336260904dc08e5d1--