hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Francis.Hu <francis...@reachjunction.com>
Subject 答复: Hadoop HA error "JOURNAL is not supported in state standby"
Date Fri, 30 Aug 2013 07:42:25 GMT
Did you start up your ZKFC service on both of your name nodes ?

Thanks,
Francis.Hu

-----邮件原件-----
发件人: orahad bigdata [mailto:oraclehad@gmail.com] 
发送时间: Friday, August 30, 2013 4:09
收件人: user
主题: Hadoop HA error "JOURNAL is not supported in state standby"

Hi,

I'm facing an error while starting Hadoop in HA(2.0.5) cluster , both
the NameNode started in standby mode and not changing the state.

When I tried to do health check through  "hdfs haadmin -checkhealth
<service id> " it's giving me below error.

Failed on local exception:
com.google.protobuf.InvalidProtocolBufferException: Message missing
required fields: callId, status; Host Details : local host is:
"clone2/XX.XX.XX.XX"; destination host is: "clone1":8020;

 I checked the logs at NN side.

2013-08-30 00:49:16,074 ERROR
org.apache.hadoop.security.UserGroupInformation:
PriviledgedActionException as:hadoop (auth:SIMPLE)
cause:org.apache.hadoop.ipc.StandbyException: Operation category
JOURNAL is not supported in state standby
2013-08-30 00:49:16,074 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 8020, call
org.apache.hadoop.hdfs.server.protocol.NamenodeProtocol.rollEditLog
from 192.168.126.31:48266: error:
org.apache.hadoop.ipc.StandbyException: Operation category JOURNAL is
not supported in state standby
2013-08-30 00:49:32,391 INFO
org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering
log roll on remote NameNode clone2:8020
2013-08-30 00:49:32,403 WARN
org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Unable to
trigger a roll of the active NN
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException
):
Operation category JOURNAL is not supported in state standby
	at
org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(Standb
yState.java:87)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOpera
tion(NameNode.java:1411)
	at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesys
tem.java:859)
	at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.rollEditLog(FSNamesystem
.java:4445)
	at
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.rollEditLog(NameNod
eRpcServer.java:766)
	at
org.apache.hadoop.hdfs.protocolPB.NamenodeProtocolServerSideTranslatorPB.rol
lEditLog(NamenodeProtocolServerSideTranslatorPB.java:139)
	at
org.apache.hadoop.hdfs.protocol.proto.NamenodeProtocolProtos$NamenodeProtoco
lService$2.callBlockingMethod(NamenodeProtocolProtos.java:8758)
	at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(Proto
bufRpcEngine.java:454)
	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1014)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1741)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1737)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
va:1478)
	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1735)

	at org.apache.hadoop.ipc.Client.call(Client.java:1235)
	at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.jav
a:202)
	at $Proxy11.rollEditLog(Unknown Source)
	at
org.apache.hadoop.hdfs.protocolPB.NamenodeProtocolTranslatorPB.rollEditLog(N
amenodeProtocolTranslatorPB.java:139)
	at
org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.triggerActiveLogRoll
(EditLogTailer.java:268)
	at
org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.access$600(EditLogTa
iler.java:61)
	at
org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.
doWork(EditLogTailer.java:310)
	at
org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.
access$200(EditLogTailer.java:279)
	at
org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$
1.run(EditLogTailer.java:296)
	at
org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.ja
va:456)
	at
org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.
run(EditLogTailer.java:292)

Did I missed something?

Thanks


Mime
View raw message