hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5770) Exception hit in TestPersistBlocks
Date Mon, 15 Aug 2016 14:26:20 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15421045#comment-15421045
] 

Kihwal Lee commented on HDFS-5770:
----------------------------------

Saw this in a precommit build.
{noformat}
2016-08-12 23:40:13,900 [main] INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:waitActive(2543))
- Cluster is active
2016-08-12 23:40:13,901 [IPC Server handler 7 on 57494] INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(7028))
- allowed=true
	ugi=jenkins (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/data	dst=null	perm=null	proto=rpc
2016-08-12 23:40:13,906 [main] INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:shutdown(1907))
- Shutting down the Mini HDFS Cluster
2016-08-12 23:40:13,906 [main] ERROR hdfs.DFSClient (DFSClient.java:closeAllFilesBeingWritten(579))
- Failed to close file: /data with inode: 16386
java.io.EOFException: End of File Exception between local host is: "6fa8fece0684/172.17.0.3";
destination host is: "localhost":57494; : java.io.EOFException;
 For more details see:  http://wiki.apache.org/hadoop/EOFException
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:815)
	at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:779)
	at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1499)
	at org.apache.hadoop.ipc.Client.call(Client.java:1441)
	at org.apache.hadoop.ipc.Client.call(Client.java:1351)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:234)
	at com.sun.proxy.$Proxy19.addBlock(Unknown Source)
{noformat}
Compared to a successful run, only 4 blocks made to the edit log instead of 5. Then after
the NN restart, the test did {{getFileIno()}} and started shutting down the cluster without
writing more data or closing the file. It might have failed the assert, but don't see it in
the log.  The above exception seems to be generated during this shutdown.

> Exception hit in TestPersistBlocks
> ----------------------------------
>
>                 Key: HDFS-5770
>                 URL: https://issues.apache.org/jira/browse/HDFS-5770
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 3.0.0-alpha1
>            Reporter: Arpit Agarwal
>
> Hit the following exception in {{TestPersistBlocks}} after running a few hundred iterations
of the test in a loop.
> {code}
> java.io.IOException: Failed on local exception: java.io.EOFException; Host Details :
local host is: "Arpit-MB-Pro.local/192.168.0.103"; destination host is: "localhost":57470;
>         at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:764)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1410)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1359)
>         at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
>         at com.sun.proxy.$Proxy12.addBlock(Unknown Source)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:185)
>         at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:101)
>         at com.sun.proxy.$Proxy12.addBlock(Unknown Source)
>         at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:348)
>         at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1259)
>         at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1107)
>         at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:515)
> Caused by: java.io.EOFException: null
>         at java.io.DataInputStream.readInt(DataInputStream.java:375)
>         at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1050)
>         at org.apache.hadoop.ipc.Client$Connection.run(Client.java:945)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message