hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sunlisheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15893) fs.TrashPolicyDefault: can't create trash directory and race condition
Date Fri, 02 Nov 2018 09:39:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16672822#comment-16672822
] 

sunlisheng commented on HADOOP-15893:
-------------------------------------

 [~hadoopqa] [~raviprak] [~jzhuge]

 hi, please help me answser the question.

Two test unit errors have nothing to do with my changes.

when I do test unit once,  test unit succeed.

when I do test unit 100 times, test fail 3~5 times.

the error log:

java.lang.IllegalStateException: failed to create a child event loop

at io.netty.util.concurrent.MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.java:68)
 at io.netty.channel.MultithreadEventLoopGroup.<init>(MultithreadEventLoopGroup.java:50)
 at io.netty.channel.nio.NioEventLoopGroup.<init>(NioEventLoopGroup.java:70)
 at io.netty.channel.nio.NioEventLoopGroup.<init>(NioEventLoopGroup.java:65)
 at io.netty.channel.nio.NioEventLoopGroup.<init>(NioEventLoopGroup.java:56)
 at io.netty.channel.nio.NioEventLoopGroup.<init>(NioEventLoopGroup.java:48)
 at io.netty.channel.nio.NioEventLoopGroup.<init>(NioEventLoopGroup.java:40)
 at org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer.<init>(DatanodeHttpServer.java:148)
 at org.apache.hadoop.hdfs.server.datanode.DataNode.startInfoServer(DataNode.java:957)
 at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1417)
 at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:500)
 at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2782)
 at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2690)
 at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1695)
 at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:911)
 at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:518)
 at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:477)
 at org.apache.hadoop.hdfs.TestReconstructStripedFile.testNNSendsErasureCodingTasks(TestReconstructStripedFile.java:474)
 at org.apache.hadoop.hdfs.TestReconstructStripedFile.testNNSendsErasureCodingTasks(TestReconstructStripedFile.java:457)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:498)
 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
 at java.util.concurrent.FutureTask.run(FutureTask.java:266)
 at java.lang.Thread.run(Thread.java:748)
Caused by: io.netty.channel.ChannelException: failed to open a new selector
 at io.netty.channel.nio.NioEventLoop.openSelector(NioEventLoop.java:176)
 at io.netty.channel.nio.NioEventLoop.<init>(NioEventLoop.java:150)
 at io.netty.channel.nio.NioEventLoopGroup.newChild(NioEventLoopGroup.java:103)
 at io.netty.util.concurrent.MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.java:64)
 ... 30 more
Caused by: java.io.IOException: 打开的文件过多
 at sun.nio.ch.IOUtil.makePipe(Native Method)
 at sun.nio.ch.EPollSelectorImpl.<init>(EPollSelectorImpl.java:65)
 at sun.nio.ch.EPollSelectorProvider.openSelector(EPollSelectorProvider.java:36)
 at io.netty.channel.nio.NioEventLoop.openSelector(NioEventLoop.java:174)
 ... 33 more

> fs.TrashPolicyDefault: can't create trash directory and race condition
> ----------------------------------------------------------------------
>
>                 Key: HADOOP-15893
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15893
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: common
>            Reporter: sunlisheng
>            Priority: Major
>         Attachments: HADOOP-15893.001.patch, HADOOP-15893.002.patch
>
>
> After catch FileAlreadyExistsException, the  same name file is deleted.
> So don't modify baseTrashPath when existsFilePath is deleted.
> But this case show hardly in untitest.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message