hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Datanode doesn't start but there is no exception in the log
Date Fri, 13 May 2011 17:45:14 GMT
Hey,

2011/5/13 Panayotis Antonopoulos <antonopoulospan@hotmail.com>:
> "899599744@qtp-1416044437-1 - Acceptor0 SelectChannelConnector@0.0.0.0:50075" prio=10
tid=0x00007f50f8414800 nid=0x1926 runnable [0x00007f50f6eb1000]
>   java.lang.Thread.State: RUNNABLE
>    at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>    at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
>    at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
>    at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
>    - locked <0x00000000ec473870> (a sun.nio.ch.Util$2)
>    - locked <0x00000000ec473860> (a java.util.Collections$UnmodifiableSet)
>    - locked <0x00000000ec4733c8> (a sun.nio.ch.EPollSelectorImpl)
>    at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
>    at org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498)
>    at org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192)
>    at org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124)
>    at org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708)
>    at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

and,

> "1620640756@qtp-1416044437-0" prio=10 tid=0x00007f50f83f0800 nid=0x1925 in Object.wait()
[0x00007f50f75eb000]
>   java.lang.Thread.State: TIMED_WAITING (on object monitor)
>    at java.lang.Object.wait(Native Method)
>    - waiting on <0x00000000ec473a88> (a org.mortbay.thread.QueuedThreadPool$PoolThread)
>    at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)
>    - locked <0x00000000ec473a88> (a org.mortbay.thread.QueuedThreadPool$PoolThread)

and,

> "main" prio=10 tid=0x0000000040115000 nid=0x18d2 runnable [0x00007f5101d2e000]
>   java.lang.Thread.State: RUNNABLE
>    at java.io.FileInputStream.readBytes(Native Method)
>    at java.io.FileInputStream.read(FileInputStream.java:220)
>    at sun.security.provider.SeedGenerator$URLSeedGenerator.getSeedBytes(SeedGenerator.java:493)
>    at sun.security.provider.SeedGenerator.generateSeed(SeedGenerator.java:117)
>    at sun.security.provider.SecureRandom.engineGenerateSeed(SecureRandom.java:114)
>    at sun.security.provider.SecureRandom.engineNextBytes(SecureRandom.java:171)
>    - locked <0x00000000eb430cc0> (a sun.security.provider.SecureRandom)
>    at java.security.SecureRandom.nextBytes(SecureRandom.java:433)
>    - locked <0x00000000eb430f60> (a java.security.SecureRandom)
>    at java.security.SecureRandom.next(SecureRandom.java:455)
>    at java.util.Random.nextInt(Random.java:257)
>    at org.apache.hadoop.hdfs.server.datanode.DataNode.setNewStorageID(DataNode.java:608)
>    at org.apache.hadoop.hdfs.server.datanode.DataNode.register(DataNode.java:629)
>    at org.apache.hadoop.hdfs.server.datanode.DataNode.runDatanodeDaemon(DataNode.java:1378)
>    at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1438)
>    at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1563)
>    at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1573)

lead me to believe that you're running into this:
http://search-hadoop.com/m/7Giae6vLWR1/securerandom&subj=Re+Entropy+Pool+and+HDFS+FS+Commands+Hanging+System

Just give it some time and it should start up soon (you may generate
some other activity on the DN to help it get some fresh entropy).
Sometimes it may take up to a minute at start up.

-- 
Harsh J

Mime
View raw message