hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adarsh Sharma <adarsh.sha...@orkash.com>
Subject Stuck with the Issue : No Lock Available
Date Tue, 18 Jan 2011 09:51:23 GMT
Dear all,

I am facing a serious problem when running a Hadoop Cluster in Cloud.

I configure a Standalone Machine as ( Namenode, Jobtracker ).

I configure 3 VM's to act as Datanode/Tasktrackers.

The data dirs of datanodes are the hard disks path of the standalone 
machines on which the VM  resides. First we mount the paths to these 
VM's  and then start datanode, tasktracker them.

The problem arises in one VM as its datanode logs says :

STARTUP_MSG:   build = 
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 
911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
************************************************************/
2011-01-18 13:21:40,418 INFO 
org.apache.hadoop.hdfs.server.common.Storage: java.io.IOException: No 
locks available
        at sun.nio.ch.FileChannelImpl.lock0(Native Method)
        at sun.nio.ch.FileChannelImpl.tryLock(FileChannelImpl.java:881)
        at java.nio.channels.FileChannel.tryLock(FileChannel.java:962)
        at 
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.tryLock(Storage.java:527)
        at 
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.lock(Storage.java:505)
        at 
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.analyzeStorage(Storage.java:363)
        at 
org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:112)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:298)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:216)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1283)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1238)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1246)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1368)

2011-01-18 13:21:40,420 ERROR 
org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: No 
locks available
        at sun.nio.ch.FileChannelImpl.lock0(Native Method)
        at sun.nio.ch.FileChannelImpl.tryLock(FileChannelImpl.java:881)
        at java.nio.channels.FileChannel.tryLock(FileChannel.java:962)
        at 
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.tryLock(Storage.java:527)
        at 
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.lock(Storage.java:505)
        at 
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.analyzeStorage(Storage.java:363)
        at 
org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:112)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:298)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:216)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1283)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1238)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1246)
        at 
org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1368)

2011-01-18 13:21:40,421 INFO 
org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
                                                                                         
                 
144,1         98%

It fails to create directories ( current, detach, storage, version, 
in_use.lock ) in data folder of that VM.

If someone know the reason or anything about this issue, Please be kind 
to suggest.

I find it difficult because I followed the same steps in the other 2 
VM's and they are running

Thanks & Regards

Adarsh Sharma

Mime
View raw message