hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sanford Rockowitz <rockow...@minsoft.com>
Subject Re: exceptions copying files into HDFS
Date Sun, 12 Dec 2010 07:31:52 GMT
On 12/11/2010 10:48 PM, Varadharajan Mukundan wrote:
> Hi,
>
>> org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
>> /user/rock/input/fair-scheduler.xml could only be replicated to 0 nodes,
>> instead of 1
> I think none of your datanodes are actually running. why not use jps
> and make sure whether they are running. Also check the datanode logs
> in the nodes.
>


jps reports DataNode, NameNode, and SecondayNameNode as running:

rock@ritter:/tmp/hadoop-rock> jps
31177 Jps
29909 DataNode
29751 NameNode
30052 SecondaryNameNode
rock@ritter:/tmp/hadoop-rock>


Here is the contents of the Hadoop node tree.  The only thing that looks 
like a log file are the dncp_block_verification.log.curr files, and 
those are empty.
Note the presence of the in_use.lock files, which suggests that this 
node is indeed being used.



rock@ritter:/tmp/hadoop-rock> ls -lR
.:
total 4
drwxr-xr-x 5 rock users 4096 2010-12-11 10:12 dfs

./dfs:
total 12
drwxr-xr-x 6 rock users 4096 2010-12-11 21:02 data
drwxr-xr-x 5 rock users 4096 2010-12-11 21:02 name
drwxr-xr-x 4 rock users 4096 2010-12-11 23:08 namesecondary

./dfs/data:
total 20
drwxr-xr-x 2 rock users 4096 2010-12-11 10:12 blocksBeingWritten
drwxr-xr-x 2 rock users 4096 2010-12-11 10:12 current
drwxr-xr-x 2 rock users 4096 2010-12-11 10:12 detach
-rw-r--r-- 1 rock users    0 2010-12-11 21:02 in_use.lock
-rw-r--r-- 1 rock users  157 2010-12-11 10:12 storage
drwxr-xr-x 2 rock users 4096 2010-12-11 21:02 tmp

./dfs/data/blocksBeingWritten:
total 0

./dfs/data/current:
total 4
-rw-r--r-- 1 rock users   0 2010-12-11 10:12 
dncp_block_verification.log.curr
-rw-r--r-- 1 rock users 154 2010-12-11 21:02 VERSION

./dfs/data/detach:
total 0

./dfs/data/tmp:
total 0

./dfs/name:
total 12
drwxr-xr-x 2 rock users 4096 2010-12-11 23:08 current
drwxr-xr-x 2 rock users 4096 2010-12-11 10:12 image
-rw-r--r-- 1 rock users    0 2010-12-11 21:02 in_use.lock
drwxr-xr-x 2 rock users 4096 2010-12-11 20:17 previous.checkpoint

./dfs/name/current:
total 16
-rw-r--r-- 1 rock users   4 2010-12-11 23:08 edits
-rw-r--r-- 1 rock users 424 2010-12-11 23:08 fsimage
-rw-r--r-- 1 rock users   8 2010-12-11 23:08 fstime
-rw-r--r-- 1 rock users 100 2010-12-11 23:08 VERSION

./dfs/name/image:
total 4
-rw-r--r-- 1 rock users 157 2010-12-11 23:08 fsimage

./dfs/name/previous.checkpoint:
total 16
-rw-r--r-- 1 rock users   4 2010-12-11 20:17 edits
-rw-r--r-- 1 rock users 538 2010-12-11 20:17 fsimage
-rw-r--r-- 1 rock users   8 2010-12-11 20:17 fstime
-rw-r--r-- 1 rock users 100 2010-12-11 20:17 VERSION

./dfs/namesecondary:
total 8
drwxr-xr-x 2 rock users 4096 2010-12-11 23:08 current
drwxr-xr-x 2 rock users 4096 2010-12-11 10:17 image
-rw-r--r-- 1 rock users    0 2010-12-11 21:02 in_use.lock

./dfs/namesecondary/current:
total 16
-rw-r--r-- 1 rock users   4 2010-12-11 23:08 edits
-rw-r--r-- 1 rock users 424 2010-12-11 23:08 fsimage
-rw-r--r-- 1 rock users   8 2010-12-11 23:08 fstime
-rw-r--r-- 1 rock users 100 2010-12-11 23:08 VERSION

./dfs/namesecondary/image:
total 4
-rw-r--r-- 1 rock users 157 2010-12-11 23:08 fsimage
rock@ritter:/tmp/hadoop-rock>



Mime
View raw message