hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "pavel kolodin" <pavelkolodinhad...@gmail.com>
Subject hardware servers != VPSs
Date Thu, 03 Dec 2009 16:09:20 GMT


0) I am running hadoop-0.20.1.
1) Running only dfs (formatting, then "hadoop-0.20.1/bin/start-dfs.sh")
2) When i try to use 1 laptop with os linux + running VirtualBox on it  
with the same linux gentoo in VirtualBox, all fine.
3) When i try to use 2 VPS on 16 cpu intel xenon 64bit hardware with the  
same gentoo (or close to mine) OS, i am getting a mess with permissions.  
For example:

hadoop@hadoopmaster ~ $ hadoop-0.20.1/bin/hadoop fs -put  
/tmp/idata/logogenPY_1259491560 /
put: org.apache.hadoop.security.AccessControlException: Permission denied:  
user=DrWho, access=WRITE, inode="":hadoop:hadoop:rwxr-xr-x
hadoop@hadoopmaster ~ $

This put command gives this message in namenode's logfile:
http://pastebin.com/m7b9e10df

Namenode's logfile contains this messages at startup:
http://pastebin.com/m72398acb

4) I am sure, that hadoop's java processes running as 'hadoop', user  
exists, group exists etc. I am running as 'hadoop' all the processes  
(commands).

hadoop@hadoopmaster ~ $ id
uid=1000(hadoop) gid=1003(hadoop) groups=1003(hadoop)
hadoop@hadoopmaster ~ $

5) After starting i can see this:

hadoopmaster ~ # netstat -natp | grep LIST | grep java
tcp6       0      0 :::33657                :::*                     
LISTEN     22038/java
tcp6       0      0 :::50010                :::*                     
LISTEN     22038/java
tcp6       0      0 :::50075                :::*                     
LISTEN     22038/java
tcp6       0      0 :::37186                :::*                     
LISTEN     21916/java
tcp6       0      0 :::50020                :::*                     
LISTEN     22038/java
tcp6       0      0 10.10.10.1:9000         :::*                     
LISTEN     21916/java
tcp6       0      0 :::40681                :::*                     
LISTEN     22152/java
tcp6       0      0 :::50090                :::*                     
LISTEN     22152/java
tcp6       0      0 :::50070                :::*                     
LISTEN     21916/java
hadoopmaster ~ #

----------
Thank you.
----------

Mime
View raw message