hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jkupferman <jkupfer...@umail.ucsb.edu>
Subject Hadoop LoginException when running mapred
Date Thu, 14 Aug 2008 06:27:48 GMT

When I try to run a simple ls on the DFS I get a LoginException, I noticed
however that this only occurs when map reduce is running. If the DFS is
running by itself it works fine (I can ls and cat files), no errors, but
when I start map reduce the error happens. 

Here is the trace:
hadoop@comp:~$ hadoop dfs -ls /
08/08/13 23:08:34 WARN fs.FileSystem: uri=hdfs://localhost:54310
javax.security.auth.login.LoginException: Login failed: java.io.IOException:
Cannot allocate memory
	at
org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
	at
org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:275)
	at
org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:257)
	at
org.apache.hadoop.security.UserGroupInformation.login(UserGroupInformation.java:67)
	at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1353)
	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1289)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:203)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:108)
	at org.apache.hadoop.fs.FsShell.init(FsShell.java:87)
	at org.apache.hadoop.fs.FsShell.run(FsShell.java:1717)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
	at org.apache.hadoop.fs.FsShell.main(FsShell.java:1866)
Bad connection to FS. command aborted.

Here is an example of what happens:
hadoop@comp:~$ start-dfs.sh 
starting namenode, logging to
/home/hadoop/hadoop/bin/../logs/hadoop-hadoop-namenode-comp.out
localhost: starting datanode, logging to
/home/hadoop/hadoop/bin/../logs/hadoop-hadoop-datanode-comp.out
hadolocalhost: starting secondarynamenode, logging to
/home/hadoop/hadoop/bin/../logs/hadoop-hadoop-secondarynamenode-comp.out
op dfs -hadoop@comp:~$ hadoop dfs -copyFromLocal test /test
hadoop@comp:~$ hadoop dfs -cat /test
THIS FILE IS ON THE DFS - IT WORKS
hadoop@comp:~$ start-mapred.sh 
starting jobtracker, logging to
/home/hadoop/hadoop/bin/../logs/hadoop-hadoop-jobtracker-comp.out
localhost: starting tasktracker, logging to
/home/hadoop/hadoop/bin/../logs/hadoop-hadoop-tasktracker-comp.out
hadoop@comp:~$ hadoop dfs -cat /test
08/08/13 23:26:43 WARN fs.FileSystem: uri=hdfs://localhost:54310
javax.security.auth.login.LoginException: Login failed: java.io.IOException:
Cannot allocate memory
	at
org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
	at
org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:275)
	at
org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:257)
	at
org.apache.hadoop.security.UserGroupInformation.login(UserGroupInformation.java:67)
	at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1353)
	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1289)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:203)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:108)
	at org.apache.hadoop.fs.FsShell.init(FsShell.java:87)
	at org.apache.hadoop.fs.FsShell.run(FsShell.java:1717)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
	at org.apache.hadoop.fs.FsShell.main(FsShell.java:1866)
Bad connection to FS. command aborted.

I tried to see if it was an issue with 'whoami' but whoami displays the
correct name and there is only one binary.

Your help is appreciated


-- 
View this message in context: http://www.nabble.com/Hadoop--LoginException-when-running-mapred-tp18976319p18976319.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.


Mime
View raw message