hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Freeman <mrff...@gmail.com>
Subject TaskTracker: exception thrown when changing perms fails - hadoop on Windows
Date Sun, 08 Jan 2012 18:23:07 GMT
To Whom It May Concern:

I am running:

 haddop version 0.20.203.0 (downloaded from http://hadoop.apache.org/common/
)
Java version 1.7.0_02
Cygwin and ssh

on a Windows XP OS.

Overall the problems I have seen in the log files involve unexpected
directory permission settings of: rwxrwxrwxt when rwxr-xr-x was expected.
In all but the TaskTracker, I was able to solve this problem manually
simply by executing chmod -R 755. In the case of the TaskTracker, although
I manually changed the permissions, when I run start-mapred.sh, it
apparently is recreating this part of the directory tree with the
rwxrwxrwxt perms, then programatically attempting to change the permissions
to 755. An exception is thrown (please see the log file contents below)
when this attempt is made.


I'm at a loss currently on how to rectify this. Note, I'm just beginning
with hadoop and do not have really any background. I'm working my way
through Tom White's, "Hadoop The Definitve Guide".

Thanks,
Mike Freeman

P.S. I should mention that my other log files are now error-free (after my
manually changing permissions) and I am able to run hadoop commands from
the cygwin command line.



2012-01-07 14:42:15,046 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
loaded properties from hadoop-metrics2.properties
2012-01-07 14:42:15,203 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-01-07 14:42:15,218 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-01-07 14:42:15,218 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-01-07 14:42:15,656 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
registered.
2012-01-07 14:42:15,656 WARN
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
exists!
2012-01-07 14:42:15,859 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-01-07 14:42:15,984 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-01-07 14:42:16,031 INFO org.apache.hadoop.mapred.TaskLogsTruncater:
Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-01-07 14:42:16,031 INFO org.apache.hadoop.mapred.TaskTracker: Starting
tasktracker with owner as SYSTEM
2012-01-07 14:42:16,046 ERROR org.apache.hadoop.mapred.TaskTracker: Can not
start task tracker because java.io.IOException: Failed to set permissions
of path: /tmp/hadoop-SYSTEM/mapred/local/taskTracker to 0755
at
org.apache.hadoop.fs.RawLocalFileSystem.checkReturnValue(RawLocalFileSystem.java:525)
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:507)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183)
at org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:630)
at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1328)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3430)

2012-01-07 14:42:16,046 INFO org.apache.hadoop.mapred.TaskTracker:
SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker
************************************************************/

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message