hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Gummadi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2761) New TaskController code doesn't run on Windows
Date Tue, 02 Aug 2011 10:30:27 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13076122#comment-13076122
] 

Ravi Gummadi commented on MAPREDUCE-2761:
-----------------------------------------

Here is the Exception message there in TT logs:


011-07-21 09:55:56,194 INFO org.apache.hadoop.mapred.LinuxTaskController: Output from LinuxTaskController's
launchTaskJVM follows:
2011-07-21 09:55:56,194 INFO org.apache.hadoop.mapred.LinuxTaskController: main : command
provided 3
2011-07-21 09:55:56,194 INFO org.apache.hadoop.mapred.LinuxTaskController: main : user is
user1
2011-07-21 09:55:56,194 INFO org.apache.hadoop.mapred.LinuxTaskController: run_process_as_user
launching a JVM for task :attempt
_201107210950_0001_m_000017_2.
2011-07-21 09:55:56,194 WARN org.apache.hadoop.mapred.LinuxTaskController: Output from task-contoller
is :
2011-07-21 09:55:56,195 WARN org.apache.hadoop.mapred.LinuxTaskController: Exception thrown
while sending kill to the Task VM {noformat}java.io.IOException: java.lang.NullPointerException
        at org.apache.hadoop.mapred.LinuxTaskController.signalTask(LinuxTaskController.java:615)
        at org.apache.hadoop.mapred.LinuxTaskController.terminateTask(LinuxTaskController.java:622)
        at org.apache.hadoop.mapred.TaskController.destroyTaskJVM(TaskController.java:154)
        at org.apache.hadoop.mapred.JvmManager$JvmManagerForType$JvmRunner.kill(JvmManager.java:522)
        at org.apache.hadoop.mapred.JvmManager$JvmManagerForType$JvmRunner.runChild(JvmManager.java:480)
        at org.apache.hadoop.mapred.JvmManager$JvmManagerForType$JvmRunner.run(JvmManager.java:462)
Caused by: java.lang.NullPointerException
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:442)
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:206)
        at org.apache.hadoop.util.Shell.run(Shell.java:188)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:381)
        at org.apache.hadoop.mapred.LinuxTaskController.signalTask(LinuxTaskController.java:612)
        ... 5 more{noformat}

> New TaskController code doesn't run on Windows
> ----------------------------------------------
>
>                 Key: MAPREDUCE-2761
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2761
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: task-controller, tasktracker
>    Affects Versions: 0.20.204.0, 0.23.0
>            Reporter: Todd Lipcon
>
> After MAPREDUCE-2178, TaskController assumes that pids are always available. The shell
executor object that's used to launch a JVM isn't retained, but rather the pid is set when
the task heartbeats. On Windows, there are no pids, and since the ShellCommandExecutor object
is no longer around, we can't call process.destroy(). So, the TaskController doesn't work
on Cygwin anymore.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message