hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Benoy Antony (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5589) MapReduce Job setup error leaves no useful info to users (when LinuxTaskController is used)
Date Thu, 17 Oct 2013 17:45:44 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Benoy Antony updated MAPREDUCE-5589:
------------------------------------

    Attachment: MAPREDUCE-5368.patch

Patch for branch-1

> MapReduce Job setup error leaves no useful info to users  (when LinuxTaskController is
used)
> --------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5589
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5589
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv1
>    Affects Versions: 1.2.1
>         Environment: I found that a significant portion of the main() in JobLocalizer
will not have its output displayed in the tasklogs.
> Before fix :
> Error initializing attempt_201310122204_0002_m_000002_0:
> java.io.IOException: Job initialization failed (1) with output: Reading task controller
config from /etc/hadoop/taskcontroller.cfg
> main : command provided 0
> main : user is bantony
> Good mapred-local-dirs are /hadoop12/scratch,/hadoop04/scratch,/hadoop09/scratch,/hadoop03/scratch,/hadoop05/scratch,/hadoop01/scratch,/hadoop11/scratch,/hadoop10/scratch,/hadoop08/scratch,/hadoop06/scratch,/hadoop07/scratch,/hadoop02/scratch
> 	at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:193)
> 	at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1340)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
> 	at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1315)
> 	at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1230)
> 	at org.apache.hadoop.mapred.TaskTracker$5.run(TaskTracker.java:2641)
> 	at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.hadoop.util.Shell$ExitCodeException: 
> 	at org.apache.hadoop.util.Shell.runCommand(Shell.java:255)
> 	at org.apache.hadoop.util.Shell.run(Shell.java:182)
> 	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:375)
> 	at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:186)
> 	... 8 more
>            Reporter: Benoy Antony
>            Assignee: Benoy Antony
>             Fix For: 1.3.0
>
>         Attachments: MAPREDUCE-5368.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message