Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-issues@hadoop.apache.org
Date: Thu, 29 Mar 2012 13:48:28 +0000 (UTC)
From: "Thomas Graves (Commented) (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Message-ID: 
 <1892298726.32529.1333028908719.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <597495638.16453.1331765919657.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (MAPREDUCE-4012) Hadoop Job setup error leaves
 no useful info to users (when LinuxTaskController is used)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MAPREDUCE-4012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241233#comment-13241233 ] 

Thomas Graves commented on MAPREDUCE-4012:
------------------------------------------

sample output now:

12/03/29 13:41:48 INFO mapred.JobClient: Task Id : attempt_201203290251_0005_m_000002_0, Status : FAILED
Error initializing attempt_201203290251_0005_m_000002_0:
java.io.IOException: Job initialization failed (22) with output: Reading task controller config from /dir/conf/hadoop/taskcontroller.cfg
The configured tasktracker group 100 is different from the group of the executable 0
Invalid permissions on task-controller binary.

        at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:192)
        at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1228)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
        at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1203)
        at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1118)
        at org.apache.hadoop.mapred.TaskTracker$5.run(TaskTracker.java:2430)
        at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.hadoop.util.Shell$ExitCodeException:
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:255)
        at org.apache.hadoop.util.Shell.run(Shell.java:182)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:375)
        at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:185)
        ... 8 more
                
> Hadoop Job setup error leaves no useful info to users (when LinuxTaskController is used)
> ----------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4012
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4012
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0, 1.0.0
>            Reporter: Koji Noguchi
>            Assignee: Thomas Graves
>            Priority: Minor
>         Attachments: MAPREDUCE-4012-branch-1.patch, mapreduce-4012-1.patch
>
>
> When distributed cache pull fail on the TaskTracker, job webUI only shows 
> {noformat}
> Job initialization failed (255)
> {noformat}
> leaving users confused.  
> On the TaskTracker log, there is a log with useful info 
> {noformat}
> 2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: org.apache.hadoop.security.AccessControlException: org.apache.hadoop.security.AccessControlException: 
> Permission denied: user=user1, access=READ, inode="testfile":user3:users:rw-------
> ...
> 2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.filecache.TrackerDistributedCacheManager.downloadCacheObject(TrackerDistributedCacheManager.java:415)
> ...
> 2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.mapred.JobLocalizer.main(JobLocalizer.java:530)
> {noformat}
> 	

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira