hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Koji Noguchi (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4012) Hadoop Job setup error leaves no useful info to users (when LinuxTaskController is used)
Date Wed, 14 Mar 2012 23:04:39 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13229733#comment-13229733
] 

Koji Noguchi commented on MAPREDUCE-4012:
-----------------------------------------

Full log.
On the webUI
{noformat}
Error initializing attempt_201202130706_49976_m_000004_0:
java.io.IOException: Job initialization failed (255)
	at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:192)
	at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1201)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1082)
	at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1176)
	at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1091)
	at org.apache.hadoop.mapred.TaskTracker$5.run(TaskTracker.java:2360)
	at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.hadoop.util.Shell$ExitCodeException: 
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:255)
	at org.apache.hadoop.util.Shell.run(Shell.java:182)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:375)
	at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:185)
	... 8 more
{noformat}


On the tasktracker log

{noformat}
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: org.apache.hadoop.security.AccessControlException:
org.apache.hadoop.security.AccessControlException: Permission denied: user=user1, access=READ,
inode="testfile":user2:users:rw-------
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:57)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.hdfs.DFSClient.callGetBlockLocations(DFSClient.java:441)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.hdfs.DFSClient.access$400(DFSClient.java:74)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1683)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1676)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:479)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:154)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:427)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:228)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:163)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1173)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1154)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.filecache.TrackerDistributedCacheManager.downloadCacheObject(TrackerDistributedCacheManager.java:415)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.mapred.JobLocalizer.downloadPrivateCacheObjects(JobLocalizer.java:324)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.mapred.JobLocalizer.downloadPrivateCache(JobLocalizer.java:349)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.mapred.JobLocalizer.localizeJobFiles(JobLocalizer.java:383)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.mapred.JobLocalizer.runSetup(JobLocalizer.java:477)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.mapred.JobLocalizer$3.run(JobLocalizer.java:534)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.mapred.JobLocalizer$3.run(JobLocalizer.java:531)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at java.security.AccessController.doPrivileged(Native
Method)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at javax.security.auth.Subject.doAs(Subject.java:396)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1082)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.mapred.JobLocalizer.main(JobLocalizer.java:530)
{noformat}
                
> Hadoop Job setup error leaves no useful info to users (when LinuxTaskController is used)
> ----------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4012
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4012
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0, 1.0.0
>            Reporter: Koji Noguchi
>            Priority: Minor
>
> When distributed cache pull fail on the TaskTracker, job webUI only shows 
> {noformat}
> Job initialization failed (255)
> {noformat}
> leaving users confused.  
> On the TaskTracker log, there is a log with useful info 
> {noformat}
> 2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: org.apache.hadoop.security.AccessControlException:
org.apache.hadoop.security.AccessControlException: 
> Permission denied: user=user1, access=READ, inode="testfile":user3:users:rw-------
> ...
> 2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.filecache.TrackerDistributedCacheManager.downloadCacheObject(TrackerDistributedCacheManager.java:415)
> ...
> 2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.mapred.JobLocalizer.main(JobLocalizer.java:530)
> {noformat}
> 	

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message