hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Weili Shao (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-8089) cannot submit job from Eclipse plugin running on Windows
Date Sat, 18 Feb 2012 18:17:59 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13211041#comment-13211041
] 

Weili Shao commented on HADOOP-8089:
------------------------------------

I think I found the reason at high level, after I put a return to avoid that permission setting,
the job started with a localjobrunner and the result was written to the remote hdfs, which
confused me for a while, since I had no knowledge of localjobrunner before. Now I realize
that it's really that the JobClient wasn't initiated properly from the plugin xml conf, so
without any mapred.job.tracker settings, it just started the localjobrunner. After I added
the code:
    Configuration conf = new Configuration();
    conf.set("mapred.job.tracker", "[server]:9001");

It's working now. However. This configuration should be loaded from plugin's server configuration
and it used to be working.
                
> cannot submit job from Eclipse plugin running on Windows
> --------------------------------------------------------
>
>                 Key: HADOOP-8089
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8089
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: contrib/eclipse-plugin
>    Affects Versions: 1.0.0
>         Environment: Windows XP
>            Reporter: Weili Shao
>
> Built eclipse plugin for 1.0.0 on Windows and using it to submit a job, I got the following
error:
> 12/02/17 17:14:24 ERROR security.UserGroupInformation: PriviledgedActionException as:weilis
cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-weilis\mapred\staging\weilis753422487\.staging
to 0700
> Exception in thread "main" java.io.IOException: Failed to set permissions of path: \tmp\hadoop-weilis\mapred\staging\weilis753422487\.staging
to 0700
> 	at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:682)
> 	at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:655)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> 	at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> 	at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
> 	at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
> 	at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
> 	at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
> 	at org.apache.hadoop.mapreduce.Job.submit(Job.java:465)
> 	at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:495)
> The job staging area local on Windows system and I don't think there is a way to set
a local file's permission to 0700 anyway. Please have a look.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message