hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5357) Job staging directory owner checking could fail on Windows
Date Wed, 03 Jul 2013 05:28:20 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698622#comment-13698622
] 

Hudson commented on MAPREDUCE-5357:
-----------------------------------

Integrated in Hadoop-trunk-Commit #4038 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/4038/])
    MAPREDUCE-5357. Job staging directory owner checking could fail on Windows. (Revision
1499210)

     Result = SUCCESS
cnauroth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1499210
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmissionFiles.java

                
> Job staging directory owner checking could fail on Windows
> ----------------------------------------------------------
>
>                 Key: MAPREDUCE-5357
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5357
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 3.0.0, 2.1.0-beta
>            Reporter: Chuan Liu
>            Assignee: Chuan Liu
>            Priority: Minor
>         Attachments: MAPREDUCE-5357-trunk.patch
>
>
> In {{JobSubmissionFiles.getStagingDir()}}, we have following code that will throw exception
if the directory owner is not the current user.
> {code:java}
>       String owner = fsStatus.getOwner();
>       if (!(owner.equals(currentUser) || owner.equals(realUser))) {
>          throw new IOException("The ownership on the staging directory " +
>                       stagingArea + " is not as expected. " +
>                       "It is owned by " + owner + ". The directory must " +
>                       "be owned by the submitter " + currentUser + " or " +
>                       "by " + realUser);
>       }
> {code}
> This check will fail on Windows when the underlying file system is LocalFileSystem. Because
on Windows, the default file or directory owner could be "Administrators" group if the user
belongs to "Administrators" group.
> Quite a few MR unit tests that runs MR mini cluster with localFs as underlying file system
fail because of this.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message