hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Benoy Antony (JIRA)" <j...@apache.org>
Subject [jira] [Moved] (MAPREDUCE-4246) Failure in deleting user directories in Secure hadoop
Date Thu, 10 May 2012 22:24:48 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Benoy Antony moved HADOOP-8382 to MAPREDUCE-4246:
-------------------------------------------------

          Component/s:     (was: security)
                       security
        Fix Version/s:     (was: 0.22.1)
                       0.22.1
    Affects Version/s:     (was: 0.22.0)
                       0.22.0
                  Key: MAPREDUCE-4246  (was: HADOOP-8382)
              Project: Hadoop Map/Reduce  (was: Hadoop Common)
    
> Failure in deleting user directories in Secure hadoop
> -----------------------------------------------------
>
>                 Key: MAPREDUCE-4246
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4246
>             Project: Hadoop Map/Reduce
>          Issue Type: Task
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Benoy Antony
>            Assignee: Benoy Antony
>             Fix For: 0.22.1
>
>         Attachments: cleanup-user-dir.patch
>
>
> This happens when security is enabled on 22
> When TaskTracker starts p, it invokes MRAsyncDiskService moves the contents of scratch/tasktracker
to toBeDeleted under a directory created with the current timestamp.
> The owner of this directory is hadoop (owner of tasktracker)
> The contents of this directory are various usernames and they are owned by individual
users. But MRAsyncDiskService tries to delete the newly created directory as hadoop and it
fails.
> 2012-05-01 16:04:58,805 DEBUG org.apache.hadoop.mapred.LinuxTaskController: deleteAsUser:
[/apache/hadoop-assemble-argon-0.228/hadoop-0.22-argon-0.105/bin/../bin/task-controller, hadoop,
3, /hadoop00/scratch/toBeDeleted/2012-04-17_16-22-03.965_0]
> 2012-05-01 16:04:58,809 WARN org.apache.hadoop.mapreduce.util.MRAsyncDiskService: Failure
in deletion of toBeDeleted/2012-04-17_16-22-03.965_0 on /hadoop00/scratch with original name
/hadoop00/scratch/toBeDeleted/2012-04-17_16-22-03.965_0 with exception org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:256)
> at org.apache.hadoop.util.Shell.run(Shell.java:183)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:376)
> at org.apache.hadoop.mapred.LinuxTaskController.deleteAsUser(LinuxTaskController.java:273)
> at org.apache.hadoop.mapreduce.util.MRAsyncDiskService$DeleteTask.run(MRAsyncDiskService.java:237)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message