hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (MAPREDUCE-4246) Failure in deleting user directories in Secure hadoop
Date Tue, 05 Jun 2012 07:41:24 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Konstantin Shvachko resolved MAPREDUCE-4246.
--------------------------------------------

          Resolution: Fixed
    Target Version/s: 0.22.1
        Hadoop Flags: Reviewed

+1
I just committed this to branch 0.22.1. Thank you Benoy.
                
> Failure in deleting user directories in Secure hadoop
> -----------------------------------------------------
>
>                 Key: MAPREDUCE-4246
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4246
>             Project: Hadoop Map/Reduce
>          Issue Type: Task
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Benoy Antony
>            Assignee: Benoy Antony
>             Fix For: 0.22.1
>
>         Attachments: cleanup-user-dir.patch
>
>
> This happens when security is enabled on 22
> When TaskTracker starts p, it invokes MRAsyncDiskService moves the contents of scratch/tasktracker
to toBeDeleted under a directory created with the current timestamp.
> The owner of this directory is hadoop (owner of tasktracker)
> The contents of this directory are various usernames and they are owned by individual
users. But MRAsyncDiskService tries to delete the newly created directory as hadoop and it
fails.
> 2012-05-01 16:04:58,805 DEBUG org.apache.hadoop.mapred.LinuxTaskController: deleteAsUser:
[/apache/hadoop-assemble-argon-0.228/hadoop-0.22-argon-0.105/bin/../bin/task-controller, hadoop,
3, /hadoop00/scratch/toBeDeleted/2012-04-17_16-22-03.965_0]
> 2012-05-01 16:04:58,809 WARN org.apache.hadoop.mapreduce.util.MRAsyncDiskService: Failure
in deletion of toBeDeleted/2012-04-17_16-22-03.965_0 on /hadoop00/scratch with original name
/hadoop00/scratch/toBeDeleted/2012-04-17_16-22-03.965_0 with exception org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:256)
> at org.apache.hadoop.util.Shell.run(Shell.java:183)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:376)
> at org.apache.hadoop.mapred.LinuxTaskController.deleteAsUser(LinuxTaskController.java:273)
> at org.apache.hadoop.mapreduce.util.MRAsyncDiskService$DeleteTask.run(MRAsyncDiskService.java:237)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message