hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-1607) Task controller may not set permissions for a task cleanup attempt's log directory
Date Thu, 18 Mar 2010 12:01:28 GMT
Task controller may not set permissions for a task cleanup attempt's log directory
----------------------------------------------------------------------------------

                 Key: MAPREDUCE-1607
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1607
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: task-controller
            Reporter: Hemanth Yamijala


Task controller uses the INITIALIZE_TASK command to initialize task attempt and task log directories.
For cleanup tasks, task attempt directories are named as task-attempt-id.cleanup. But log
directories do not have the .cleanup suffix. The task controller is not aware of this distinction
and tries to set permissions for log directories named task-attempt-id.cleanup. This is a
NO-OP. Typically the task cleanup runs on the same node that ran the original task attempt
as well. So, the task log directories are already properly initialized. However, the task
cleanup can run on a node that has not run the original task attempt. In that case, the initialization
would not happen and this could result in the cleanup task failing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message