hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Priyo Mustafi (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-1410) Task-Cleanup attempt cannot be given KillTaskAction if the main attempt is killed with a KillTaskAction
Date Fri, 11 Feb 2011 02:19:57 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Priyo Mustafi updated MAPREDUCE-1410:
-------------------------------------

    Status: Open  (was: Patch Available)

My latest patch is not working so deleting.  The earlier patch rebased by Doug Cutting applies
fine but fails with the below error.  Not sure if that is the expected behaviour now.  Any
help appreciated.

Testcase: testWithDFS took 240.679 sec
        Caused an ERROR
File /home/pmustafi/git/hadoop-mapreduce/build/test/logs/userlogs/job_20110210181140136_0004/attempt_20110210181140136_0004_m_000000_0/log.index
does not exist.
java.io.FileNotFoundException: File /home/pmustafi/git/hadoop-mapreduce/build/test/logs/userlogs/job_20110210181140136_0004/attempt_20110210181140136_0004_m_000000_0/log.index
does not exist.
        at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:446)
        at org.apache.hadoop.io.SecureIOUtils.openForRead(SecureIOUtils.java:105)
        at org.apache.hadoop.mapred.TaskLog.getLogFileDetail(TaskLog.java:106)
        at org.apache.hadoop.mapred.TaskLog.access$100(TaskLog.java:58)
        at org.apache.hadoop.mapred.TaskLog$Reader.<init>(TaskLog.java:301)
        at org.apache.hadoop.mapreduce.MapReduceTestUtil.readTaskLog(MapReduceTestUtil.java:443)
        at org.apache.hadoop.mapred.TestTaskFail.validateAttempt(TestTaskFail.java:166)
        at org.apache.hadoop.mapred.TestTaskFail.testKillMapperAndKillTaskCleanup(TestTaskFail.java:269)
        at org.apache.hadoop.mapred.TestTaskFail.testWithDFS(TestTaskFail.java:307)


> Task-Cleanup attempt cannot be given KillTaskAction if the main attempt is killed with
a KillTaskAction
> -------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1410
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1410
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker
>    Affects Versions: 0.20.1
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Amareshwari Sriramadasu
>         Attachments: MAPREDUCE-1410.patch, patch-1410.txt
>
>
> If the main attempt is killed with a KillTaskAction and is added to tasksReportedClosed,
then the cleanup-attempt for the task (with same id) can not be given a KillTaskAction, since
tasksReportedClosed already contains the attemptID.  
> The attemptID should be removed from  tasksReportedClosed in incompleteSubTask() method.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message