hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2495) The distributed cache cleanup thread has no monitoring to check to see if it has died for some reason
Date Wed, 25 May 2011 02:48:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13038938#comment-13038938
] 

Hudson commented on MAPREDUCE-2495:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #698 (See [https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/698/])
    MAPREDUCE-2495. exit() the TaskTracker when the distributed cache cleanup
thread dies. Contributed by Robert Joseph Evans

cdouglas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1127361
Files : 
* /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapreduce/filecache/TrackerDistributedCacheManager.java
* /hadoop/mapreduce/trunk/CHANGES.txt
* /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapreduce/filecache/TestTrackerDistributedCacheManager.java


> The distributed cache cleanup thread has no monitoring to check to see if it has died
for some reason
> -----------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2495
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2495
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: distributed-cache
>    Affects Versions: 0.21.0
>            Reporter: Robert Joseph Evans
>            Assignee: Robert Joseph Evans
>            Priority: Minor
>             Fix For: 0.20.205.0, 0.23.0
>
>         Attachments: MAPREDUCE-2495-20.20X-V1.patch, MAPREDUCE-2495-20.20X-V2.patch,
MAPREDUCE-2495-20.20X-V3.patch, MAPREDUCE-2495-20.20X-V4.patch, MAPREDUCE-2495-v1.patch, MAPREDUCE-2495-v2.patch,
MAPREDUCE-2495-v3.patch, MAPREDUCE-2495-v4.patch
>
>
> The cleanup thread in the distributed cache handles IOExceptions and the like correctly,
but just to be a bit more defensive it would be good to monitor the thread, and check that
it is still alive regularly, so that the distributed cache does not fill up the entire disk
on the node. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message