hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2495) The distributed cache cleanup thread has no monitoring to check to see if it has died for some reason
Date Wed, 18 May 2011 23:16:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035844#comment-13035844
] 

Owen O'Malley commented on MAPREDUCE-2495:
------------------------------------------

This looks good, except that you shouldn't do a shutdown for interruptedexception. Those are
*only* thrown when another thread is trying to do a clean shutdown. Just log the exception
as info and exit nicely.

> The distributed cache cleanup thread has no monitoring to check to see if it has died
for some reason
> -----------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2495
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2495
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: distributed-cache
>    Affects Versions: 0.21.0
>            Reporter: Robert Joseph Evans
>            Assignee: Robert Joseph Evans
>            Priority: Minor
>         Attachments: MAPREDUCE-2495-20.20X-V1.patch, MAPREDUCE-2495-20.20X-V2.patch,
MAPREDUCE-2495-v1.patch, MAPREDUCE-2495-v2.patch
>
>
> The cleanup thread in the distributed cache handles IOExceptions and the like correctly,
but just to be a bit more defensive it would be good to monitor the thread, and check that
it is still alive regularly, so that the distributed cache does not fill up the entire disk
on the node. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message