hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Joseph Evans (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2495) The distributed cache cleanup thread has no monitoring to check to see if it has died for some reason
Date Thu, 19 May 2011 14:17:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13036206#comment-13036206
] 

Robert Joseph Evans commented on MAPREDUCE-2495:
------------------------------------------------

OK, Will have an updated patch shortly.  But just to clarify.  You want the code to look like

} catch (InterruptedException e) {
    LOG.info("Cleanup...",e);
    //To force us to exit cleanly
    running = false;
}

> The distributed cache cleanup thread has no monitoring to check to see if it has died
for some reason
> -----------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2495
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2495
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: distributed-cache
>    Affects Versions: 0.21.0
>            Reporter: Robert Joseph Evans
>            Assignee: Robert Joseph Evans
>            Priority: Minor
>         Attachments: MAPREDUCE-2495-20.20X-V1.patch, MAPREDUCE-2495-20.20X-V2.patch,
MAPREDUCE-2495-v1.patch, MAPREDUCE-2495-v2.patch
>
>
> The cleanup thread in the distributed cache handles IOExceptions and the like correctly,
but just to be a bit more defensive it would be good to monitor the thread, and check that
it is still alive regularly, so that the distributed cache does not fill up the entire disk
on the node. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message