hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karam Singh (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2847) [HOD] Idle cluster cleanup does not work if the JobTracker becomes unresponsive to RPC calls
Date Fri, 07 Mar 2008 10:17:46 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12576114#action_12576114
] 

Karam Singh commented on HADOOP-2847:
-------------------------------------

To check this issue did the following -:
1. Sent SIGSTOP to JobTracker and checked that cluster is cleanup after idle timeout limit
2. Sent SIGTERM to JobTracker and checked that cluster is cleanup after idle timeout limit
3. Allocated cluster. First ran randomwriter with block size=512 KB and then ran sort to make
large number of maps. When Jobtracker started giving RPC time out exception, checked that
cluster is being cleaned up


> [HOD] Idle cluster cleanup does not work if the JobTracker becomes unresponsive to RPC
calls
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-2847
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2847
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/hod
>    Affects Versions: 0.16.0
>            Reporter: Hemanth Yamijala
>            Assignee: Hemanth Yamijala
>            Priority: Blocker
>             Fix For: 0.16.1
>
>         Attachments: hadoop-2847
>
>
> In some erroneous conditions, the Hadoop JobTracker becomes unresponsive to RPC calls
(for e.g. if a misconfiguration causes the JobTracker to run out of memory). In such cases,
a cluster allocated by HOD no longer runs any jobs and is wastefully holding up nodes. The
usual idle cluster cleaner should deallocate the cluster ideally, but it does not.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message