Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 69299 invoked from network); 7 Jan 2009 08:07:11 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 7 Jan 2009 08:07:11 -0000 Received: (qmail 42529 invoked by uid 500); 7 Jan 2009 08:07:08 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 42374 invoked by uid 500); 7 Jan 2009 08:07:07 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 42363 invoked by uid 99); 7 Jan 2009 08:07:07 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Jan 2009 00:07:07 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Jan 2009 08:07:05 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 501D4234C46D for ; Wed, 7 Jan 2009 00:06:44 -0800 (PST) Message-ID: <483668578.1231315604317.JavaMail.jira@brutus> Date: Wed, 7 Jan 2009 00:06:44 -0800 (PST) From: "Peeyush Bishnoi (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Updated: (HADOOP-4937) [HOD] Include ringmaster RPC port information in the notes attribute In-Reply-To: <2137415645.1230093886266.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peeyush Bishnoi updated HADOOP-4937: ------------------------------------ Attachment: hadoop-4937-2.txt > [HOD] Include ringmaster RPC port information in the notes attribute > -------------------------------------------------------------------- > > Key: HADOOP-4937 > URL: https://issues.apache.org/jira/browse/HADOOP-4937 > Project: Hadoop Core > Issue Type: New Feature > Components: contrib/hod > Reporter: Hemanth Yamijala > Assignee: Peeyush Bishnoi > Attachments: hadoop-4937-1.txt, hadoop-4937-2.txt, hadoop-4937.txt > > > In large cluster deployments, due to node failures, it sometimes happens that HOD clusters get allocated, but not deallocated even after the idleness limit of the cluster (the time for which no jobs are run) exceeds. One of the main reasons for this is the ringmaster process which is responsible for tracking and cleaning an idle cluster (of which it is a part) itself goes down. To handle such scenarios it makes sense to centrally track the ringmaster nodes for suspicious clusters. But since the information about which port the ringmaster is bound to is not centrally available, this becomes impossible to monitor. > This issue is an enhancement request to include ringmaster RPC port information along with the JT and NN info as part of the resource manager's notes attribute so that it can be used by any monitoring processes built around it. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.