Return-Path: Delivered-To: apmail-incubator-chukwa-dev-archive@www.apache.org Received: (qmail 63098 invoked from network); 6 Jan 2011 18:46:08 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 6 Jan 2011 18:46:08 -0000 Received: (qmail 35297 invoked by uid 500); 6 Jan 2011 18:46:08 -0000 Delivered-To: apmail-incubator-chukwa-dev-archive@incubator.apache.org Received: (qmail 35144 invoked by uid 500); 6 Jan 2011 18:46:07 -0000 Mailing-List: contact chukwa-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: chukwa-dev@incubator.apache.org Delivered-To: mailing list chukwa-dev@incubator.apache.org Received: (qmail 34923 invoked by uid 99); 6 Jan 2011 18:46:07 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Jan 2011 18:46:07 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Jan 2011 18:46:07 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id p06IjlHQ026320 for ; Thu, 6 Jan 2011 18:45:47 GMT Message-ID: <18087270.194181294339547085.JavaMail.jira@thor> Date: Thu, 6 Jan 2011 13:45:47 -0500 (EST) From: "Ari Rabkin (JIRA)" To: chukwa-dev@incubator.apache.org Subject: [jira] Updated: (CHUKWA-575) Cluster Summarization script In-Reply-To: <12276268.89981293847245209.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CHUKWA-575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ari Rabkin updated CHUKWA-575: ------------------------------ Status: Open (was: Patch Available) CHUKWA-578 blocks this. > Cluster Summarization script > ---------------------------- > > Key: CHUKWA-575 > URL: https://issues.apache.org/jira/browse/CHUKWA-575 > Project: Chukwa > Issue Type: New Feature > Components: scripts > Environment: Java 6, Mac OS X 10.6 > Reporter: Eric Yang > Assignee: Eric Yang > Fix For: 0.5.0 > > Attachments: CHUKWA-575.patch > > > Chukwa record metrics from name node, data node, job tracker, task tracker, etc, but the raw metrics does not help determine all aspect of the cluster health. For now, we have the following metrics in HBase: > * System > * Disk > * Memory > * Network > * HDFS > * Name Node > * Data Node > * Map Reduce > * Job Tracker > * Task Tracker > We can further analyze the data to provide a summary for the cluster as these categories: > * System - Performance profile of how busy the nodes are in the cluster > * HDFS - Capacity of the disk storage, and health of the data in the file system > * MapReduce - Capacity of the processing pipeline, and health of the processing system -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.