chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <>
Subject [jira] Created: (CHUKWA-575) Cluster Summarization script
Date Sat, 01 Jan 2011 02:00:45 GMT
Cluster Summarization script

                 Key: CHUKWA-575
             Project: Chukwa
          Issue Type: New Feature
          Components: scripts
         Environment: Java 6, Mac OS X 10.6
            Reporter: Eric Yang
            Assignee: Eric Yang
             Fix For: 0.5.0

 Chukwa record metrics from name node, data node, job tracker, task tracker, etc, but the
raw metrics does not help determine all aspect of the cluster health.  For now, we have the
following metrics in HBase:

 * System
 *   Disk
 *   Memory
 *   Network
 *   Name Node
 *   Data Node
 * Map Reduce
 *   Job Tracker
 *   Task Tracker

We can further analyze the data to provide a summary for the cluster as these categories:

 * System - Performance profile of how busy the nodes are in the cluster
 * HDFS - Capacity of the disk storage, and health of the data in the file system
 * MapReduce - Capacity of the processing pipeline, and health of the processing system

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message