Return-Path: Delivered-To: apmail-hadoop-core-commits-archive@www.apache.org Received: (qmail 7213 invoked from network); 10 Apr 2009 18:36:40 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 10 Apr 2009 18:36:40 -0000 Received: (qmail 76069 invoked by uid 500); 10 Apr 2009 18:36:40 -0000 Delivered-To: apmail-hadoop-core-commits-archive@hadoop.apache.org Received: (qmail 75992 invoked by uid 500); 10 Apr 2009 18:36:40 -0000 Mailing-List: contact core-commits-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-commits@hadoop.apache.org Received: (qmail 75980 invoked by uid 99); 10 Apr 2009 18:36:40 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Apr 2009 18:36:40 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [192.87.106.226] (HELO aurora.apache.org) (192.87.106.226) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Apr 2009 18:36:39 +0000 Received: from aurora.apache.org (localhost [127.0.0.1]) by aurora.apache.org (8.13.8+Sun/8.13.8) with ESMTP id n3AIaGl1001535 for ; Fri, 10 Apr 2009 18:36:18 GMT Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: Apache Wiki To: core-commits@hadoop.apache.org Date: Fri, 10 Apr 2009 18:36:16 -0000 Message-ID: <20090410183616.1455.62745@aurora.apache.org> Subject: [Hadoop Wiki] Update of "Chukwa Test Plan" by EricYang X-Virus-Checked: Checked by ClamAV on apache.org Dear Wiki user, You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification. The following page has been changed by EricYang: http://wiki.apache.org/hadoop/Chukwa_Test_Plan ------------------------------------------------------------------------------ * Database query for the past 3 hours. * Database query for cross partition union. + * Check HICC graphs + * Cluster System Metrics + * CPU idle percentage + * CPU nice percentage + * CPU system percentage + * CPU user percentage + * CPU hardware interrupt percentage + * CPU software interrupt percentage + * Iowait percentage + * Memory buffer percentage + * Memory used percentage + * Network card 1 busy percentage + * Network card 2 busy percentage + * Disk 1 busy percentage + * Disk 2 busy percentage + * Disk 3 busy percentage + * Disk 4 busy percentage + * Swap used percentage + * Number of reporting hosts + * System load 15 minutes average + * System load 5 minutes average + * System load 1 minutes average + * Task total + * Task running + * Task sleep + * Task stopped + * Task zombie + * Memory total + * Memory buffers + * Memory cached + * Memory free + * Network card 1 received error per second + * Network card 1 received bytes per second + * Network card 1 received dropped per second + * Network card 1 received packets per second + * Network card 2 received error per second + * Network card 2 received bytes per second + * Network card 2 received dropped per second + * Network card 2 received packets per second + * Disk 1 read kilobytes per second + * Disk 1 read kilobytes per second + * Disk 2 read kilobytes per second + * Disk 2 read kilobytes per second + * Disk 3 read kilobytes per second + * Disk 3 read kilobytes per second + * Disk 4 read kilobytes per second + * Disk 4 read kilobytes per second + + * System Metrics + * CPU idle percentage + * CPU nice percentage + * CPU system percentage + * CPU user percentage + * CPU hardware interrupt percentage + * CPU software interrupt percentage + * Iowait percentage + * Memory buffer percentage + * Memory used percentage + * Network card 1 busy percentage + * Network card 2 busy percentage + * Disk 1 busy percentage + * Disk 2 busy percentage + * Disk 3 busy percentage + * Disk 4 busy percentage + * Swap used percentage + * Number of reporting hosts + * System load 15 minutes average + * System load 5 minutes average + * System load 1 minutes average + * Task total + * Task running + * Task sleep + * Task stopped + * Task zombie + * Memory total + * Memory buffers + * Memory cached + * Memory free + * Network card 1 received error per second + * Network card 1 received bytes per second + * Network card 1 received dropped per second + * Network card 1 received packets per second + * Network card 2 received error per second + * Network card 2 received bytes per second + * Network card 2 received dropped per second + * Network card 2 received packets per second + * Disk 1 read kilobytes per second + * Disk 1 read kilobytes per second + * Disk 2 read kilobytes per second + * Disk 2 read kilobytes per second + * Disk 3 read kilobytes per second + * Disk 3 read kilobytes per second + * Disk 4 read kilobytes per second + * Disk 4 read kilobytes per second + + * HDFS FS Name System Metrics + * Blocks total + * Capacity remaining gigabytes + * Capacity used gigabytes + * Files total + * Pending replication blocks + * Scheduled replication blocks + * Total load + * Under replication blocks + + * HDFS Throughput Metrics + * Reporting hosts + * Number of operation for block reports per minute + * Block verification failures + * Blocks read per minute + * Blocks removed per minute + * Blocks replicated per minute + * Blocks verified per minute + * Blocks written per minute + * Bytes read per minute + * Bytes written per minute + * Number of copy block operation per minute + * Number of heartbeat operation + * Number of read block operation + * Number of read meta data operation + * Number of reads from local client + * Number of reads from remote client + * Number of replace block operation + * Number of write block operation + * Writes from local client + * Writes from remote client + * Block reports average time + * Copy block operation average time + * Heart beats average time + * Read block operation average time + * Read meta data operation average time + * Replace block operation average time + * Write block operation average time + + * HDFS Name Node Metrics + * Number of add block operation + * Number of create file operation + * Number of delete file operation + * Files created + * Files renamed + * Files deleted + * Get block locations + * Get listing operation + * Number of syncs operation + * Number of transactions + * Number of block report + * Blocks corrupted + * Safe mode time + * Syncs average time + * Transaction average time + * Block report average time + * File system image load time + + * HDFS Data Node Metrics + * Number of operation for block reports + * Number of block verification failures + * Blocks read + * Blocks removed + * Blocks replicated + * Blocks verified + * Blocks written + * Bytes read + * Bytes written + * Number of copy block operation + * Number of heart beats + * Number of read block operation + * Number of read meta data operations + * Reads from local client + * Reads from remote client + * Number of replace block operation + * Number of write block operation + * Writes from local client + * Writes from remote client + + * Map Reduce Job Metrics + * Jobs completed + * Jobs submitted + * Maps completed + * Maps launched + * Reduce completed + * Reduce launched + + * JVM Metrics + * NameNode + * Memory heap committed + * Memory heap used + * Memory non heap committed + * Memory non heap used + * threads blocked + * threads new + * threads runnable + * threads terminated + * threads timed waiting + * threads waiting + * DataNode + * Memory heap committed + * Memory heap used + * Memory non heap committed + * Memory non heap used + * threads blocked + * threads new + * threads runnable + * threads terminated + * threads timed waiting + * threads waiting + * Job Tracker + * Memory heap committed + * Memory heap used + * Memory non heap committed + * Memory non heap used + * threads blocked + * threads new + * threads runnable + * threads terminated + * threads timed waiting + * threads waiting + * Task Tracker + * Memory heap committed + * Memory heap used + * Memory non heap committed + * Memory non heap used + * threads blocked + * threads new + * threads runnable + * threads terminated + * threads timed waiting + * threads waiting + * Map + * Memory heap committed + * Memory heap used + * Memory non heap committed + * Memory non heap used + * threads blocked + * threads new + * threads runnable + * threads terminated + * threads timed waiting + * threads waiting + * Shuffle + * Memory heap committed + * Memory heap used + * Memory non heap committed + * Memory non heap used + * threads blocked + * threads new + * threads runnable + * threads terminated + * threads timed waiting + * threads waiting + + * Usage Report + * HDFS usage by queue + * Map reduce slot hour by queue + * HDFS usage by user + * Map reduce slot hour by user + Manual Test * Restart HDFS cluster