Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1569FD247 for ; Mon, 10 Sep 2012 20:17:04 +0000 (UTC) Received: (qmail 27150 invoked by uid 500); 10 Sep 2012 20:16:58 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 27073 invoked by uid 500); 10 Sep 2012 20:16:58 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 27066 invoked by uid 99); 10 Sep 2012 20:16:58 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Sep 2012 20:16:58 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [64.78.56.86] (HELO hub025-ca-2.exch025.serverdata.net) (64.78.56.86) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Sep 2012 20:16:50 +0000 Received: from MBX025-W1-CA-7.exch025.domain.local ([10.254.12.57]) by HUB025-CA-2.exch025.domain.local ([10.254.12.33]) with mapi id 14.02.0309.002; Mon, 10 Sep 2012 13:16:30 -0700 From: "Jones, Robert" To: "user@hadoop.apache.org" Subject: Which metrics to track? Thread-Topic: Which metrics to track? Thread-Index: AQHNj5Ephc/IDMVw10e+WJ9hi+Wjag== Date: Mon, 10 Sep 2012 20:16:29 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [24.75.64.234] Content-Type: text/plain; charset="us-ascii" Content-ID: <97D3B0F64391E748A6EFB1C5AD9A52CC@exch025.domain.local> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org Hello all, I am a sysadmin and do not know that much about Hadoop. I run a= stats/metrics tracking system that logs stats over time so you can look at= historical and current data and perform some trend analysis. I know I can= access several hadoop metrics via jmx by going to http://localhost:50070/j= mx?qry=3Dhadoop:* and I've got a script that parses all that data so that I= can stuff any of it that I want into our stats system. So, with all that preamble, I have one question. Which metrics are worth t= racking? There are a *lot* of metrics returned via the jmx query but I dou= bt all of them are critically important. Which metrics are important to tr= ack if we want to watch for any trends or spikes in our hadoop cluster? Please provide some education to this noob. Thanks! -- Bob Jones Linux Systems/Network Engineer ME Cloud Computing Advanced Systems Development, Inc. 1 (434) 964-3156 ***************************************************************************= *** This message and any attachments are solely for the intended recipient = and may contain confidential or privileged information. If you are not the = intended recipient, any disclosure, copying, use, or distribution of the in= formation included in this message and any attachments is prohibited. If yo= u have received this communication in error, please notify us by reply e-ma= il and immediately and permanently delete this message and any attachments.= Any views or opinions presented in this email are solely those of the auth= or and do not necessarily represent those of ASD. Employees of ASD are expr= essly required not to make defamatory statements and not to infringe or aut= horize any infringement of copyright or any other legal right by email comm= unications. Any such communication is contrary to company policy and outsid= e the scope of the employment of the individual concerned. The company will= not accept any liability in respect. *************************************= *****************************************