Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 38202 invoked from network); 12 Jun 2009 03:32:47 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 12 Jun 2009 03:32:47 -0000 Received: (qmail 97570 invoked by uid 500); 12 Jun 2009 03:32:56 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 97476 invoked by uid 500); 12 Jun 2009 03:32:56 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 97466 invoked by uid 99); 12 Jun 2009 03:32:56 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Jun 2009 03:32:56 +0000 X-ASF-Spam-Status: No, hits=1.8 required=10.0 tests=MIME_QP_LONG_LINE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of vishal_ghawate@persistent.co.in designates 202.54.11.87 as permitted sender) Received: from [202.54.11.87] (HELO bmapps.persistent.co.in) (202.54.11.87) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Jun 2009 03:32:43 +0000 Received: from bmapps.persistent.co.in (unknown [127.0.0.1]) by bmapps.persistent.co.in (Symantec Mail Security) with ESMTP id 70E26464027 for ; Fri, 12 Jun 2009 09:02:19 +0530 (IST) X-AuditID: 0a4e0006-a5de8bb00000669b-3f-4a31cc4382e3 Received: from CAS2.persistent.co.in (unknown [10.78.0.1]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by bmapps.persistent.co.in (Symantec Mail Security) with ESMTP id 5C5B1420002 for ; Fri, 12 Jun 2009 09:02:19 +0530 (IST) Received: from Exchange.persistent.co.in ([fe80::ad8a:d553:ef93:bfdd]) by CAS2 ([10.77.224.47]) with mapi; Fri, 12 Jun 2009 09:02:19 +0530 From: Vishal Ghawate To: "core-user@hadoop.apache.org" Date: Fri, 12 Jun 2009 09:01:01 +0530 Subject: RE: Monitoring hadoop? Thread-Topic: Monitoring hadoop? Thread-Index: Acnqx443Si3fAquqRPiWAqyHU2faMAARqcMO Message-ID: References: <294abfce0906050655q1c013cbau3e295d122b03686a@mail.gmail.com>,<39b0afc00906111204k7e74bd7dv672f9437d46a7429@mail.gmail.com> In-Reply-To: <39b0afc00906111204k7e74bd7dv672f9437d46a7429@mail.gmail.com> Accept-Language: en-US, en-IN Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-IN Content-Type: text/plain; charset="us-ascii" content-transfer-encoding: quoted-printable MIME-Version: 1.0 X-Brightmail-Tracker: AAAAAA== X-Virus-Checked: Checked by ClamAV on apache.org you can try Ganglia monitoring tool even though its not hadoop specific it monitors the cluster that will might= help you. With Regards, VIshal S. Ghawate | Intern | Persistent Systems vishal_ghawate@persistent.co.in | Cell: +91 9970231302| Tel: +91 (20) 3023= 4224 Persistent Systems - Innovation in software product design, development and= delivery - www.persistentsys.com ________________________________________ From: Ariel Rabkin [asrabkin@gmail.com] Sent: Friday, June 12, 2009 12:34 AM To: core-user@hadoop.apache.org Subject: Re: Monitoring hadoop? You might also want to check out Chukwa, which is a Hadoop subproject aiming to do scalable monitoring and analysis of large clusters, particularly Hadoop clusters. It's still in development, so you'd be able to have an influence on the design and priorities that come out. --Ari On Fri, Jun 5, 2009 at 6:55 AM, Anthony McCulley wrote: > Hey all, > I'm currently tasked to come up with a web/flex-based > visualization/monitoring system for a cloud system using hadoop as part of= a > university research project. I was wondering if I could elicit some > feedback from all of you with regards to: > > > - If you were an engineer of a cloud system running hadoop, what > information would you be interested in capturing, viewing, monitoring, e= tc? > - Is there any sort of real-time stats or monitoring currently available > for hadoop? if so, is in a web-friendly format? > > Thanks in advance, > > - Anthony > -- Ari Rabkin asrabkin@gmail.com UC Berkeley Computer Science Department DISCLAIMER=0A= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A= This e-mail may contain privileged and confidential information which is the= property of Persistent Systems Ltd. It is intended only for the use of the= individual or entity to which it is addressed. If you are not the intended= recipient, you are not authorized to read, retain, copy, print, distribute= or use this message. If you have received this communication in error, plea= se notify the sender and delete all copies of this message. Persistent Syste= ms Ltd. does not accept any liability for virus infected mails.