Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 76927 invoked from network); 17 Mar 2009 13:56:10 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 17 Mar 2009 13:56:10 -0000 Received: (qmail 42457 invoked by uid 500); 17 Mar 2009 13:56:03 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 42417 invoked by uid 500); 17 Mar 2009 13:56:03 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 42406 invoked by uid 99); 17 Mar 2009 13:56:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 Mar 2009 06:56:03 -0700 X-ASF-Spam-Status: No, hits=-1.0 required=10.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy includes SPF record at spf.trusted-forwarder.org) Received: from [129.93.181.2] (HELO mathstat.unl.edu) (129.93.181.2) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 Mar 2009 13:55:52 +0000 Received: from pcp088886pcs.unl.edu (pcp088886pcs.unl.edu [129.93.158.1]) (authenticated bits=0) by mathstat.unl.edu (8.13.8/8.13.8) with ESMTP id n2HDtSDg016229 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NOT) for ; Tue, 17 Mar 2009 08:55:30 -0500 Message-Id: <3578303B-C1D7-44C7-A29E-74B3C99BE34E@cse.unl.edu> From: Brian Bockelman To: core-user@hadoop.apache.org In-Reply-To: <6d10e930903170648w706e71d6lc52005476e4fa4c@mail.gmail.com> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v930.3) Subject: Re: Monitoring with Ganglia Date: Tue, 17 Mar 2009 08:55:28 -0500 References: <6d10e930903170648w706e71d6lc52005476e4fa4c@mail.gmail.com> X-Mailer: Apple Mail (2.930.3) X-Virus-Checked: Checked by ClamAV on apache.org Hey Tamir, I assume you want something like this: http://rcf.unl.edu/ganglia/?c=red-workers&h=node155&m=load_one&r=hour&s=descending&hc=4 (That link's old - where'd you find it? I'll update it...) Can you send out the relevant lines from the hadoop-metrics file? Also, can you do the following telnet (Ganglia host) (Ganglia port) This should spew out lots of XML data; use the host and port you configured hadoop with. Brian On Mar 17, 2009, at 8:48 AM, Tamir Kamara wrote: > Hi, > > For a few days I'm trying to make hadoop work with the Ganglia > monitoring > software. > I'm using hadoop 0.18.3 with ganglia 3.0.6, I've changed the hadoop- > metrics > file as described in the wiki and also used HADOOP-3422 patch.Now, I > can > only see system metrics in the ganglia data and nothing about hadoop > itself. > > I also tried to add a collection group to gmond.conf for metric > mapred.tasktracker.mapTaskSlots, but that caused gmond to stop working > because it couldn't "collect the metric on the platform" which means > that it > doesn't recognize the metric. > It should be possible to do this like in http://rcf.unl.edu/ganglia/?c=red > . > > There're some posts of this issue but I couldn't find any answer or > detailed > description of how to monitor hadoop with ganglia. > > Does anyone have any experience with this ? > > Thanks, > Tamir