hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brian Bockelman <bbock...@cse.unl.edu>
Subject Re: Monitoring with Ganglia
Date Tue, 17 Mar 2009 13:55:28 GMT
Hey Tamir,

I assume you want something like this:

http://rcf.unl.edu/ganglia/?c=red-workers&h=node155&m=load_one&r=hour&s=descending&hc=4

(That link's old - where'd you find it?  I'll update it...)

Can you send out the relevant lines from the hadoop-metrics file?

Also, can you do the following

telnet (Ganglia host) (Ganglia port)

This should spew out lots of XML data; use the host and port you  
configured hadoop with.

Brian

On Mar 17, 2009, at 8:48 AM, Tamir Kamara wrote:

> Hi,
>
> For a few days I'm trying to make hadoop work with the Ganglia  
> monitoring
> software.
> I'm using hadoop 0.18.3 with ganglia 3.0.6, I've changed the hadoop- 
> metrics
> file as described in the wiki and also used HADOOP-3422 patch.Now, I  
> can
> only see system metrics in the ganglia data and nothing about hadoop  
> itself.
>
> I also tried to add a collection group to gmond.conf for metric
> mapred.tasktracker.mapTaskSlots, but that caused gmond to stop working
> because it couldn't "collect the metric on the platform" which means  
> that it
> doesn't recognize the metric.
> It should be possible to do this like in http://rcf.unl.edu/ganglia/?c=red 
> .
>
> There're some posts of this issue but I couldn't find any answer or  
> detailed
> description of how to monitor hadoop with ganglia.
>
> Does anyone have any experience with this ?
>
> Thanks,
> Tamir


Mime
View raw message