Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: core-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of lists@nabble.com designates
 216.139.236.158 as permitted sender)
Message-ID: <18771561.post@talk.nabble.com>
Date: Fri, 1 Aug 2008 03:15:39 -0700 (PDT)
From: savethequeen <truong727@gmail.com>
To: core-user@hadoop.apache.org
Subject: Re: Hadoop and Ganglia Meterics
In-Reply-To: <4888E2EA.1080909@joetify.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
References: <488799B9.5070404@joetify.com> <4888951E.6070908@attributor.com>
 <4888A7DE.9000301@joetify.com> <4888BBE6.2060707@attributor.com>
 <4888D90D.6070404@joetify.com> <4888DE2F.3010704@attributor.com>
 <4888E0C5.6010409@joetify.com> <4888E17B.9030409@attributor.com>
 <4888E2EA.1080909@joetify.com>


I'm using the newest version 0.17.1, but I can't make it works (it works
with FileContext, but not with GangliaContext). The gmond and gmetad are
working fine. The hadoop run on my local machine only. 

here is my hadoop-metrics.properties: 
#
dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
dfs.period=10
dfs.servers=localhost:8649

mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext
mapred.period=10
mapred.servers=localhost:8649

jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext
jvm.period=10
jvm.servers=localhost:8649
#
All the other lines are commented. 

Is there any problem with it? Where can I find the patch for this version? 
Thks. 


Joe Williams wrote:
> 
> Ah, yeah, I found that one. :) Patching 
> 'java/org/apache/hadoop/mapred/JobInProgress.java' on 0.17.1.
> 
> -joe
> 
> 
> Jason Venner wrote:
>> I have only applied this patch as far forward as 0.16.0
>>
>> Joe Williams wrote:
>>> Sweet, thanks.
>>>
>>>
>>> Jason Venner wrote:
>>>> Once the patch is applied you should start seeing the ganglia metrics
>>>>
>>>> We do.
>>>>
>>>>
>>>> Joe Williams wrote:
>>>>> Once I have the patch applied and have it running should I see the 
>>>>> metrics? Or do I need to additional work?
>>>>>
>>>>> Thanks.
>>>>> -Joe
>>>>>
>>>>>
>>>>> Jason Venner wrote:
>>>>>> I applied the patch in the jira to my distro
>>>>>>
>>>>>> Joe Williams wrote:
>>>>>>> Thanks Jason, until this is implemented are how are you pulling 
>>>>>>> stats from Hadoop?
>>>>>>>
>>>>>>> -joe
>>>>>>>
>>>>>>>
>>>>>>> Jason Venner wrote:
>>>>>>>> Check out
>>>>>>>>
>>>>>>>> https://issues.apache.org/jira/browse/HADOOP-3422
>>>>>>>>
>>>>>>>>
>>>>>>>> Joe Williams wrote:
>>>>>>>>> I have been attempting to get Hadoop metrics in Ganliga and 
>>>>>>>>> have been unsuccessful thus far. I have see this thread 
>>>>>>>>> (http://mail-archives.apache.org/mod_mbox/hadoop-core-user/200712.mbox/raw/%3C475E4FFA.7050007@yahoo-inc.com%3E/) 
>>>>>>>>> but it didn't help much.
>>>>>>>>>
>>>>>>>>> I have setup my properties file like so:
>>>>>>>>>
>>>>>>>>>> [root@hadoop-head-node01 current]# cat 
>>>>>>>>>> conf/hadoop-metrics.properties
>>>>>>>>>> dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
>>>>>>>>>> dfs.period=10
>>>>>>>>>> dfs.servers=127.0.0.1:8649
>>>>>>>>>>
>>>>>>>>>> mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext
>>>>>>>>>> mapred.period=10
>>>>>>>>>> mapred.servers=127.0.0.1:8649
>>>>>>>>>
>>>>>>>>> And if I 'telnet 127.0.0.1  8649' I receive the Ganglia XML 
>>>>>>>>> metrics output without any hadoop specific metrics:
>>>>>>>>>
>>>>>>>>>> [root@hadoop-head-node01 current]# telnet 127.0.0.1  8649
>>>>>>>>>> Trying 127.0.0.1...
>>>>>>>>>> Connected to localhost (127.0.0.1).
>>>>>>>>>> Escape character is '^]'.
>>>>>>>>>> ?xml version="1.0" encoding="ISO-8859-1" standalone="yes"?>
>>>>>>>>>> !DOCTYPE GANGLIA_XML [
>>>>>>>>>>   !ELEMENT GANGLIA_XML (GRID|CLUSTER|HOST)*>
>>>>>>>>>>       !ATTLIST GANGLIA_XML VERSION CDATA #REQUIRED>
>>>>>>>>>>       !ATTLIST GANGLIA_XML SOURCE CDATA #REQUIRED>
>>>>>>>>>> --SNIP--
>>>>>>>>>
>>>>>>>>> Is there more I need to do to get the metrics to show up in 
>>>>>>>>> this output, am I doing something incorrectly? Do I need to 
>>>>>>>>> have a gmetric script run in a cron to update the stats? If so, 
>>>>>>>>> does anyone have a hadoop specific example of this?
>>>>>>>>>
>>>>>>>>> Any info would be helpful.
>>>>>>>>>
>>>>>>>>> Thanks.
>>>>>>>>> -Joe
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>>>
>>>
> 
> -- 
> Name: Joseph A. Williams
> Email: joe@joetify.com
> 
> 
> 

-- 
View this message in context: http://www.nabble.com/Hadoop-and-Ganglia-Meterics-tp18620340p18771561.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.