hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Larry Compton <lawrence.comp...@gmail.com>
Subject Re: Ganglia Configuration
Date Mon, 22 Mar 2010 20:43:35 GMT
I figured it out. The IP address of the host running "gmetad" didn't work,
but specifying the value found in the "udp_send_channel" block in
"gmond.conf" worked (239.2.11.71), as is indeed specified in
http://wiki.apache.org/hadoop/GangliaMetrics. Here's the "udp_send_channel"
block...

udp_send_channel {
  mcast_join = 239.2.11.71
  port = 8649
  ttl = 1
}

And for those who have similar problems getting this to work, here is a
sample of the sort of output to expect from Ganglia if this is working
correctly. A significant number of additional entries will appear in the XML
output...

<METRIC NAME="jvm.metrics.threadsRunnable" VAL="6" TYPE="int32" UNITS=""
TN="0" TMAX="60" DMAX="0" SLOPE="both">
<EXTRA_DATA>
<EXTRA_ELEMENT NAME="GROUP" VAL="jvm.metrics"/>
</EXTRA_DATA>
</METRIC>
<METRIC NAME="rpc.metrics.mkdirs_num_ops" VAL="1" TYPE="int32" UNITS=""
TN="0" TMAX="60" DMAX="0" SLOPE="both">
<EXTRA_DATA>
<EXTRA_ELEMENT NAME="GROUP" VAL="rpc.metrics"/>
</EXTRA_DATA>
</METRIC>
<METRIC NAME="mapred.jobtracker.reduces_completed" VAL="0" TYPE="int32"
UNITS="" TN="3" TMAX="60" DMAX="0" SLOPE="both">
<EXTRA_DATA>
<EXTRA_ELEMENT NAME="GROUP" VAL="mapred.jobtracker"/>
</EXTRA_DATA>
</METRIC>

On Mon, Mar 22, 2010 at 4:07 PM, Nathan Harkenrider <
nathan.harkenrider@gmail.com> wrote:

> Try changing dfs.servers to point to the IP of the machine running the
> gmetad daemon.
>
> Example,
>
> dfs.servers=<ip of host running gmetad>:8649
>
> Regards,
>
> Nathan Harkenrider
>
> On Mon, Mar 22, 2010 at 12:55 PM, Larry Compton
> <lawrence.compton@gmail.com>wrote:
>
> > When Hadoop is properly configured to use Ganglia, do you see additional
> > entries in the Ganglia XML output? We've configured Hadoop to send
> metrics
> > to Ganglia, but we're not seeing additional information when we run
> "telnet
> > localhost 8649". The only configuration change we made was to update
> > "hadoop-metrics.properties" per the instructions in...
> >
> >  http://wiki.apache.org/hadoop/GangliaMetrics
> >
> > Do you also have to make changes in "gmond.conf"? If so, what changes are
> > necessary?
> >
> > - Cloudera Hadoop Distribution hadoop-0.20.1+169.56
> > - Ganglia 3.1.2
> > - Ubuntu 9.10
> >
> > Here is our "hadoop-metrics.properties" file...
> >
> > # Configuration of the "dfs" context for null
> > #dfs.class=org.apache.hadoop.metrics.spi.NullContext
> >
> > # Configuration of the "dfs" context for file
> > #dfs.class=org.apache.hadoop.metrics.file.FileContext
> > #dfs.period=10
> > #dfs.fileName=/tmp/dfsmetrics.log
> >
> > # Configuration of the "dfs" context for ganglia
> > # Pick one: Ganglia 3.0 (former) or Ganglia 3.1 (latter)
> > # dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> > dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
> > dfs.period=10
> > dfs.servers=localhost:8649
> >
> >
> > # Configuration of the "mapred" context for null
> > #mapred.class=org.apache.hadoop.metrics.spi.NullContext
> >
> > # Configuration of the "mapred" context for file
> > #mapred.class=org.apache.hadoop.metrics.file.FileContext
> > #mapred.period=10
> > #mapred.fileName=/tmp/mrmetrics.log
> >
> > # Configuration of the "mapred" context for ganglia
> > # Pick one: Ganglia 3.0 (former) or Ganglia 3.1 (latter)
> > # mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> > mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
> > mapred.period=10
> > mapred.servers=localhost:8649
> >
> >
> > # Configuration of the "jvm" context for null
> > #jvm.class=org.apache.hadoop.metrics.spi.NullContext
> >
> > # Configuration of the "jvm" context for file
> > #jvm.class=org.apache.hadoop.metrics.file.FileContext
> > #jvm.period=10
> > #jvm.fileName=/tmp/jvmmetrics.log
> >
> > # Configuration of the "jvm" context for ganglia
> > jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> > jvm.period=10
> > jvm.servers=localhost:8649
> >
> > # Configuration of the "rpc" context for ganglia
> > #rpc.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> > #rpc.period=10
> > #rpc.servers=localhost:8649
> >
>



-- 
Larry Compton
SRA International
240.373.5312 (APL)
443.742.2762 (cell)

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message