hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matt Massie <m...@cloudera.com>
Subject Re: Using Ganglia with hadoop 0.19.0 on Amazon EC2
Date Wed, 30 Sep 2009 16:33:28 GMT
On Mon, Sep 14, 2009 at 11:25 AM, Samprita Hegde <sampritavh@gmail.com> wrote:

> @ Matt,
>   I have done all the steps that you have mentioned. Can you please tell
> what are the next steps that I shoudl do?

I just noticed this was directed at me.  Sorry for the delayed response.

I'm assuming at this point, that you are able to connect to the gmond
port 8649 and see a complete XML description of the state of your
cluster, e.g.

$ telnet <gmond node> 8649 | grep '<HOST'

should output a complete list of the hosts in your cluster.

To get the web console, you need to pick a machine to install the
ganglia meta daemon (gmetad) and the front-end PHP scripts.  You need
to make sure the firewall rules allow you to make a TCP connection to
port 8649 of your gmond machine.

For more details about installation and configuration, take a look at
our wiki page....


> Thanks and Regards,
> Samprita
> On Fri, Sep 11, 2009 at 4:21 AM, John Clarke <clarkemjj@gmail.com> wrote:
>> Hadoop comes with a number of scripts to configure EC2 instances, see
>> "HADOOP_HOME/src/contrib/ec2/bin"
>> If you take a look at "src/contrib/ec2/bin/image/hadoop-init" you will see
>> that it sets up Ganglia.
>> I currently use the Cloudera scripts from
>> http://www.cloudera.com/hadoop-ec2,
>> these do not however set up Ganglia so I modified the
>> hadoop-ec2-init-remote.sh script to install the necessary packages and to
>> configure it as per the hadoop-init script above. The
>> hadoop-ec2-init-remote.sh is run at boot time on each node.
>> John.

View raw message