Install Chukwa

Return-Path: Delivered-To: apmail-hadoop-chukwa-commits-archive@minotaur.apache.org Received: (qmail 5412 invoked from network); 15 May 2009 06:06:50 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 15 May 2009 06:06:50 -0000 Received: (qmail 11151 invoked by uid 500); 15 May 2009 06:06:50 -0000 Delivered-To: apmail-hadoop-chukwa-commits-archive@hadoop.apache.org Received: (qmail 11140 invoked by uid 500); 15 May 2009 06:06:50 -0000 Mailing-List: contact chukwa-commits-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: chukwa-dev@hadoop.apache.org Delivered-To: mailing list chukwa-commits@hadoop.apache.org Received: (qmail 11129 invoked by uid 99); 15 May 2009 06:06:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 May 2009 06:06:50 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO eris.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 May 2009 06:06:41 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id B03532388895; Fri, 15 May 2009 06:06:19 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r775018 - /hadoop/chukwa/trunk/src/docs/src/documentation/content/xdocs/admin.xml Date: Fri, 15 May 2009 06:06:19 -0000 To: chukwa-commits@hadoop.apache.org From: eyang@apache.org X-Mailer: svnmailer-1.0.8 Message-Id: <20090515060619.B03532388895@eris.apache.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: eyang Date: Fri May 15 06:06:19 2009 New Revision: 775018 URL: http://svn.apache.org/viewvc?rev=775018&view=rev Log: CHUKWA-248. misc documentation updateds. (Corinne Chandel via Eric Yang) Modified: hadoop/chukwa/trunk/src/docs/src/documentation/content/xdocs/admin.xml Modified: hadoop/chukwa/trunk/src/docs/src/documentation/content/xdocs/admin.xml URL: http://svn.apache.org/viewvc/hadoop/chukwa/trunk/src/docs/src/documentation/content/xdocs/admin.xml?rev=775018&r1=775017&r2=775018&view=diff ============================================================================== --- hadoop/chukwa/trunk/src/docs/src/documentation/content/xdocs/admin.xml (original) +++ hadoop/chukwa/trunk/src/docs/src/documentation/content/xdocs/admin.xml Fri May 15 06:06:19 2009 @@ -51,8 +51,8 @@ Install Chukwa

Chukwa is installed on:

A hadoop cluster created specifically for Chukwa (referred to as the Chukwa cluster)
The source nodes that Chukwa monitors (referred to as the monitored source nodes)
A hadoop cluster created specifically for Chukwa (referred to as the Chukwa cluster).
The source nodes that Chukwa monitors (referred to as the monitored source nodes).

@@ -67,40 +67,40 @@ General Install Procedure

1. Select one of the nodes in the Chukwa cluster:

Create a directory for the Chukwa installation (Chukwa will automatically set the environment variable CHUKWA_HOME to point to this directory during the install) -
Move to the new directory -
Download and un-tar the Chukwa binary -
Configure the components for the Chukwa cluster (see Chukwa Cluster Deployment) -
Configure the Hadoop configuration files (see Hadoop Configuration Files) -
Zip the directory and deploy to all nodes in the Chukwa cluster +
Create a directory for the Chukwa installation (Chukwa will set the environment variable CHUKWA_HOME to point to this directory during the the install). +
Move to the new directory. +
Download and un-tar the Chukwa binary. +
Configure the components for the Chukwa cluster (see Chukwa Cluster Deployment). +
Configure the Hadoop configuration files (see Hadoop Configuration Files). +
Zip the directory and deploy to all nodes in the Chukwa cluster.

-

2. Select one of the source nodes to be monitored

+

2. Select one of the source nodes to be monitored:

Create a directory for the Chukwa installation (Chukwa will set the environment variable CHUKWA_HOME to point to this directory) -
Move to the new directory -
Download and un-tar the Chukwa binary -
Configure the components for the source nodes (see Monitored Source Node Deployment)) -
Configure the Hadoop configuration files (see Hadoop Configuration Files) -
Zip the directory and deploy to all source nodes to be monitored +
Create a directory for the Chukwa installation (Chukwa will set the environment variable CHUKWA_HOME to point to this directory during the install). +
Move to the new directory. +
Download and un-tar the Chukwa binary. +
Configure the components for the source nodes (see Monitored Source Node Deployment). +
Configure the Hadoop configuration files (see Hadoop Configuration Files). +
Zip the directory and deploy to all source nodes to be monitored.

Chukwa Binary

To get a Chukwa distribution, download a recent stable release of Hadoop from one of the Apache Download Mirrors (see - Hadoop Core Releases. + Hadoop Chukwa Releases.

Chukwa Configuration Files

The Chukwa configuration files are located in the CHUKWA_HOME/conf directory. The configuration files that you modify are named *.template. -To set up your Chukwa installation (to configure various components), copy, rename, and modify the *.template files as necessary. +To set up your Chukwa installation (configure various components), copy, rename, and modify the *.template files as necessary. For example, copy the chukwa-collector-conf.xml.template file to a file named chukwa-collector-conf.xml and then modify the file to include the cluster/group name for the source nodes.

-

The default.properties file contains default parameter settings. To override these default settings use the build.properties . +

The default.properties file contains default parameter settings. To override these default settings use the build.properties file. For example, copy the TODO-JAVA-HOME environment variable from the default.properties file to the build.properties file and change the setting.

@@ -125,7 +125,7 @@

1. Set the Environment Variables -

Edit the CHUKWA_HOME/conf/chukwa-env.sh configuration file.

+

Edit the CHUKWA_HOME/conf/chukwa-env.sh configuration file:

Set JAVA_HOME to your Java installation.
Set HADOOP_JAR to $CHUKWA_HOME/hadoopjars/hadoop-0.18.2.jar @@ -135,8 +135,9 @@
2. Set Up the Hadoop jar File +
Do the following:
-cp $HADOOP_HOME/lib hadoop-*-core.jar file $CHUKWA_HOME/hadoopjars +cp $HADOOP_HOME/lib hadoop-*-core.jar file $CHUKWA_HOME/hadoopjars
@@ -144,7 +145,7 @@
3. Configure the Collector
Edit the CHUKWA_HOME/conf/chukwa-collector-conf.xml configuration file.
-
Set the writer.hdfs.filesystem property to the HDFS root url.
+
Set the writer.hdfs.filesystem property to the HDFS root URL.

@@ -161,17 +162,17 @@
-Configure and then copy the my.cnf file to the CHUKWA_HOME/opt/mysql-* directory. +Configure and then copy the my.cnf file to the CHUKWA_HOME/opt/mysql-* directory:
-./scripts/mysql_install_db -./bin/mysqld_safe& +./scripts/mysql_install_db +./bin/mysqld_safe& ./bin/mysqladmin -u root create <clustername> -./bin/mysql -u root <clustername> < $CHUKWA_HOME/conf/database_create_table +./bin/mysql -u root <clustername> < $CHUKWA_HOME/conf/database_create_table
Edit the CHUKWA_HOME/conf/jdbc.conf configuration file.
-
Set the clustername to the MYSQL root URL.
+
Set the clustername to the MYSQL root URL:
<clustername>=jdbc:mysql://localhost:3306/<clustername>?user=root @@ -181,7 +182,7 @@

-Setup MySQL for Replication +Set Up MySQL for Replication
Start the MySQL shell:
mysql -u root -p @@ -243,8 +244,8 @@
-7. Deploy HICC Portal -
The Hadoop Infrastructure Care Center (HICC) is the Chukwa web user interface. To deploy HICC, do the following:
+7. Set Up HICC +
The Hadoop Infrastructure Care Center (HICC) is the Chukwa web user interface. To set up HICC, do the following:
- Download apache-tomcat 6.0.18+ from Apache Tomcat and decompress the tarball to CHUKWA_HOME/opt.
- Copy CHUKWA_HOME/hicc.war to apache-tomcat-6.0.18/webapps.