hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "Chukwa_Quick_Start" by EricYang
Date Sun, 27 Nov 2011 19:32:15 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "Chukwa_Quick_Start" page has been changed by EricYang:
http://wiki.apache.org/hadoop/Chukwa_Quick_Start?action=diff&rev1=44&rev2=45

  == Pre-requisites ==
  Chukwa should work on any POSIX platform, but GNU/Linux is the only production platform
that has been tested extensively. Chukwa has also been used successfully on Mac OS X, which
several members of the Chukwa team use for development.
  
- The only absolute software requirements are Java 1.6 or better and Hadoop 0.20.203+. HICC,
the Chukwa visualization interface, requires HBase 0.90.3.
+ The only absolute software requirements are Java 1.6 or better and Hadoop 0.20.205+. HICC,
the Chukwa visualization interface, requires HBase 0.90.4.
  
  The Chukwa cluster management scripts rely on ssh; these scripts, however, are not required
if you have some alternate mechanism for starting and stopping daemons.
  
@@ -24, +24 @@

  {{http://people.apache.org/~eyang/docs/chukwa-0.5-arch.png}}
  
  == Compiling and installing Chukwa ==
+  1. To compile Chukwa, just type 'mvn clean package -DskipTests -DTODO_HBASE_CONF_DIR=/path/to/$HBASE_CONF_DIR'
in the project root directory.
-  1. Copy hbase-0.90.3.jar, hbase-0.90.3-test.jar and HBASE_HOME/lib/zookeeper-*.jar to CHUKWA_HOME/lib
-  1. To compile Chukwa, just say ''ant tar'' in the project root directory.
-  1. Extract the compiled tar file from build/chukwa-0.x.y.tar.gz to the Chukwa root directory.
+  1. Extract the compiled tar file from target/chukwa-0.x.y.tar.gz to the Chukwa root directory.
  
  == Setup Chukwa Cluster ==
  General Hadoop configuration is available at: [[http://hadoop.apache.org/common/docs/current/cluster_setup.html|Hadoop
Configuration]]
@@ -43, +42 @@

    }}}
    Save the file.
   1. Copy CHUKWA_HOME/hadoop-metrics.properties to HADOOP_CONF_DIR.
-  1. Copy CHUKWA_HOME/chukwa-hadoop-0.5.0-client.jar to HADOOP_HOME/lib.
+  1. Copy CHUKWA_HOME/share/chukwa/chukwa-0.5.0-client.jar to HADOOP_HOME/share/hadoop/lib.
-  1. Copy CHUKWA_HOME/lib/json-simple-1.1.jar to HADOOP_HOME/lib.
+  1. Copy CHUKWA_HOME/share/chukwa/lib/json-simple-1.1.jar to HADOOP_HOME/share/hadoop/lib.
   1. Restart Hadoop Cluster.
   1. General HBASE configuration is available at:  [[http://hbase.apache.org/docs/current/api/overview-summary.html#overview_description|HBase
Configuration]]
   1. After Hadoop and HBase has been configured properly, run: 
@@ -54, +53 @@

    This procedure initializes the default Chukwa HBase schema.
  
  == Configuring and starting the Collector ==
-  1. Copy conf/chukwa-collector-conf.xml.template to conf/chukwa-collector-conf.xml
   1. Edit conf/chukwa-collector-conf.xml and comment out the default properties for chukwaCollector.writerClass,
and chukwaCollector.pipeline.  Uncomment block for HBaseWriter parameters, and save.
-  1. If you're running HBase in distributed mode, copy your hadoop-site.xml, hbase-site.xml
file to the collectors conf/ directory. At a minimum, this file must contain a setting for
hbase.zookeeper.quorum.
-  1. Copy conf/chukwa-env.sh-template to conf/chukwa-env.sh.
   1. Edit chukwa-env.sh.  You almost certainly need to set JAVA_HOME, HADOOP_HOME, HADOOP_CONF_DIR,
HBASE_HOME, and HBASE_CONF_DIR at least.
-  1. In the chukwa root directory, say bash bin/chukwa collector'' ''
+  1. In the chukwa root directory, run 'bin/chukwa collector'
  
  == Configuring and starting the local agent ==
-  1. ''Copy conf/chukwa-agent-conf.xml.template to conf/chukwa-agent-conf.xml ''
-  1. ''Copy conf/collectors.template to conf/collectors ''
+  1. Verify etc/chukwa/chukwa-agent-conf.xml configuration
+  1. Verify etc/chukwa/collectors contains list of collector hostname
-  1. ''In the chukwa root directory, say bash bin/chukwa agent''
+  1. In the chukwa root directory, run 'bin/chukwa agent'
  
  == Starting Adaptors ==
  The local agent speaks a simple text-based protocol, by default over port 9093. Suppose
you want Chukwa to monitor system metrics, hadoop metrics, and hadoop logs on the localhost:

Mime
View raw message