hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Trivial Update of "Chukwa Quick Start" by andyk
Date Thu, 11 Dec 2008 20:48:30 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The following page has been changed by andyk:
http://wiki.apache.org/hadoop/Chukwa_Quick_Start

------------------------------------------------------------------------------
  '''Configure Chukwa'''
  (For an explanation of each configuration file in the conf directory, see ["Chukwa Configuration"])
  
- 1. Specify your JAVA_HOME and HADOOP_HOME in conf/chukwa-env.sh
+  1. Specify your JAVA_HOME and HADOOP_HOME in conf/chukwa-env.sh
- 1. Specify which hosts to run collectors on in the conf/collectors file.
+  1. Specify which hosts to run collectors on in the conf/collectors file.
- 1. Like in Hadoop, you need to specify a set of nodes on which you want to run Chukwa agents
(similar to conf/slaves in Hadoop) using a conf/slaves file. The local agents on each machine
will also reference the conf/collectors file, selecting a collector at random from this list
to talk to. Thus, like Hadoop, it is common to run Chukwa from a shared file system where
all of the agents (i.e. slaves) can access the same conf files.
+  1. Like in Hadoop, you need to specify a set of nodes on which you want to run Chukwa agents
(similar to conf/slaves in Hadoop) using a conf/slaves file. The local agents on each machine
will also reference the conf/collectors file, selecting a collector at random from this list
to talk to. Thus, like Hadoop, it is common to run Chukwa from a shared file system where
all of the agents (i.e. slaves) can access the same conf files.
- 1. Setup the initial adaptors you want to run on every agent in the chukwa cluster by copying
conf/initial_adaptors.template to conf/initial_adaptors and adding whichever adaptors you
see fit. See the ["Chukwa Adaptors List"] for a catalog of pre-made adaptors.
+  1. Setup the initial adaptors you want to run on every agent in the chukwa cluster by copying
conf/initial_adaptors.template to conf/initial_adaptors and adding whichever adaptors you
see fit. See the ["Chukwa Adaptors List"] for a catalog of pre-made adaptors.
  
  '''Run Chukwa'''
- 1. run bin/start-all.sh to start all agents, collectors, data loaders, and schedule the
demux MapReduce job to run every 5 minutes over top of the datasink. Use bin/stop-all.sh to
shut everything down.
+  1. run bin/start-all.sh to start all agents, collectors, data loaders, and schedule the
demux MapReduce job to run every 5 minutes over top of the datasink. Use bin/stop-all.sh to
shut everything down.
  
  
  '''OR''' run the collectors and agents independently (without other scripts running as part
of startup and shutdown)
  
- 1. Start the collectors in your cluster with the command <code>bin/start-collectors.sh</code>
(use bin/stop-collectors.sh to shut them down).
+  1. Start the collectors in your cluster with the command <code>bin/start-collectors.sh</code>
(use bin/stop-collectors.sh to shut them down).
- 1. Start the agents by running <code>bin/start-agents.sh</code> (use bin/stop-agents.sh
to shut them down).
+  1. Start the agents by running <code>bin/start-agents.sh</code> (use bin/stop-agents.sh
to shut them down).
  

Mime
View raw message