hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "Hbase/MapReduce" by allenday
Date Wed, 20 Aug 2008 19:52:07 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The following page has been changed by allenday:
http://wiki.apache.org/hadoop/Hbase/MapReduce

------------------------------------------------------------------------------
  
  You could add ''hbase-site.xml'' to $HADOOP_HOME/conf and add hbase.jar to the $HADOOP_HOME/lib
and copy these changes across your cluster but the cleanest means of adding hbase configuration
and classes to the cluster ''CLASSPATH'' is by uncommenting ''HADOOP_CLASSPATH'' in ''$HADOOP_HOME/conf/hadoop-env.sh''
and adding the path to the hbase jar and ''$HBASE_CONF_DIR'' directory.  Then copy the amended
configuration around the cluster.  You'll probably need to restart the mapreduce cluster if
you want it to notice the new configuration (You may not have to).
  
- Below, find an example of how you would amend ''hadoop-env.sh'' adding the hbase jar, conf,
and the !PerformanceEvaluation class from hbase test classes to the hadoop ''CLASSPATH''.
 This example assumes you are using the hbase-0.2.0 release, with additional commented export
commands for other releases/builds:
+ Below, find an example of how you would amend $HADOOP_HOME/conf/hadoop-env.sh adding the
hbase jar, conf.  This example assumes you are using the hbase-0.2.0 release, with additional
commented export commands for other releases/builds:
  
  {{{
  # Extra Java CLASSPATH elements.  Optional.
@@ -19, +19 @@

  #export HADOOP_CLASSPATH=$HBASE_HOME/build/test:$HBASE_HOME/build/hadoop-0.16.0-hbase.jar:$HBASE_HOME/conf
  }}}
  
+ Expand $HBASE_HOME appropriately in the in accordance with your local environment.  To use
the developer versions of the HADOOP_CLASSPATH, you first need to execute "ant" or "ant build"
in $HBASE_HOME.  This will create some .jar files in the $HBASE_HOME/build directory.  To
use the !PerformanceEvaluation class from hbase test classes, you must use a developer build.
 Then, this is how you would run the PerformanceEvaluation MR job to put up 4 clients:
- Expand $HBASE_HOME appropriately in the in accordance with your local environment.  To use
the developer versions of the HADOOP_CLASSPATH, you first need to execute "ant" or "ant build"
in $HBASE_HOME.  This will create some .jar files in the $HBASE_HOME/build directory.
- 
- And then, this is how you would run the PerformanceEvaluation MR job to put up 4 clients:
  
  {{{ > $HADOOP_HOME/bin/hadoop org.apache.hadoop.hbase.PerformanceEvaluation sequentialWrite
4}}}
  

Mime
View raw message