chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerome Boulon (JIRA)" <>
Subject [jira] Commented: (CHUKWA-297) Unbundling hadoop jar file
Date Tue, 16 Jun 2009 17:17:07 GMT


Jerome Boulon commented on CHUKWA-297:

>> by using environment controlled class path
If HADOOP_HOME and HADOOP_CONF_DIR are correctly set in then you should have
the right classpath for hadoop jars???

if [ -z ${HADOOP_JAR} ]; then
  if [ -z ${HADOOP_HOME} ]; then
        export HADOOP_HOME=../../..
    if [ -d ${HADOOP_HOME} ]; then
        export HADOOP_JAR=`ls ${HADOOP_HOME}/hadoop-*-core.jar`
        if [ -z ${HADOOP_JAR} ]; then
            echo "Please make sure hadoop-*-core.jar exists in ${HADOOP_HOME}"
            exit -1
        if [ -d ${CHUKWA_HOME}/hadoopjars ]; then
            echo "WARNING: neither HADOOP_HOME nor HADOOP_JAR is set we we are reverting to
defaults in $CHUKWA_HOME/hadoopjars dir"
            export HADOOP_JAR=`ls ${CHUKWA_HOME}/hadoopjars/hadoop-*-core.jar`
            echo "Please make sure hadoop-*-core.jar exists in ${CHUKWA_HOME}/hadoopjars"
            exit -1

> Unbundling hadoop jar file
> --------------------------
>                 Key: CHUKWA-297
>                 URL:
>             Project: Hadoop Chukwa
>          Issue Type: Bug
>          Components: build and test code
>    Affects Versions: 0.1.2, 0.2.0
>         Environment: Redhat EL 5.1, Java 6
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
> During the deployment, the most frequently issue is hadoop version mismatch.  When this
happens, the hadoop jar files needs to be copied to both CHUKWA_HOME/hadoopjars, and hicc/WEB-INF/lib.
 We should be able to work around both issues by using environment controlled class path.
 For build time, the HADOOP_JAR variable could be overwritten by and
to source in hadoop jar file.  If this is this sounds good, then I vote for removing the hadoop-*.jar
file from hadoopjars directory in the upcoming release.  This change would reduce the amount
of hand tweak on the deployment system.  Suggestion and feedback are welcome.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message