chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerome Boulon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CHUKWA-297) Unbundling hadoop jar file
Date Tue, 16 Jun 2009 17:17:07 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720245#action_12720245
] 

Jerome Boulon commented on CHUKWA-297:
--------------------------------------

>> by using environment controlled class path
If HADOOP_HOME and HADOOP_CONF_DIR are correctly set in build.properties then you should have
the right classpath for hadoop jars???
>From chukwa-config.sh:

if [ -z ${HADOOP_JAR} ]; then
  if [ -z ${HADOOP_HOME} ]; then
        export HADOOP_HOME=../../..
    fi
    if [ -d ${HADOOP_HOME} ]; then
        export HADOOP_JAR=`ls ${HADOOP_HOME}/hadoop-*-core.jar`
        if [ -z ${HADOOP_JAR} ]; then
            echo "Please make sure hadoop-*-core.jar exists in ${HADOOP_HOME}"
            exit -1
        fi
    else
        if [ -d ${CHUKWA_HOME}/hadoopjars ]; then
            echo "WARNING: neither HADOOP_HOME nor HADOOP_JAR is set we we are reverting to
defaults in $CHUKWA_HOME/hadoopjars dir"
            export HADOOP_JAR=`ls ${CHUKWA_HOME}/hadoopjars/hadoop-*-core.jar`
        else
            echo "Please make sure hadoop-*-core.jar exists in ${CHUKWA_HOME}/hadoopjars"
            exit -1
        fi
    fi
fi


> Unbundling hadoop jar file
> --------------------------
>
>                 Key: CHUKWA-297
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-297
>             Project: Hadoop Chukwa
>          Issue Type: Bug
>          Components: build and test code
>    Affects Versions: 0.1.2, 0.2.0
>         Environment: Redhat EL 5.1, Java 6
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>
> During the deployment, the most frequently issue is hadoop version mismatch.  When this
happens, the hadoop jar files needs to be copied to both CHUKWA_HOME/hadoopjars, and hicc/WEB-INF/lib.
 We should be able to work around both issues by using environment controlled class path.
 For build time, the HADOOP_JAR variable could be overwritten by default.properties and build.properties
to source in hadoop jar file.  If this is this sounds good, then I vote for removing the hadoop-*.jar
file from hadoopjars directory in the upcoming release.  This change would reduce the amount
of hand tweak on the deployment system.  Suggestion and feedback are welcome.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message