hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Abdelnur (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7563) hadoop-config.sh setup HADOOP_HDFS_HOME and HADOOP_MAPRED_HOME incorrectly
Date Tue, 23 Aug 2011 20:56:28 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089754#comment-13089754
] 

Alejandro Abdelnur commented on HADOOP-7563:
--------------------------------------------

Comments on '-2' patch:

Where you are doing: 

{code}

if [ -d "$HADOOP_PREFIX/share/hadoop/common/lib" ]; then
  CLASSPATH=${CLASSPATH}:$HADOOP_PREFIX/share/hadoop/common/lib/*;
fi

CLASSPATH=${CLASSPATH}:$HADOOP_PREFIX/share/hadoop/common/*.jar;
{code}

For the first CLASSPATH=, you have to do '/*' to prevent the shell from resolving the wildcard.
'java' does special handing.

For the second CLASSPATH=, I don't that will be correctly resolved. There are multiple JARs
at common/ level, and some of the them are test classes and sources. You don't want them in
the classpath.

IMO, the correct fix is to change the assembly as I've pointed out before (to have the hadoop-*
artifact JAR under lib) and then do:

{code}
  CLASSPATH=${CLASSPATH}:$HADOOP_PREFIX/share/hadoop/common/lib'/*';
{code}


> hadoop-config.sh setup HADOOP_HDFS_HOME and HADOOP_MAPRED_HOME incorrectly
> --------------------------------------------------------------------------
>
>                 Key: HADOOP-7563
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7563
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: scripts
>    Affects Versions: 0.23.0
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7563-1.patch, HADOOP-7563-2.patch, HADOOP-7563.patch
>
>
> HADOOP_HDFS_HOME and HADOOP_MAPRED_HOME was set to HADOOP_PREFIX/share/hadoop/hdfs and
HADOOP_PREFIX/share/hadoop/mapreduce.  This setup confuses the location of hdfs and mapred
scripts.  Instead the script should look for hdfs and mapred script in HADOOP_PREFIX/bin.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message