hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6368) hadoop classpath is too long
Date Tue, 10 Nov 2009 19:43:28 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776041#action_12776041
] 

Tsz Wo (Nicholas), SZE commented on HADOOP-6368:
------------------------------------------------

> Is there a limit to the length of the classpath, or is this just inconvenient?

I am not sure whether there is a limit but it is definitely inconvenient.  For example, the
command displayed in "ps aux" is truncated.  I see something like

tsz      27732  9.1  0.5 3574740 96352 pts/0   Sl   19:38   0:02 /grid/0/gs/java/jdk64/current/bin/java
... -classpath /grid/0/dev/tsz-c2/conf:/grid/0/gs/java/jdk64/current/lib/tools.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build/classes:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build/test/classes:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../hadoop-core-*.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../lib/hadoop-core-0.21.0-dev.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../lib/hadoop-core-test-0.21.0-dev.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../lib/hadoop-hdfs-0.21.0-dev.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../lib/hadoop-hdfs-test-0.21.0-dev.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../lib/hadoop-mapred-0.21.0-dev.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../lib/hadoop-mapred-examples-0.21.0-dev.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../lib/hadoop-mapred-test-0.21.0-dev.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build/ivy/lib/Hadoop-Core/common/ant-1.6.5.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build/ivy/lib/Hadoop-Core/common/asm-3.0.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build/ivy/lib/Hadoop-Core/common/aspectjrt-1.6.4.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build/ivy/lib/Hadoop-Core/common/aspectjtools-1.6.4.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build/ivy/lib/Hadoop-Core/common/avro-1.2.0.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build/ivy/lib/Hadoop-Core/common/commons-cli-1.2.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build/ivy/lib/Hadoop-Core/common/commons-codec-1.3.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build/ivy/lib/Hadoop-Core/common/commons-el-1.0.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build/ivy/lib/Hadoop-Core/common/commons-httpclient-3.0.1.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build/ivy/lib/Hadoop-Core/common/commons-logging-1.0.4.jar:/grid/0/dev/tsz-c2/Hadoop_0.21.0-SNAPSHOT/bin/../build/ivy/lib/Hadoop-Core/common/comm


> hadoop classpath is too long
> ----------------------------
>
>                 Key: HADOOP-6368
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6368
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.21.0
>            Reporter: Tsz Wo (Nicholas), SZE
>
> After combined common, hdfs and mapreduce, the hadoop classpath in my machine has more
than 10000 characters.  There are also redundant jars in the classpath.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message