accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-1472) MiniAccumulo cluster improperly configures classpaths
Date Mon, 03 Feb 2014 20:49:07 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13889900#comment-13889900
] 

ASF subversion and git services commented on ACCUMULO-1472:
-----------------------------------------------------------

Commit 748276b5b4cd91cd860082a758ec55d013013c9e in branch refs/heads/1.4.5-SNAPSHOT from [~elserj]
[ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=748276b ]

ACCUMULO-1472 Rely solely on classpath from the invoking application and prevent extra warnings
from being logged.

Create lib/ext so that the classloader doesn't WARN. Since the applications
will inherit the classpath from the invoking application, we shouldn't try
to pull jars from environment vars (as they will rarely be correct) and add
them to the classpath too. Sadly, we must set *something*, otherwise the
AccumuloClassLoader will revert back to some default and load things
we don't want.


> MiniAccumulo cluster improperly configures classpaths
> -----------------------------------------------------
>
>                 Key: ACCUMULO-1472
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1472
>             Project: Accumulo
>          Issue Type: Bug
>          Components: mini
>    Affects Versions: 1.5.0
>            Reporter: Keith Turner
>            Assignee: Josh Elser
>            Priority: Trivial
>             Fix For: 1.5.1, 1.6.0
>
>
> I used instamo to run an Accumulo shell against MiniAccumuloCluster.  I ran the classpath
command and noticed it was referencing the hadoop jars from my local hadoop install.  It was
also referencing the hadoop jars from maven.
> I looked at the accumulo-site.xml generated MAC and saw the following :
> {noformat}
> <property><name>general.classpaths</name><value>null/lib/.*.jar,$ZOOKEEPER_HOME/zookeeper[^.].*.jar,$HADOOP_HOME/[^.].*.jar,$HADOOP_HOME/lib/[^.].*.jar,$HADOOP_PREFIX/share/hadoop/common/.*.jar,$HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,$HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,$HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar</value></property>
> {noformat}
> I think this prop should be empty.  Below is what I saw when running classpath.  Also,
I do not think it should print the warning.
> {noformat}
> root@miniInstance !METADATA> classpath
> [main] WARN  org.apache.accumulo.start.classloader.vfs.AccumuloVFSClassLoader  - ignoring
classpath entry file:///lib/ext/[^.].*.jar
> Level 1: Java System Classloader (loads Java system resources) URL classpath items are:
>     file:/home/kturner/software/jdk1.6.0_33/jre/lib/ext/dnsns.jar
>     file:/home/kturner/software/jdk1.6.0_33/jre/lib/ext/localedata.jar
>     file:/home/kturner/software/jdk1.6.0_33/jre/lib/ext/sunpkcs11.jar
>     file:/home/kturner/software/jdk1.6.0_33/jre/lib/ext/sunjce_provider.jar
> Level 2: Java Classloader (loads everything defined by java classpath) URL classpath
items are:
>     file:/home/kturner/instamo-example/target/classes/
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-core/1.5.0/accumulo-core-1.5.0.jar
>     file:/home/kturner/.m2/repository/com/beust/jcommander/1.30/jcommander-1.30.jar
>     file:/home/kturner/.m2/repository/jline/jline/1.0/jline-1.0.jar
>     file:/home/kturner/.m2/repository/org/apache/commons/commons-vfs2/2.0/commons-vfs2-2.0.jar
>     file:/home/kturner/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar
>     file:/home/kturner/.m2/repository/org/apache/maven/scm/maven-scm-api/1.4/maven-scm-api-1.4.jar
>     file:/home/kturner/.m2/repository/org/codehaus/plexus/plexus-utils/1.5.6/plexus-utils-1.5.6.jar
>     file:/home/kturner/.m2/repository/org/apache/maven/scm/maven-scm-provider-svnexe/1.4/maven-scm-provider-svnexe-1.4.jar
>     file:/home/kturner/.m2/repository/org/apache/maven/scm/maven-scm-provider-svn-commons/1.4/maven-scm-provider-svn-commons-1.4.jar
>     file:/home/kturner/.m2/repository/regexp/regexp/1.3/regexp-1.3.jar
>     file:/home/kturner/.m2/repository/org/apache/thrift/libthrift/0.9.0/libthrift-0.9.0.jar
>     file:/home/kturner/.m2/repository/commons-lang/commons-lang/2.5/commons-lang-2.5.jar
>     file:/home/kturner/.m2/repository/org/apache/httpcomponents/httpclient/4.1.3/httpclient-4.1.3.jar
>     file:/home/kturner/.m2/repository/org/apache/httpcomponents/httpcore/4.1.3/httpcore-4.1.3.jar
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-fate/1.5.0/accumulo-fate-1.5.0.jar
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-server/1.5.0/accumulo-server-1.5.0.jar
>     file:/home/kturner/.m2/repository/com/google/code/gson/gson/2.2.2/gson-2.2.2.jar
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-test/1.5.0/accumulo-test-1.5.0.jar
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-minicluster/1.5.0/accumulo-minicluster-1.5.0.jar
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-start/1.5.0/accumulo-start-1.5.0.jar
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-trace/1.5.0/accumulo-trace-1.5.0.jar
>     file:/home/kturner/.m2/repository/org/apache/zookeeper/zookeeper/3.3.6/zookeeper-3.3.6.jar
>     file:/home/kturner/.m2/repository/log4j/log4j/1.2.15/log4j-1.2.15.jar
>     file:/home/kturner/.m2/repository/javax/mail/mail/1.4/mail-1.4.jar
>     file:/home/kturner/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar
>     file:/home/kturner/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar
>     file:/home/kturner/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar
>     file:/home/kturner/.m2/repository/org/slf4j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar
>     file:/home/kturner/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar
>     file:/home/kturner/.m2/repository/org/apache/hadoop/hadoop-core/1.0.4/hadoop-core-1.0.4.jar
>     file:/home/kturner/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar
>     file:/home/kturner/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar
>     file:/home/kturner/.m2/repository/commons-httpclient/commons-httpclient/3.0.1/commons-httpclient-3.0.1.jar
>     file:/home/kturner/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar
>     file:/home/kturner/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
>     file:/home/kturner/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar
>     file:/home/kturner/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar
>     file:/home/kturner/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar
>     file:/home/kturner/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar
>     file:/home/kturner/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar
>     file:/home/kturner/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
>     file:/home/kturner/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar
>     file:/home/kturner/.m2/repository/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.jar
>     file:/home/kturner/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar
>     file:/home/kturner/.m2/repository/tomcat/jasper-runtime/5.5.12/jasper-runtime-5.5.12.jar
>     file:/home/kturner/.m2/repository/tomcat/jasper-compiler/5.5.12/jasper-compiler-5.5.12.jar
>     file:/home/kturner/.m2/repository/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar
>     file:/home/kturner/.m2/repository/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar
>     file:/home/kturner/.m2/repository/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar
>     file:/home/kturner/.m2/repository/ant/ant/1.6.5/ant-1.6.5.jar
>     file:/home/kturner/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar
>     file:/home/kturner/.m2/repository/net/java/dev/jets3t/jets3t/0.7.1/jets3t-0.7.1.jar
>     file:/home/kturner/.m2/repository/net/sf/kosmosfs/kfs/0.3/kfs-0.3.jar
>     file:/home/kturner/.m2/repository/hsqldb/hsqldb/1.8.0.10/hsqldb-1.8.0.10.jar
>     file:/home/kturner/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar
>     file:/home/kturner/.m2/repository/org/eclipse/jdt/core/3.1.1/core-3.1.1.jar
>     file:/home/kturner/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.jar
>     file:/home/kturner/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.jar
> Level 3: Accumulo Classloader (loads everything defined by general.classpaths) URL classpath
items are:
>     file:/home/kturner/software/zookeeper/zookeeper-3.3.5.jar
>     file:/home/kturner/software/hadoop/hadoop-client-1.0.3.jar
>     file:/home/kturner/software/hadoop/hadoop-ant-1.0.3.jar
>     file:/home/kturner/software/hadoop/hadoop-core-1.0.3.jar
>     file:/home/kturner/software/hadoop/hadoop-test-1.0.3.jar
>     file:/home/kturner/software/hadoop/hadoop-tools-1.0.3.jar
>     file:/home/kturner/software/hadoop/hadoop-minicluster-1.0.3.jar
>     file:/home/kturner/software/hadoop/hadoop-examples-1.0.3.jar
>     file:/home/kturner/software/hadoop/lib/commons-collections-3.2.1.jar
>     file:/home/kturner/software/hadoop/lib/commons-beanutils-1.7.0.jar
>     file:/home/kturner/software/hadoop/lib/jasper-compiler-5.5.12.jar
>     file:/home/kturner/software/hadoop/lib/jasper-runtime-5.5.12.jar
>     file:/home/kturner/software/hadoop/lib/servlet-api-2.5-20081211.jar
>     file:/home/kturner/software/hadoop/lib/slf4j-log4j12-1.4.3.jar
>     file:/home/kturner/software/hadoop/lib/aspectjrt-1.6.5.jar
>     file:/home/kturner/software/hadoop/lib/commons-logging-api-1.0.4.jar
>     file:/home/kturner/software/hadoop/lib/mockito-all-1.8.5.jar
>     file:/home/kturner/software/hadoop/lib/jackson-core-asl-1.8.8.jar
>     file:/home/kturner/software/hadoop/lib/jsch-0.1.42.jar
>     file:/home/kturner/software/hadoop/lib/jersey-core-1.8.jar
>     file:/home/kturner/software/hadoop/lib/hadoop-fairscheduler-1.0.3.jar
>     file:/home/kturner/software/hadoop/lib/kfs-0.2.2.jar
>     file:/home/kturner/software/hadoop/lib/asm-3.2.jar
>     file:/home/kturner/software/hadoop/lib/log4j-1.2.15.jar
>     file:/home/kturner/software/hadoop/lib/jersey-json-1.8.jar
>     file:/home/kturner/software/hadoop/lib/hsqldb-1.8.0.10.jar
>     file:/home/kturner/software/hadoop/lib/jersey-server-1.8.jar
>     file:/home/kturner/software/hadoop/lib/slf4j-api-1.4.3.jar
>     file:/home/kturner/software/hadoop/lib/commons-httpclient-3.0.1.jar
>     file:/home/kturner/software/hadoop/lib/commons-configuration-1.6.jar
>     file:/home/kturner/software/hadoop/lib/junit-4.5.jar
>     file:/home/kturner/software/hadoop/lib/commons-logging-1.1.1.jar
>     file:/home/kturner/software/hadoop/lib/commons-beanutils-core-1.8.0.jar
>     file:/home/kturner/software/hadoop/lib/commons-math-2.1.jar
>     file:/home/kturner/software/hadoop/lib/core-3.1.1.jar
>     file:/home/kturner/software/hadoop/lib/jetty-util-6.1.26.jar
>     file:/home/kturner/software/hadoop/lib/jackson-mapper-asl-1.8.8.jar
>     file:/home/kturner/software/hadoop/lib/hadoop-capacity-scheduler-1.0.3.jar
>     file:/home/kturner/software/hadoop/lib/jets3t-0.6.1.jar
>     file:/home/kturner/software/hadoop/lib/aspectjtools-1.6.5.jar
>     file:/home/kturner/software/hadoop/lib/hadoop-thriftfs-1.0.3.jar
>     file:/home/kturner/software/hadoop/lib/commons-digester-1.8.jar
>     file:/home/kturner/software/hadoop/lib/xmlenc-0.52.jar
>     file:/home/kturner/software/hadoop/lib/jdeb-0.8.jar
>     file:/home/kturner/software/hadoop/lib/commons-daemon-1.0.1.jar
>     file:/home/kturner/software/hadoop/lib/jetty-6.1.26.jar
>     file:/home/kturner/software/hadoop/lib/commons-codec-1.4.jar
>     file:/home/kturner/software/hadoop/lib/commons-el-1.0.jar
>     file:/home/kturner/software/hadoop/lib/commons-io-2.1.jar
>     file:/home/kturner/software/hadoop/lib/commons-cli-1.2.jar
>     file:/home/kturner/software/hadoop/lib/commons-net-1.4.1.jar
>     file:/home/kturner/software/hadoop/lib/oro-2.0.8.jar
>     file:/home/kturner/software/hadoop/lib/commons-lang-2.4.jar
> Level 4: Accumulo Dynamic Classloader (loads everything defined by general.dynamic.classpaths)
VFS classpaths items are:
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message