accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-1472) MiniAccumulo cluster improperly configures classpaths
Date Mon, 03 Feb 2014 16:04:09 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13889577#comment-13889577
] 

Josh Elser commented on ACCUMULO-1472:
--------------------------------------

The {{null/lib/*.jar}} in the {{general.classpaths}} value was bugging me. Turns out there's
another small issue there -- we reference ACCUMULO_HOME from the current environment, but
that value doesn't necessarily exist yet (if it does, it isn't the right one). When we exec
out to the Accumulo processes, that where we turn the File from the MiniAccumuloConfig into
the ACCUMULO_HOME env variable.

> MiniAccumulo cluster improperly configures classpaths
> -----------------------------------------------------
>
>                 Key: ACCUMULO-1472
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1472
>             Project: Accumulo
>          Issue Type: Bug
>          Components: mini
>    Affects Versions: 1.5.0
>            Reporter: Keith Turner
>            Assignee: Josh Elser
>            Priority: Trivial
>             Fix For: 1.5.1, 1.6.0
>
>
> I used instamo to run an Accumulo shell against MiniAccumuloCluster.  I ran the classpath
command and noticed it was referencing the hadoop jars from my local hadoop install.  It was
also referencing the hadoop jars from maven.
> I looked at the accumulo-site.xml generated MAC and saw the following :
> {noformat}
> <property><name>general.classpaths</name><value>null/lib/.*.jar,$ZOOKEEPER_HOME/zookeeper[^.].*.jar,$HADOOP_HOME/[^.].*.jar,$HADOOP_HOME/lib/[^.].*.jar,$HADOOP_PREFIX/share/hadoop/common/.*.jar,$HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,$HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,$HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar</value></property>
> {noformat}
> I think this prop should be empty.  Below is what I saw when running classpath.  Also,
I do not think it should print the warning.
> {noformat}
> root@miniInstance !METADATA> classpath
> [main] WARN  org.apache.accumulo.start.classloader.vfs.AccumuloVFSClassLoader  - ignoring
classpath entry file:///lib/ext/[^.].*.jar
> Level 1: Java System Classloader (loads Java system resources) URL classpath items are:
>     file:/home/kturner/software/jdk1.6.0_33/jre/lib/ext/dnsns.jar
>     file:/home/kturner/software/jdk1.6.0_33/jre/lib/ext/localedata.jar
>     file:/home/kturner/software/jdk1.6.0_33/jre/lib/ext/sunpkcs11.jar
>     file:/home/kturner/software/jdk1.6.0_33/jre/lib/ext/sunjce_provider.jar
> Level 2: Java Classloader (loads everything defined by java classpath) URL classpath
items are:
>     file:/home/kturner/instamo-example/target/classes/
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-core/1.5.0/accumulo-core-1.5.0.jar
>     file:/home/kturner/.m2/repository/com/beust/jcommander/1.30/jcommander-1.30.jar
>     file:/home/kturner/.m2/repository/jline/jline/1.0/jline-1.0.jar
>     file:/home/kturner/.m2/repository/org/apache/commons/commons-vfs2/2.0/commons-vfs2-2.0.jar
>     file:/home/kturner/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar
>     file:/home/kturner/.m2/repository/org/apache/maven/scm/maven-scm-api/1.4/maven-scm-api-1.4.jar
>     file:/home/kturner/.m2/repository/org/codehaus/plexus/plexus-utils/1.5.6/plexus-utils-1.5.6.jar
>     file:/home/kturner/.m2/repository/org/apache/maven/scm/maven-scm-provider-svnexe/1.4/maven-scm-provider-svnexe-1.4.jar
>     file:/home/kturner/.m2/repository/org/apache/maven/scm/maven-scm-provider-svn-commons/1.4/maven-scm-provider-svn-commons-1.4.jar
>     file:/home/kturner/.m2/repository/regexp/regexp/1.3/regexp-1.3.jar
>     file:/home/kturner/.m2/repository/org/apache/thrift/libthrift/0.9.0/libthrift-0.9.0.jar
>     file:/home/kturner/.m2/repository/commons-lang/commons-lang/2.5/commons-lang-2.5.jar
>     file:/home/kturner/.m2/repository/org/apache/httpcomponents/httpclient/4.1.3/httpclient-4.1.3.jar
>     file:/home/kturner/.m2/repository/org/apache/httpcomponents/httpcore/4.1.3/httpcore-4.1.3.jar
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-fate/1.5.0/accumulo-fate-1.5.0.jar
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-server/1.5.0/accumulo-server-1.5.0.jar
>     file:/home/kturner/.m2/repository/com/google/code/gson/gson/2.2.2/gson-2.2.2.jar
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-test/1.5.0/accumulo-test-1.5.0.jar
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-minicluster/1.5.0/accumulo-minicluster-1.5.0.jar
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-start/1.5.0/accumulo-start-1.5.0.jar
>     file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-trace/1.5.0/accumulo-trace-1.5.0.jar
>     file:/home/kturner/.m2/repository/org/apache/zookeeper/zookeeper/3.3.6/zookeeper-3.3.6.jar
>     file:/home/kturner/.m2/repository/log4j/log4j/1.2.15/log4j-1.2.15.jar
>     file:/home/kturner/.m2/repository/javax/mail/mail/1.4/mail-1.4.jar
>     file:/home/kturner/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar
>     file:/home/kturner/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar
>     file:/home/kturner/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar
>     file:/home/kturner/.m2/repository/org/slf4j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar
>     file:/home/kturner/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar
>     file:/home/kturner/.m2/repository/org/apache/hadoop/hadoop-core/1.0.4/hadoop-core-1.0.4.jar
>     file:/home/kturner/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar
>     file:/home/kturner/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar
>     file:/home/kturner/.m2/repository/commons-httpclient/commons-httpclient/3.0.1/commons-httpclient-3.0.1.jar
>     file:/home/kturner/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar
>     file:/home/kturner/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
>     file:/home/kturner/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar
>     file:/home/kturner/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar
>     file:/home/kturner/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar
>     file:/home/kturner/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar
>     file:/home/kturner/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar
>     file:/home/kturner/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
>     file:/home/kturner/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar
>     file:/home/kturner/.m2/repository/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.jar
>     file:/home/kturner/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar
>     file:/home/kturner/.m2/repository/tomcat/jasper-runtime/5.5.12/jasper-runtime-5.5.12.jar
>     file:/home/kturner/.m2/repository/tomcat/jasper-compiler/5.5.12/jasper-compiler-5.5.12.jar
>     file:/home/kturner/.m2/repository/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar
>     file:/home/kturner/.m2/repository/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar
>     file:/home/kturner/.m2/repository/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar
>     file:/home/kturner/.m2/repository/ant/ant/1.6.5/ant-1.6.5.jar
>     file:/home/kturner/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar
>     file:/home/kturner/.m2/repository/net/java/dev/jets3t/jets3t/0.7.1/jets3t-0.7.1.jar
>     file:/home/kturner/.m2/repository/net/sf/kosmosfs/kfs/0.3/kfs-0.3.jar
>     file:/home/kturner/.m2/repository/hsqldb/hsqldb/1.8.0.10/hsqldb-1.8.0.10.jar
>     file:/home/kturner/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar
>     file:/home/kturner/.m2/repository/org/eclipse/jdt/core/3.1.1/core-3.1.1.jar
>     file:/home/kturner/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.jar
>     file:/home/kturner/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.jar
> Level 3: Accumulo Classloader (loads everything defined by general.classpaths) URL classpath
items are:
>     file:/home/kturner/software/zookeeper/zookeeper-3.3.5.jar
>     file:/home/kturner/software/hadoop/hadoop-client-1.0.3.jar
>     file:/home/kturner/software/hadoop/hadoop-ant-1.0.3.jar
>     file:/home/kturner/software/hadoop/hadoop-core-1.0.3.jar
>     file:/home/kturner/software/hadoop/hadoop-test-1.0.3.jar
>     file:/home/kturner/software/hadoop/hadoop-tools-1.0.3.jar
>     file:/home/kturner/software/hadoop/hadoop-minicluster-1.0.3.jar
>     file:/home/kturner/software/hadoop/hadoop-examples-1.0.3.jar
>     file:/home/kturner/software/hadoop/lib/commons-collections-3.2.1.jar
>     file:/home/kturner/software/hadoop/lib/commons-beanutils-1.7.0.jar
>     file:/home/kturner/software/hadoop/lib/jasper-compiler-5.5.12.jar
>     file:/home/kturner/software/hadoop/lib/jasper-runtime-5.5.12.jar
>     file:/home/kturner/software/hadoop/lib/servlet-api-2.5-20081211.jar
>     file:/home/kturner/software/hadoop/lib/slf4j-log4j12-1.4.3.jar
>     file:/home/kturner/software/hadoop/lib/aspectjrt-1.6.5.jar
>     file:/home/kturner/software/hadoop/lib/commons-logging-api-1.0.4.jar
>     file:/home/kturner/software/hadoop/lib/mockito-all-1.8.5.jar
>     file:/home/kturner/software/hadoop/lib/jackson-core-asl-1.8.8.jar
>     file:/home/kturner/software/hadoop/lib/jsch-0.1.42.jar
>     file:/home/kturner/software/hadoop/lib/jersey-core-1.8.jar
>     file:/home/kturner/software/hadoop/lib/hadoop-fairscheduler-1.0.3.jar
>     file:/home/kturner/software/hadoop/lib/kfs-0.2.2.jar
>     file:/home/kturner/software/hadoop/lib/asm-3.2.jar
>     file:/home/kturner/software/hadoop/lib/log4j-1.2.15.jar
>     file:/home/kturner/software/hadoop/lib/jersey-json-1.8.jar
>     file:/home/kturner/software/hadoop/lib/hsqldb-1.8.0.10.jar
>     file:/home/kturner/software/hadoop/lib/jersey-server-1.8.jar
>     file:/home/kturner/software/hadoop/lib/slf4j-api-1.4.3.jar
>     file:/home/kturner/software/hadoop/lib/commons-httpclient-3.0.1.jar
>     file:/home/kturner/software/hadoop/lib/commons-configuration-1.6.jar
>     file:/home/kturner/software/hadoop/lib/junit-4.5.jar
>     file:/home/kturner/software/hadoop/lib/commons-logging-1.1.1.jar
>     file:/home/kturner/software/hadoop/lib/commons-beanutils-core-1.8.0.jar
>     file:/home/kturner/software/hadoop/lib/commons-math-2.1.jar
>     file:/home/kturner/software/hadoop/lib/core-3.1.1.jar
>     file:/home/kturner/software/hadoop/lib/jetty-util-6.1.26.jar
>     file:/home/kturner/software/hadoop/lib/jackson-mapper-asl-1.8.8.jar
>     file:/home/kturner/software/hadoop/lib/hadoop-capacity-scheduler-1.0.3.jar
>     file:/home/kturner/software/hadoop/lib/jets3t-0.6.1.jar
>     file:/home/kturner/software/hadoop/lib/aspectjtools-1.6.5.jar
>     file:/home/kturner/software/hadoop/lib/hadoop-thriftfs-1.0.3.jar
>     file:/home/kturner/software/hadoop/lib/commons-digester-1.8.jar
>     file:/home/kturner/software/hadoop/lib/xmlenc-0.52.jar
>     file:/home/kturner/software/hadoop/lib/jdeb-0.8.jar
>     file:/home/kturner/software/hadoop/lib/commons-daemon-1.0.1.jar
>     file:/home/kturner/software/hadoop/lib/jetty-6.1.26.jar
>     file:/home/kturner/software/hadoop/lib/commons-codec-1.4.jar
>     file:/home/kturner/software/hadoop/lib/commons-el-1.0.jar
>     file:/home/kturner/software/hadoop/lib/commons-io-2.1.jar
>     file:/home/kturner/software/hadoop/lib/commons-cli-1.2.jar
>     file:/home/kturner/software/hadoop/lib/commons-net-1.4.1.jar
>     file:/home/kturner/software/hadoop/lib/oro-2.0.8.jar
>     file:/home/kturner/software/hadoop/lib/commons-lang-2.4.jar
> Level 4: Accumulo Dynamic Classloader (loads everything defined by general.dynamic.classpaths)
VFS classpaths items are:
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message