accumulo-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject svn commit: r1458253 - in /accumulo/trunk: ./ assemble/ conf/examples/vfs-classloader/ core/ examples/ fate/src/main/java/org/apache/accumulo/fate/ fate/src/main/java/org/apache/accumulo/fate/zookeeper/ server/ src/
Date Tue, 19 Mar 2013 12:47:20 GMT
Author: ecn
Date: Tue Mar 19 12:47:19 2013
New Revision: 1458253

ACCUMULO-1185 Applying Dave Marion's patch to document how to configure the vfs classloader

    accumulo/trunk/   (props changed)
    accumulo/trunk/assemble/   (props changed)
    accumulo/trunk/core/   (props changed)
    accumulo/trunk/examples/   (props changed)
    accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/   (props changed)
 (props changed)
    accumulo/trunk/server/   (props changed)
    accumulo/trunk/src/   (props changed)

Propchange: accumulo/trunk/
  Merged /accumulo/branches/1.5:r1458251

Propchange: accumulo/trunk/assemble/
  Merged /accumulo/branches/1.5/assemble:r1458251

Modified: accumulo/trunk/conf/examples/vfs-classloader/accumulo-site.xml
--- accumulo/trunk/conf/examples/vfs-classloader/accumulo-site.xml (original)
+++ accumulo/trunk/conf/examples/vfs-classloader/accumulo-site.xml Tue Mar 19 12:47:19 2013
@@ -27,7 +27,7 @@
     <description>A secret unique to a given instance that all servers must know in
order to communicate with one another.
-      Change it before initialization. To change it later use ./bin/accumulo org.apache.accumulo.server.util.ChangeSecret
[oldpasswd] [newpasswd],
+      Change it before initialization. To change it later use ./bin/accumulo org.apache.accumulo.server.util.ChangeSecret
--old [oldpasswd] --new [newpasswd],
       and then update this file.
@@ -70,6 +70,13 @@
+    <!--
+       Add the following for hadoop-2.0
+       $HADOOP_PREFIX/share/hadoop/common/.*.jar,
+       $HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,
+       $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
+       $HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar,
+    -->
@@ -88,29 +95,57 @@
   <!-- VFS ClassLoader Settings -->
-  <property>
-    <name>classloader.vfs.enabled</name>
-    <value>true</value>
-    <description>set to true to enable the vfs classloader. If not enabled (default=false),
then the old classloader is used</description>
+  <!--
+  At a minimum the general.vfs.classpath property must be set. After this is set in the configuration,
the bin/ can be
+  run to move the jars into the required locations. All other properties are optional. This
example demonstrates using hdfs, other
+  protocols supported by the Apache Commons VFS software can be used but are not demonstrated
here. If the accumulo-site.xml changes
+  after initial configuration, you will want to copy the file to all of the slave hosts.

+  -->
+  <property>
+    <name>general.vfs.classpaths</name>
+    <value>hdfs://localhost:8020/accumulo/system-classpath</value>
+    <description>Configuration for a system level vfs classloader.  Accumulo jars can
be configured here and loaded out of HDFS.</description>
-    <name>classloader.vfs.context.classpath.system</name>
-    <value>hdfs://localhost:8020/accumulo/classpath</value>
-    <description>location of the jars for the default (system) context</description>
+    <name>general.vfs.cache.dir</name>
+    <value>/tmp</value>
+    <description>Directory to use for the vfs cache. The cache will keep a soft reference
to all of the classes loaded in the VM. 
+    This should be on local disk on each node with sufficient space. It defaults to /tmp
and will use a directory with the 
+    format "accumulo-vfs-cache-" + System.getProperty("", "nouser")
+    </description>
+  <!--
+  Properties in this category define a classpath for a named context. These properties start
with the category prefix, followed by a context name.
+  The value is a comma seperated list of URIs. Supports full regex on filename alone. For
+  general.vfs.context.classpath.cx1=hdfs://nn1:9902/mylibdir/*.jar.  You can enable post
delegation for a context, which will load classes from 
+  the context first instead of the parent first.  Do this by setting general.vfs.context.classpath.<name>.delegation=post,
where <name> 
+  is your context name.  If delegation is not specified, it defaults to loading from parent
classloader first.
+  -->
-    <name>classloader.vfs.context.names</name>
-    <value>application1</value>
-    <description>list of context names</description>
+    <name>general.vfs.context.classpath.application1</name>
+    <value>hdfs://localhost:8020/application1/classpath/*.jar</value>
+    <description>classpath for the application1 context</description>
-    <name>classloader.vfs.context.classpath.application1</name>
-    <value>hdfs://localhost:8020/application1/classpath</value>
-    <description>classpath for the application1 context</description>
+    <name>general.vfs.context.classpath.application1.delegation=post</name>
+    <value>hdfs://localhost:8020/application1/classpath/*.jar</value>
+    <description>classpath for the application1 context, but the classloader parent
delegation model is inverted to prefer the jars/classes in this directory</description>
+  <property>
+    <name>general.vfs.context.classpath.application2</name>
+    <value>hdfs://localhost:8020/application1/classpath/*.jar,hdfs://localhost:8020/application2/classpath/*.jar</value>
+    <description>classpath for the application2 context, includes all of the jars in
app1 context</description>
+  </property>
+  <!--
+  Once classpath context are configured, tables can be configured in the shell to use them
via the table.classpath.context property.
+  For example, all of the tables related to application1 would have the context.classpath
property set to 'application1'. 
+  -->

Propchange: accumulo/trunk/core/
  Merged /accumulo/branches/1.5/core:r1458251

Propchange: accumulo/trunk/examples/
  Merged /accumulo/branches/1.5/examples:r1458251

Propchange: accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/
  Merged /accumulo/branches/1.5/fate/src/main/java/org/apache/accumulo/fate/

Propchange: accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/
  Merged /accumulo/branches/1.5/fate/src/main/java/org/apache/accumulo/fate/zookeeper/

Propchange: accumulo/trunk/server/
  Merged /accumulo/branches/1.5/server:r1458251

Propchange: accumulo/trunk/src/
  Merged /accumulo/branches/1.5/src:r1458251

View raw message