accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-1747) ServerConstants.getBaseDirs() use fs default name, not instance.dfs.uri
Date Wed, 02 Oct 2013 20:51:41 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-1747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784413#comment-13784413
] 

Steve Loughran commented on ACCUMULO-1747:
------------------------------------------

generated site file, has both the 1.x and the (new, changed ) property for the default fs:
{code}
<?xml version="1.0" encoding="UTF-8" standalone="no"?><configuration>
<property><name>trace.user</name><value>root</value><source>file:/Users/stevel/.hoya/cluster/TestAccM1T0/original/accumulo-site.xml</source></property>
<property><name>instance.secret</name><value>d4483896-76a7-42a2-a0ad-cf93f44d5305</value><source>programatically</source></property>
<property><name>tserver.memory.maps.native.enabled</name><value>false</value><source>file:/Users/stevel/.hoya/cluster/TestAccM1T0/original/accumulo-site.xml</source></property>
<property><name>tserver.memory.maps.max</name><value>80M</value><source>file:/Users/stevel/.hoya/cluster/TestAccM1T0/original/accumulo-site.xml</source></property>
<property><name>tserver.sort.buffer.size</name><value>50M</value><source>file:/Users/stevel/.hoya/cluster/TestAccM1T0/original/accumulo-site.xml</source></property>
<property><name>logger.dir.walog</name><value>walogs</value><source>file:/Users/stevel/.hoya/cluster/TestAccM1T0/original/accumulo-site.xml</source></property>
<property><name>instance.dfs.uri</name><value>file:/</value><source>programatically</source></property>
<property><name>tserver.walog.max.size</name><value>100M</value><source>file:/Users/stevel/.hoya/cluster/TestAccM1T0/original/accumulo-site.xml</source></property>
<property><name>monitor.port.client</name><value>50095</value><source>programatically</source></property>
<property><name>hoya.template.origin</name><value>file:/Users/stevel/.hoya/cluster/TestAccM1T0/original/accumulo-site.xml</value><source>programatically</source></property>
<property><name>trace.token.property.password</name><value>secret</value><source>file:/Users/stevel/.hoya/cluster/TestAccM1T0/original/accumulo-site.xml</source></property>
<property><name>instance.zookeeper.host</name><value>127.0.0.1:64731</value><source>programatically</source></property>
<property><name>instance.dfs.dir</name><value>/Users/stevel/.hoya/cluster/TestAccM1T0/database</value><source>programatically</source></property>
<property><name>tserver.cache.index.size</name><value>20M</value><source>file:/Users/stevel/.hoya/cluster/TestAccM1T0/original/accumulo-site.xml</source></property>
<property><name>master.port.client</name><value>9999</value><source>programatically</source></property>
<property><name>fs.defaultFS</name><value>file:///</value><source>programatically</source></property>
<property><name>tserver.cache.data.size</name><value>7M</value><source>file:/Users/stevel/.hoya/cluster/TestAccM1T0/original/accumulo-site.xml</source></property>
<property><name>trace.port.client</name><value>0</value><source>programatically</source></property>
<property><name>general.classpaths</name><value>
      $ACCUMULO_HOME/lib/accumulo-server.jar,
      $ACCUMULO_HOME/lib/accumulo-core.jar,
      $ACCUMULO_HOME/lib/accumulo-start.jar,
      $ACCUMULO_HOME/lib/accumulo-fate.jar,
      $ACCUMULO_HOME/lib/accumulo-proxy.jar,
      $ACCUMULO_HOME/lib/[^.].*.jar,
      $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
      $HADOOP_CONF_DIR,
      $HADOOP_PREFIX/[^.].*.jar,
      $HADOOP_PREFIX/lib/[^.].*.jar,
      $HADOOP_PREFIX/share/hadoop/common/.*.jar,
      $HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,
      $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
      $HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar,
      $HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
    </value><source>file:/Users/stevel/.hoya/cluster/TestAccM1T0/original/accumulo-site.xml</source></property>
<property><name>fs.default.name</name><value>file:///</value></property>
{code}
It does look like I'm not using file:/// as the full URI, but its moot: ServerConstants doesn't
use the instance uri:
{code}
hadoopConfig.get("fs.default.name")
{code}
As to why the FS settings aren't being picked up, this test used a core-site.xml pointing
to hdfs://local:9000 -which got picked up instead of the site.xml value

-steve

>  ServerConstants.getBaseDirs() use fs default name, not instance.dfs.uri
> ------------------------------------------------------------------------
>
>                 Key: ACCUMULO-1747
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1747
>             Project: Accumulo
>          Issue Type: Bug
>          Components: start
>    Affects Versions: 1.6.0
>            Reporter: Steve Loughran
>
> I've been trying to track down why I'm seeing connection refused to port 9000 in {{accumulo
init}} -looks to me like
> 2013-10-02 19:04:12,600 [util.Initialize] INFO : Hadoop Filesystem is file:/
> 2013-10-02 19:04:12,678 [Configuration.deprecation] INFO : fs.default.name is deprecated.
Instead, use fs.defaultFS
> 2013-10-02 19:04:12,678 [util.Initialize] INFO : Accumulo data dirs are [hdfs://localhost:9000/Users/stevel/.hoya/cluster/TestAcc
> Initialize is picking up instance.dfs.uri value, but the {{ServerConstants.getBaseDirs()}}
is picking up the default FS -not even from accumulo-site.xml by the look of things, so fails
to work except when instance.dfs.uri==fs.default.name



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message