accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keith Turner (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (ACCUMULO-2044) Accumulo fails when instance.volumes and fs.default.name are disjoint
Date Mon, 13 Jan 2014 21:00:57 GMT

     [ https://issues.apache.org/jira/browse/ACCUMULO-2044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Keith Turner resolved ACCUMULO-2044.
------------------------------------

    Resolution: Fixed

> Accumulo fails when instance.volumes and fs.default.name are disjoint
> ---------------------------------------------------------------------
>
>                 Key: ACCUMULO-2044
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2044
>             Project: Accumulo
>          Issue Type: Sub-task
>          Components: master, tserver
>            Reporter: Keith Turner
>            Assignee: Keith Turner
>             Fix For: 1.6.0
>
>         Attachments: ACCUMULO-2044-1.patch
>
>
> In the hadoop core-site.xml I had the following.
> {noformat}
>   <property>
>     <name>fs.default.name</name>
>     <value>viewfs:///</value>
>   </property>
>   <property>
>     <name>fs.viewfs.mounttable.default.link./nn1</name>
>     <value>hdfs://ip-10-1-3-10:9000</value>
>   </property>
>   <property>
>     <name>fs.viewfs.mounttable.default.link./nn2</name>
>     <value>hdfs://ip-10-1-3-11:9000</value>
>   </property>
> {noformat}
> In accumulo-site.xml, I had the following.
> {noformat}
>   <property>
>     <name>instance.volumes</name>
>     <value>hdfs://ip-10-1-3-10:9000,hdfs://ip-10-1-3-11</value>
>   </property>
> {noformat}
> When I tried to initialize accumulo I saw the following error.  I think the problem is
ZooUtil.getInstanceIDFromHdfs() just gets the default filesystem.  
> {noformat}
> java.lang.IllegalArgumentException: Wrong FS: hdfs://ip-10-1-3-10:9000/accumulo/instance_id,
expected: viewfs:/
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:642)
> 	at org.apache.hadoop.fs.viewfs.ViewFileSystem.getUriPath(ViewFileSystem.java:113)
> 	at org.apache.hadoop.fs.viewfs.ViewFileSystem.listStatus(ViewFileSystem.java:363)
> 	at org.apache.accumulo.core.zookeeper.ZooUtil.getInstanceIDFromHdfs(ZooUtil.java:53)
> 	at org.apache.accumulo.server.client.HdfsZooInstance._getInstanceID(HdfsZooInstance.java:125)
> 	at org.apache.accumulo.server.client.HdfsZooInstance.getInstanceID(HdfsZooInstance.java:119)
> 	at org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUtil.java:37)
> 	at org.apache.accumulo.server.util.TablePropUtil.getTablePath(TablePropUtil.java:58)
> 	at org.apache.accumulo.server.util.TablePropUtil.setTableProperty(TablePropUtil.java:34)
> 	at org.apache.accumulo.server.init.Initialize.initMetadataConfig(Initialize.java:502)
> 	at org.apache.accumulo.server.init.Initialize.initMetadataConfig(Initialize.java:514)
> 	at org.apache.accumulo.server.init.Initialize.initFileSystem(Initialize.java:273)
> 	at org.apache.accumulo.server.init.Initialize.initialize(Initialize.java:222)
> 	at org.apache.accumulo.server.init.Initialize.doInit(Initialize.java:206)
> 	at org.apache.accumulo.server.init.Initialize.main(Initialize.java:565)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.apache.accumulo.start.Main$1.run(Main.java:137)
> 	at java.lang.Thread.run(Thread.java:744)
> 2013-12-17 20:30:12,370 [init.Initialize] FATAL: Failed to initialize filesystem
> java.io.IOException: java.lang.IllegalArgumentException: Wrong FS: hdfs://ip-10-1-3-10:9000/accumulo/instance_id,
expected: viewfs:/
> 	at org.apache.accumulo.server.init.Initialize.initMetadataConfig(Initialize.java:509)
> 	at org.apache.accumulo.server.init.Initialize.initMetadataConfig(Initialize.java:514)
> 	at org.apache.accumulo.server.init.Initialize.initFileSystem(Initialize.java:273)
> 	at org.apache.accumulo.server.init.Initialize.initialize(Initialize.java:222)
> 	at org.apache.accumulo.server.init.Initialize.doInit(Initialize.java:206)
> 	at org.apache.accumulo.server.init.Initialize.main(Initialize.java:565)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.apache.accumulo.start.Main$1.run(Main.java:137)
> 	at java.lang.Thread.run(Thread.java:744)
> Caused by: java.lang.IllegalArgumentException: Wrong FS: hdfs://ip-10-1-3-10:9000/accumulo/instance_id,
expected: viewfs:/
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:642)
> 	at org.apache.hadoop.fs.viewfs.ViewFileSystem.getUriPath(ViewFileSystem.java:113)
> 	at org.apache.hadoop.fs.viewfs.ViewFileSystem.listStatus(ViewFileSystem.java:363)
> 	at org.apache.accumulo.core.zookeeper.ZooUtil.getInstanceIDFromHdfs(ZooUtil.java:53)
> 	at org.apache.accumulo.server.client.HdfsZooInstance._getInstanceID(HdfsZooInstance.java:125)
> 	at org.apache.accumulo.server.client.HdfsZooInstance.getInstanceID(HdfsZooInstance.java:119)
> 	at org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUtil.java:37)
> 	at org.apache.accumulo.server.util.TablePropUtil.getTablePath(TablePropUtil.java:58)
> 	at org.apache.accumulo.server.util.TablePropUtil.setTableProperty(TablePropUtil.java:34)
> 	at org.apache.accumulo.server.init.Initialize.initMetadataConfig(Initialize.java:502)
> 	... 11 more
> {noformat}
> In testing I have done in the past with multiple namenode, the default namenode configured
for hadoop was the same as the first namenode I configured for Accumulo.  In this case the
configs are disjoint, I may see other errors using this configuration.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message