hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tao Jie (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-13214) RBF: Configuration on Router conflicts with client side configuration
Date Thu, 01 Mar 2018 13:53:00 GMT
Tao Jie created HDFS-13214:
------------------------------

             Summary: RBF: Configuration on Router conflicts with client side configuration
                 Key: HDFS-13214
                 URL: https://issues.apache.org/jira/browse/HDFS-13214
             Project: Hadoop HDFS
          Issue Type: Bug
    Affects Versions: 2.9.0
            Reporter: Tao Jie


In a typical router-based federation cluster, hdfs-site.xml is supposed to be:
{code}
<property>
    <name>dfs.nameservices</name>
    <value>ns1,ns2,ns-fed</value>
  </property>
  <property>
    <name>dfs.ha.namenodes.ns-fed</name>
    <value>r1,r2</value>
  </property>
  <property>
    <name>dfs.namenode.rpc-address.ns1</name>
    <value>host1:8020</value>
  </property>
  <property>
    <name>dfs.namenode.rpc-address.ns2</name>
    <value>host2:8020</value>
  </property>
  <property>
    <name>dfs.namenode.rpc-address.ns-fed.r1</name>
    <value>host1:8888</value>
  </property>
  <property>
    <name>dfs.namenode.rpc-address.ns-fed.r2</name>
    <value>host2:8888</value>
  </property>
{code}
{{dfs.ha.namenodes.ns-fed}} here is used for client to access the Router. However with this
configuration on server node, Router fails to start with error:
{code}
org.apache.hadoop.HadoopIllegalArgumentException: Configuration has multiple addresses that
match local node's address. Please configure the system with dfs.nameservice.id and dfs.ha.namenode.id
        at org.apache.hadoop.hdfs.DFSUtil.getSuffixIDs(DFSUtil.java:1198)
        at org.apache.hadoop.hdfs.DFSUtil.getNameServiceId(DFSUtil.java:1131)
        at org.apache.hadoop.hdfs.DFSUtil.getNamenodeNameServiceId(DFSUtil.java:1086)
        at org.apache.hadoop.hdfs.server.federation.router.Router.createLocalNamenodeHearbeatService(Router.java:466)
        at org.apache.hadoop.hdfs.server.federation.router.Router.createNamenodeHearbeatServices(Router.java:423)
        at org.apache.hadoop.hdfs.server.federation.router.Router.serviceInit(Router.java:199)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.hadoop.hdfs.server.federation.router.DFSRouter.main(DFSRouter.java:69)
2018-03-01 18:05:56,208 ERROR org.apache.hadoop.hdfs.server.federation.router.DFSRouter: Failed
to start router
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message