Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 274D9E1F0 for ; Thu, 29 Nov 2012 10:59:52 +0000 (UTC) Received: (qmail 18193 invoked by uid 500); 29 Nov 2012 10:59:47 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 17900 invoked by uid 500); 29 Nov 2012 10:59:46 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 17860 invoked by uid 99); 29 Nov 2012 10:59:45 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Nov 2012 10:59:45 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [125.215.199.158] (HELO mail.mediator.com.hk) (125.215.199.158) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Nov 2012 10:59:40 +0000 Received: from localhost (localhost [127.0.0.1]) by mail.mediator.com.hk (Postfix) with ESMTP id 9A526A20431 for ; Thu, 29 Nov 2012 19:13:18 +0800 (HKT) X-Virus-Scanned: amavisd-new at mediator.com.hk Received: from mail.mediator.com.hk ([127.0.0.1]) by localhost (mail.mediator.com.hk [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Ywlug3XyBobT; Thu, 29 Nov 2012 19:13:17 +0800 (HKT) Received: from [192.168.0.102] (unknown [192.168.16.10]) by mail.mediator.com.hk (Postfix) with ESMTPSA id 26C61A20429; Thu, 29 Nov 2012 19:13:17 +0800 (HKT) Subject: Re: Failed To Start SecondaryNameNode in Secure Mode Mime-Version: 1.0 (Apple Message framework v1085) Content-Type: multipart/alternative; boundary=Apple-Mail-26-69918543 From: "ac@hsk.hk" In-Reply-To: <9DE85E5B-131C-4EE7-A9E8-43F0252557A5@hsk.hk> Date: Thu, 29 Nov 2012 18:59:16 +0800 Cc: "ac@hsk.hk" Message-Id: <666FA621-31F9-41DC-AABB-DE6C0E3F6EAA@hsk.hk> References: <17861B3B-BAF3-4563-B86A-CB882A5F82BE@hsk.hk> <9DE85E5B-131C-4EE7-A9E8-43F0252557A5@hsk.hk> To: user@hadoop.apache.org X-Mailer: Apple Mail (2.1085) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail-26-69918543 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi Since NN and SNN are used in the same server: 1) If i use the default "dfs.secondary.http.address", i.e. 0.0.0.0:50090 = (commented out dfs.secondary.http.address property) I got : Exception in thread "main" = java.lang.IllegalArgumentException: Does not contain a valid host:port = authority: 0.0.0.0:0.0.0.0:0 2) If I add the following to hdfs-site.xml =20 dfs.secondary.http.address =20 m146:50090 I got: Exception in thread "main" = java.lang.IllegalArgumentException: Does not contain a valid host:port = authority: m146:m146:0 in both cases, the port was not 50090, very strange. Thanks AC On 29 Nov 2012, at 5:46 PM, ac@hsk.hk wrote: > Hi, >=20 > I found this error message in the .out file after trying to start = SecondaryNameNode in secure mode >=20 > Exception in thread "main" java.lang.IllegalArgumentException: Does = not contain a valid host:port authority: m146:m146:0 > at = org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:162) > at = org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:128) > at = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$1.run(SecondaryNa= meNode.java:205) > at = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$1.run(SecondaryNa= meNode.java:190) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at = org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.= java:1121) > at = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.initialize(Second= aryNameNode.java:190) > at = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.(SecondaryN= ameNode.java:129) > at = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNam= eNode.java:567) >=20 > version: 1.0.4 > distributed cluster: true > os: ubuntu 12.04 > server: also the server of NameNode, the NameNode is already started = in secure mode >=20 > QUESTION: It seems that it is related to configuration but what does = this error mean and where I would be wrong? Please help! >=20 > Thanks > ac >=20 >=20 >=20 >=20 > P.S. > below is form the .log file >=20 > 2012-11-29 17:42:16,687 INFO = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: STARTUP_MSG:=20= > /************************************************************ > STARTUP_MSG: Starting SecondaryNameNode > STARTUP_MSG: host =3D m146...... > STARTUP_MSG: args =3D [] > STARTUP_MSG: version =3D 1.0.4 > STARTUP_MSG: build =3D = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r = 1393290; compiled by 'hortonfo' on Wed Oct 3 05:13:58 UTC 2012 > ************************************************************/ > 2012-11-29 17:42:17,174 INFO = org.apache.hadoop.security.UserGroupInformation: Login successful for = user hduser/m146...... > 2012-11-29 17:42:17,405 INFO = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Starting web = server as: host/m146....... > 2012-11-29 17:42:17,434 INFO org.mortbay.log: Logging to = org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via = org.mortbay.log.Slf4jLog > 2012-11-29 17:42:17,468 INFO org.apache.hadoop.http.HttpServer: Added = global filtersafety = (class=3Dorg.apache.hadoop.http.HttpServer$QuotingInputFilter) > 2012-11-29 17:42:17,473 INFO = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: SHUTDOWN_MSG:=20= > /************************************************************ > SHUTDOWN_MSG: Shutting down SecondaryNameNode at m146....... > ************************************************************/ --Apple-Mail-26-69918543 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii

     I got = : Exception in thread "main" java.lang.IllegalArgumentException: = Does not contain a valid host:port authority: 0.0.0.0:0.0.0.0:0


2) If I add the following to hdfs-site.xml =  
    =  <property>
    =  <name>dfs.secondary.http.address</name> =   
    =  <value>m146:50090</value>
    =  </property>

    I = got: Exception in thread "main" java.lang.IllegalArgumentException: = Does not contain a valid host:port authority: m146:m146:0

in both cases, the = port was not 50090, very = strange.



Thanks
AC


On 29 Nov 2012, at 5:46 PM, = ac@hsk.hk wrote:

Does not contain a valid host:port authority: = m146:m146:0
        at = org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:162)
        at = org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:128)
        at = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$1.run(SecondaryNa= meNode.java:205)
        at = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$1.run(SecondaryNa= meNode.java:190)
        at = java.security.AccessController.doPrivileged(Native = Method)
        at = javax.security.auth.Subject.doAs(Subject.java:396)
  =       at = org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.= java:1121)
        at = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.initialize(Second= aryNameNode.java:190)
        at = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.<init>(Seco= ndaryNameNode.java:129)
        at = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNam= eNode.java:567)

version: = 1.0.4
distributed cluster: true
os: ubuntu = 12.04
server: also the server of NameNode, the NameNode is = already started in secure mode

QUESTION:   = It seems that it is related to configuration but what does this = error mean and where I would be wrong?  Please = help!

Thanks
ac




P.S.
below is = form the .log file

2012-11-29 17:42:16,687 = INFO org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: = STARTUP_MSG: 
/********************************************= ****************
STARTUP_MSG: Starting = SecondaryNameNode
STARTUP_MSG:   host =3D = m146......
STARTUP_MSG:   args =3D = []
STARTUP_MSG:   version =3D = 1.0.4
STARTUP_MSG:   build =3D https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 = -r 1393290; compiled by 'hortonfo' on Wed Oct  3 05:13:58 UTC = 2012
***********************************************************= */
2012-11-29 17:42:17,174 INFO = org.apache.hadoop.security.UserGroupInformation: Login successful for = user hduser/m146......
2012-11-29 17:42:17,405 INFO = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Starting web = server as: host/m146.......
2012-11-29 17:42:17,434 INFO = org.mortbay.log: Logging to = org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via = org.mortbay.log.Slf4jLog
2012-11-29 17:42:17,468 INFO = org.apache.hadoop.http.HttpServer: Added global filtersafety = (class=3Dorg.apache.hadoop.http.HttpServer$QuotingInputFilter)
2= 012-11-29 17:42:17,473 INFO = org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: = SHUTDOWN_MSG: 
/*******************************************= *****************
SHUTDOWN_MSG: Shutting down = SecondaryNameNode at = m146.......
****************************************************= ********/

= --Apple-Mail-26-69918543--