Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 245E8DB02 for ; Wed, 27 Jun 2012 18:15:28 +0000 (UTC) Received: (qmail 13010 invoked by uid 500); 27 Jun 2012 18:15:26 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 12955 invoked by uid 500); 27 Jun 2012 18:15:26 -0000 Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-user@hadoop.apache.org Delivered-To: mailing list hdfs-user@hadoop.apache.org Received: (qmail 12945 invoked by uid 99); 27 Jun 2012 18:15:26 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 27 Jun 2012 18:15:26 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jeffsilverman@google.com designates 209.85.210.48 as permitted sender) Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 27 Jun 2012 18:15:20 +0000 Received: by dadz8 with SMTP id z8so2050798dad.35 for ; Wed, 27 Jun 2012 11:14:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:x-system-of-record; bh=TIlujnl9tQkDSNrBhdOiub6LU7oqGUPAhNgAfVUftFE=; b=Iez1ntw7lJPKMTzCnWZIB67kGc+5FqpUUsVWts3dFN1Rjsyp7Tc5PMOIKjdJmvGRe6 bcgL0P4aaaPJrXYoEVI6lreP+RFiY08bHP4Zv4eoXsx7GZk0sS/WlFz+odNptt/Jpb6E 0QeMhV99PBzQ336Qk0MTpGE3MiVYLtglvhURjJk3Q1vyd7sohCUGEFzveAAAPafp2hbM A/OQGcy9dmQKUkmyNeFYB/KSfXqyhQgtNAFZn3WW2ejqvynRR7O8GoD/LUJgSly0gcsD J9ER3KtGBiA+dwDjbUYPyCj94oZX/eIKoqBjTXAWBzETqJa7CmEo5w2jo7N+ttPehZ9K Og5w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:x-system-of-record:x-gm-message-state; bh=TIlujnl9tQkDSNrBhdOiub6LU7oqGUPAhNgAfVUftFE=; b=fJN45Hyro3ruorE+lphXQceiMXMlOWSJ7gRBuzfWsyBUU2R11Oow3o360nko5HfM8A XBGp2sC0CDOv8ULmT93bEkpKOJu1YjOlBSJD5MVgaXHljNWm7IeoLWTSAyX1SVMG8Tgq s4gWNULMOILcQHF14ISCIGGc+Il9DCbyoEkUHM2iEAtMn0q03mdfYc8VCpOpl2DO3P24 uCToICNadKdxAb8bCIBos6kKbFZLX1H3ccwT5AHGwzrBUvSbbnqcPjd3UUgqM6Ggehf/ xediuiDpYn4LfZnp7qALuvGMK9hIwv7JYOOa+m8mA2BK5rzkpvaHYrATCwLxmCORFVj4 k1xg== Received: by 10.68.226.137 with SMTP id rs9mr65880049pbc.114.1340820898392; Wed, 27 Jun 2012 11:14:58 -0700 (PDT) MIME-Version: 1.0 Received: by 10.68.226.137 with SMTP id rs9mr65880016pbc.114.1340820898038; Wed, 27 Jun 2012 11:14:58 -0700 (PDT) Received: by 10.68.43.42 with HTTP; Wed, 27 Jun 2012 11:14:57 -0700 (PDT) In-Reply-To: References: Date: Wed, 27 Jun 2012 11:14:57 -0700 Message-ID: Subject: Re: Problems starting secondarynamenode in hadoop 1.0.3 From: Jeffrey Silverman To: hdfs-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7b2ee75b55c33504c3783115 X-System-Of-Record: true X-Gm-Message-State: ALoCoQlTzzl7JsHH6x8C2nq0gmFHkyx7FL7reVJfm3Vrw/BndfEP4oGw+UYxB/IPPdFPfrDOqRzksG8kurdAsU8zVTvtmwgCYhwM7blmrhEyijtNViKAYv4pIhK/6Fiauqln44QeBBXjnwKSkLqgaEak7Aj7+47JA4MW542g+84K2gxorq76vdHYaFHA5Hv0CuobQVMnrflU --047d7b2ee75b55c33504c3783115 Content-Type: text/plain; charset=ISO-8859-1 Varun, I tried what you suggested and I am still having the same problem: hduser@master:/usr/local/hadoop-1.0.3/conf$ tail /var/log/hadoop/hduser/hadoop-hduser-secondarynamenode-master.out Exception in thread "main" java.lang.IllegalArgumentException: Does not contain a valid host:port authority: file:/// at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:162) at org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:198) at org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:228) at org.apache.hadoop.hdfs.server.namenode.NameNode.getServiceAddress(NameNode.java:222) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.initialize(SecondaryNameNode.java:161) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.(SecondaryNameNode.java:129) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNameNode.java:567) hduser@master:/usr/local/hadoop-1.0.3/conf$ hduser@master:/usr/local/hadoop-1.0.3/conf$ cat core-site.xml hadoop.tmp.dir /home/hduser/tmp A base for other temporary directories. fs.default.name hdfs://master:54310 The name of the default file system. A URI whose scheme and authority determine the FileSystem implementation. The uri's scheme determines the config property (fs.SCHEME.impl) naming the FileSystem implementation class. The uri's authority is used to determine the host, port, etc. for a filesystem. hduser@master:/usr/local/hadoop-1.0.3/conf$ Do you have another suggestion? I think the problem is that somewhere I have URL that is in the form file:// instead of hdfs://. I have done some fgrep'ing and I see several possibilities, but nothing jumps out at me. Thank you Jeff On Tue, Jun 26, 2012 at 7:44 PM, varun kumar wrote: > Hi Jeff, > > Instead of localhost,mention the host-name of Primary namenod. > > > On Wed, Jun 27, 2012 at 3:46 AM, Jeffrey Silverman < > jeffsilverman@google.com> wrote: > >> I am working with hadoop for the first time, and I am following >> instructions at >> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/ >> >> >> I am having problems starting the secondarynamenode daemon. The error >> message in >> /var/log/hadoop/hduser/hadoop-hduser-secondarynamenode-master.out is >> >> Exception in thread "main" java.lang.IllegalArgumentException: Does not >> contain a valid host:port authority: file:/// >> at >> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:162) >> at >> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:198) >> at >> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:228) >> at >> org.apache.hadoop.hdfs.server.namenode.NameNode.getServiceAddress(NameNode.java:222) >> at >> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.initialize(SecondaryNameNode.java:161) >> at >> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.(SecondaryNameNode.java:129) >> at >> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNameNode.java:567) >> >> >> >> I googled the error message and came across HDFS-2515, which says that I >> might get that error message if the fs.default.name property name had an >> incorrect value, but I think my value is okay. >> >> My core-site.xml file is : >> >> >> >> >> >> >> >> >> hadoop.tmp.dir >> /home/hduser/tmp >> A base for other temporary directories. >> >> >> >> fs.default.name >> hdfs://localhost:54310 >> The name of the default file system. A URI whose >> scheme and authority determine the FileSystem implementation. The >> uri's scheme determines the config property (fs.SCHEME.impl) naming >> the FileSystem implementation class. The uri's authority is used to >> determine the host, port, etc. for a filesystem. >> >> >> ~ >> >> Does anybody have a suggestion for how to further troubleshoot this >> problem, please? >> >> >> Thank you, >> >> >> Jeff Silverman >> >> > > > > -- > Regards, > Varun Kumar.P > > --047d7b2ee75b55c33504c3783115 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Varun,

I tried what you suggested and I am still hav= ing the same problem:

hduser@master:/usr/local/hadoop-1.0.3/conf$ tail /var/log/ha= doop/hduser/hadoop-hduser-secondarynamenode-master.out
Exception in thread "main&q= uot; java.lang.IllegalArgumentException: Does not contain a valid host:port= authority: file:///
at org.ap= ache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:162)
at org.apache.hadoop.hdfs.server.namenode.= NameNode.getAddress(NameNode.java:198)
at org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(Name= Node.java:228)
at org.apache.hadoop.hdfs.server.namenode.= NameNode.getServiceAddress(NameNode.java:222)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNo= de.initialize(SecondaryNameNode.java:161)
at org.apache.hadoop.hdfs.server.namenode.= SecondaryNameNode.<init>(SecondaryNameNode.java:129)
at org.apache.hadoop.hdfs.server.namenode.Seco= ndaryNameNode.main(SecondaryNameNode.java:567)
hduser@master:/usr/local/hadoop-= 1.0.3/conf$=A0

<= /font>

hduser@master:/usr/local/hadoop-1.0.3= /conf$ cat core-site.xml =A0 =A0=A0
<?xml version=3D"1.0"?>
<?xml-stylesheet type=3D"text/x= sl" href=3D"configuration.xsl"?>

<!-- Put site-specific property overrides in= this file. -->
<= br>
<configuration&g= t;
<property><= /font>
=A0 <name>hado= op.tmp.dir</name>
=A0 <value>/home/hduser/tm= p</value>
=A0 = <description>A base for other temporary directories.</description&= gt;
</property>

<property>
=A0 <name>fs.default.name</name>
says that the value should be hd= fs://localhost:54310 however I got an answer on the hadoop mailing list tha= t said to explicitly
name the host -->
=A0 <value>hdfs://master:5= 4310</value>
= =A0 <description>The name of the default file system. =A0A URI whose<= /font>
=A0 scheme and authority determi= ne the FileSystem implementation. =A0The
=A0 uri's scheme determines the config property (f= s.SCHEME.impl) naming
=A0 the FileSystem implementatio= n class. =A0The uri's authority is used to
=A0 determine the host, port, etc. for a filesy= stem.</description>
</property>
</configuration>
hduser@master:/usr/local/hadoop= -1.0.3/conf$=A0

Do you have another suggestion? =A0I think the pr= oblem is that somewhere I have URL that is in the form file:// instead of h= dfs://. =A0I have done some fgrep'ing and I see several=A0possibilities= , but nothing jumps out at me.

Thank you


Jeff<= /div>


On Tue, Jun 2= 6, 2012 at 7:44 PM, varun kumar <varun.uid@gmail.com> wrot= e:
Hi Jeff,

Instead of local= host,mention the=A0host-name=A0of Primary namenod.

On Wed, Jun 27, 2012 at 3:46 AM, Jeffrey Silverm= an <jeffsilverman@google.com> wrote:
I am working with hadoop for the first time, and I am follo= wing instructions at=A0http://= www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-c= luster/=A0

I am having problems starting the secondarynamenode daemon. = =A0The error message in /var/log/hadoop/hduser/hadoop-hduser-secondarynamen= ode-master.out=A0=A0is

Exception in thread "main" java.lang.IllegalArgum= entException: Does not contain a valid host:port authority: file:///=
=A0 =A0 =A0 =A0 at org.apache.ha= doop.net.NetUtils.createSocketAddr(NetUtils.java:162)
=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs= .server.namenode.NameNode.getAddress(NameNode.java:198)
=A0 =A0 =A0 =A0 at org.apache.ha= doop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:228)
=A0 =A0 =A0 =A0 at org.apache.= hadoop.hdfs.server.namenode.NameNode.getServiceAddress(NameNode.java:222)
=A0 =A0 =A0 =A0 at org.apache.ha= doop.hdfs.server.namenode.SecondaryNameNode.initialize(SecondaryNameNode.ja= va:161)
=A0 =A0 =A0 = =A0 at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.<init>= ;(SecondaryNameNode.java:129)
=A0 =A0 =A0 =A0 at org.apache.ha= doop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNameNode.java:567= )



I goo= gled the error message and came across HDFS-2515, which says that I might g= et that error message if the fs.default.name property name had an incorrect value, but I thin= k my value is okay.

My=A0core-site.xml file is :

<= div><?xml version=3D"1.0"= ;?>
<?xml-styl= esheet type=3D"text/xsl" href=3D"configuration.xsl"?>= ;

<!-- Put site-specific property overrides in= this file. -->
<= br>
<configuration&g= t;
<property><= /font>
=A0 <name>hado= op.tmp.dir</name>
=A0 <value>/home/hduser/tm= p</value>
=A0 = <description>A base for other temporary directories.</description&= gt;
</property>

<property>
=A0 <name>fs.default.name</name>
=A0 <value>hdfs://localhos= t:54310</value>
=A0 scheme and authority determi= ne the FileSystem implementation. =A0The
=A0 uri's scheme determines the config property (f= s.SCHEME.impl) naming
=A0 the FileSystem implementatio= n class. =A0The uri's authority is used to
=A0 determine the host, port, etc. for a filesy= stem.</description>
</property>
</configuration>
~=A0

Does anybody have a suggestion for how = to further troubleshoot this problem, please?


Thank you,


=
Jeff Silverman
=A0=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=A0



--
Regards,
Varun Kumar.P=


--047d7b2ee75b55c33504c3783115--