Mailing-List: contact hadoop-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hadoop-user@lucene.apache.org
Received-SPF: pass (herse.apache.org: local policy)
Content-class: urn:content-classes:message
Subject: RE: Trying to run nutch: no address associated with name
MIME-Version: 1.0
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Date: Mon, 16 Jul 2007 14:21:09 +0400
Message-ID: <410ACBBB22A25A4CAE7D1ABC316125D00EEE12@caesar.elegion.local>
In-Reply-To: <46965D4C.30605@apache.org>
Thread-Topic: Trying to run nutch: no address associated with name
Thread-index: AcfEpbB/FzuQZU/pQVuy3oaFCFL8wgC7PPqw
References: <410ACBBB22A25A4CAE7D1ABC316125D00EEDC8@caesar.elegion.local>
 <46965D4C.30605@apache.org>
From: "Ilya Vishnevsky" <Ilya.Vishnevsky@e-legion.com>
To: <hadoop-user@lucene.apache.org>

Well, I've tried with the following slaves file:

thanatos
morpheus

but the result is the same.

-----Original Message-----
From: Doug Cutting [mailto:cutting@apache.org]=20
Sent: Thursday, July 12, 2007 8:57 PM
To: hadoop-user@lucene.apache.org
Subject: Re: Trying to run nutch: no address associated with name

In the slaves file, 'localhost' should only be used alone, not with=20
other hosts, since 'localhost' is not a name that other hosts can use to

refer to a host.  It's equivalent to 127.0.0.1, the loopback address.=20
So, if you're specifying more than one host, it's best to use real=20
hostnames or IP addresses.

Doug

Ilya Vishnevsky wrote:
> Hello! I'm trying to run nutch on two computers. Here is content of my
> "slaves" file:
>=20
> localhost
> morpheus
>=20
> When I type bin/start-al.sh, I get the next output:
>=20
> starting namenode, logging to
> /nutch/search/logs/hadoop-nutch-namenode-Thanatos.out
> localhost
> : ssh: localhost
> : no address associated with name
> morpheus: starting datanode, logging to
> /nutch/search/logs/hadoop-nutch-datanode-morpheus.out
> starting jobtracker, logging to
> /nutch/search/logs/hadoop-nutch-jobtracker-Thanatos.out
> localhost
> : ssh: localhost
> : no address associated with name
> morpheus: starting tasktracker, logging to
> /nutch/search/logs/hadoop-nutch-tasktracker-morpheus.out
>=20
>=20
> It seems like it for some reason nutch can't run datanode and
> tasktracker on localhost (thanatos).
>=20
> At the same time if I have only localhost in my "slaves" file, I get
the
> following output:
>=20
> starting namenode, logging to
> /nutch/search/logs/hadoop-nutch-namenode-Thanatos.out
> localhost: starting datanode, logging to
> /nutch/search/logs/hadoop-nutch-datanode-Thanatos.out
> starting jobtracker, logging to
> /nutch/search/logs/hadoop-nutch-jobtracker-Thanatos.out
> localhost: starting tasktracker, logging to
> /nutch/search/logs/hadoop-nutch-tasktracker-Thanatos.out
>=20
> I.e. all nodes and trackers are run properly.
> Why can it be?
>=20
> Here is content of my hadoop-site.xml:
>=20
>=20
> <?xml version=3D"1.0"?>
> <?xml-stylesheet type=3D"text/xsl" href=3D"configuration.xsl"?>
>=20
> <!-- Put site-specific property overrides in this file. -->
>=20
> <configuration>
>=20
> <property>
>   <name>fs.default.name</name>
>   <value>localhost:50010</value>
>   <description>
>     The name of the default file system. Either the literal string=20
>     "local" or a host:port for NDFS.
>   </description>
> </property>
>=20
> <property>
>   <name>mapred.job.tracker</name>
>   <value>local</value>
>   <description>
>     The host and port that the MapReduce job tracker runs at. If=20
>     "local", then jobs are run in-process as a single map and=20
>     reduce task.
>   </description>
> </property>
>=20
> <property>=20
>   <name>mapred.map.tasks</name>
>   <value>2</value>
>   <description>
>     define mapred.map tasks to be number of slave hosts
>   </description>=20
> </property>=20
>=20
> <property>=20
>   <name>mapred.reduce.tasks</name>
>   <value>2</value>
>   <description>
>     define mapred.reduce tasks to be number of slave hosts
>   </description>=20
> </property>=20
>=20
> <property>
>   <name>dfs.name.dir</name>
>   <value>c:/cygwin/nutch/filesystem/name</value>
> </property>
>=20
> <property>
>   <name>dfs.data.dir</name>
>   <value>c:/cygwin/nutch/filesystem/data</value>
> </property>
>=20
> <property>
>   <name>mapred.system.dir</name>
>   <value>/nutch/filesystem/mapreduce/system</value>
> </property>
>=20
> <property>
>   <name>mapred.local.dir</name>
>   <value>/nutch/filesystem/mapreduce/local</value>
> </property>
>=20
> <property>
>   <name>dfs.replication</name>
>   <value>1</value>
> </property>
>=20
> </configuration>