Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EC6EC1166C for ; Thu, 3 Jul 2014 06:20:51 +0000 (UTC) Received: (qmail 89372 invoked by uid 500); 3 Jul 2014 06:20:47 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 89252 invoked by uid 500); 3 Jul 2014 06:20:47 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 89242 invoked by uid 99); 3 Jul 2014 06:20:47 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Jul 2014 06:20:47 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of chris.mawata@gmail.com designates 209.85.128.171 as permitted sender) Received: from [209.85.128.171] (HELO mail-ve0-f171.google.com) (209.85.128.171) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Jul 2014 06:20:44 +0000 Received: by mail-ve0-f171.google.com with SMTP id jz11so12434940veb.2 for ; Wed, 02 Jul 2014 23:20:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=zG4dGiTiZlTzZLQa+nIECeoh1pPppuB8KbhjtM03MFU=; b=Fr1SbMeqK2YwyPrtkyCaMSYVulOjlLt2xB9zeMU+A6JsK8QCneOjTwwK89pAwlT2EY y7oaxoSszoJ8i4VAsLa5QNIAMa1Hd1nXLj53VkfWqjcf2xhsmfn795RVDxn8UpCNdeaH duNSI/DDPNyvbwM/6WZHis71chwXmw4CYFMhPI4paSEnvH2KmH/aDL47SUUPKvGCZt0G 7cFfIyBILmjuDMNqdKFlULK0bplyRP84is6PnmWk0BLNGQTr0+Dzg3BYCd0sj05/hVDH a61KYKrhxx95vZca7GfEJ4HygV4Epl1vbn5FGfWqxCg18oIpEe3+HFpLj7zKKT2JR/Z9 b3OQ== MIME-Version: 1.0 X-Received: by 10.52.232.133 with SMTP id to5mr1653731vdc.16.1404368419899; Wed, 02 Jul 2014 23:20:19 -0700 (PDT) Received: by 10.221.38.196 with HTTP; Wed, 2 Jul 2014 23:20:19 -0700 (PDT) Received: by 10.221.38.196 with HTTP; Wed, 2 Jul 2014 23:20:19 -0700 (PDT) In-Reply-To: References: Date: Thu, 3 Jul 2014 14:20:19 +0800 Message-ID: Subject: Re: Bugs while installing apache hadoop 2.4.0 From: Chris Mawata To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=089e011764d1cd4f4904fd4400c1 X-Virus-Checked: Checked by ClamAV on apache.org --089e011764d1cd4f4904fd4400c1 Content-Type: text/plain; charset=UTF-8 What is the hostname of your NaneNode? How are you doing name resolution? On Jul 3, 2014 2:05 AM, "Ritesh Kumar Singh" wrote: > When I try to start dfs using start-dfs.sh I get this error message: > 14/07/03 11:03:21 WARN util.NativeCodeLoader: Unable to load native-hadoop > library for your platform... using builtin-java classes where applicable > Starting namenodes on [OpenJDK 64-Bit Server VM warning: You have loaded > library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have > disabled stack guard. The VM will try to fix the stack guard now. > It's highly recommended that you fix the library with 'execstack -c > ', or link it with '-z noexecstack'. > localhost] > sed: -e expression #1, char 6: unknown option to `s' > Server: ssh: Could not resolve hostname Server: Name or service not known > -c: Unknown cipher type 'cd' > stack: ssh: Could not resolve hostname stack: Name or service not known > 64-Bit: ssh: Could not resolve hostname 64-Bit: Name or service not known > guard.: ssh: Could not resolve hostname guard.: Name or service not known > The: ssh: Could not resolve hostname The: Name or service not known > guard: ssh: Could not resolve hostname guard: Name or service not known > might: ssh: Could not resolve hostname might: Name or service not known > stack: ssh: Could not resolve hostname stack: Name or service not known > will: ssh: Could not resolve hostname will: Name or service not known > the: ssh: Could not resolve hostname the: Name or service not known > fix: ssh: Could not resolve hostname fix: Name or service not known > VM: ssh: Could not resolve hostname VM: Name or service not known > You: ssh: Could not resolve hostname You: Name or service not known > which: ssh: Could not resolve hostname which: Name or service not known > It's: ssh: Could not resolve hostname It's: Name or service not known > disabled: ssh: Could not resolve hostname disabled: Name or service not > known > try: ssh: Could not resolve hostname try: Name or service not known > localhost: namenode running as process 4463. Stop it first. > library: ssh: Could not resolve hostname library: Name or service not known > with: ssh: Could not resolve hostname with: Name or service not known > the: ssh: Could not resolve hostname the: Name or service not known > warning:: ssh: Could not resolve hostname warning:: Name or service not > known > VM: ssh: Could not resolve hostname VM: Name or service not known > now.: ssh: Could not resolve hostname now.: Name or service not known > loaded: ssh: Could not resolve hostname loaded: Name or service not known > library: ssh: Could not resolve hostname library: Name or service not known > ',: ssh: Could not resolve hostname ',: Name or service > not known > to: ssh: connect to host to port 22: Connection refused > OpenJDK: ssh: Could not resolve hostname OpenJDK: Name or service not known > have: ssh: Could not resolve hostname have: Name or service not known > have: ssh: Could not resolve hostname have: Name or service not known > with: ssh: Could not resolve hostname with: Name or service not known > fix: ssh: Could not resolve hostname fix: Name or service not known > noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Name or > service not known > that: ssh: Could not resolve hostname that: Name or service not known > you: ssh: Could not resolve hostname you: Name or service not known > or: ssh: Could not resolve hostname or: Name or service not known > highly: ssh: Could not resolve hostname highly: Name or service not known > recommended: ssh: Could not resolve hostname recommended: Name or service > not known > 'execstack: ssh: Could not resolve hostname 'execstack: Name or service > not known > link: ssh: Could not resolve hostname link: Name or service not known > it: ssh: Could not resolve hostname it: Name or service not known > '-z: ssh: Could not resolve hostname '-z: Name or service not known > localhost: datanode running as process 4561. Stop it first. > Starting secondary namenodes [OpenJDK 64-Bit Server VM warning: You have > loaded library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might > have disabled stack guard. The VM will try to fix the stack guard now. > It's highly recommended that you fix the library with 'execstack -c > ', or link it with '-z noexecstack'. > 0.0.0.0] > sed: -e expression #1, char 6: unknown option to `s' > OpenJDK: ssh: Could not resolve hostname OpenJDK: Name or service not known > -c: Unknown cipher type 'cd' > VM: ssh: Could not resolve hostname VM: Name or service not known > The authenticity of host '0.0.0.0 (0.0.0.0)' can't be established. > ECDSA key fingerprint is dd:64:53:7e:c0:62:40:c0:63:2b:5c:6d:1e:b6:cd:23. > Are you sure you want to continue connecting (yes/no)? might: ssh: Could > not resolve hostname might: Name or service not known > Server: ssh: Could not resolve hostname Server: Name or service not known > guard.: ssh: Could not resolve hostname guard.: Name or service not known > have: ssh: Could not resolve hostname have: Name or service not known > You: ssh: Could not resolve hostname You: Name or service not known > The: ssh: Could not resolve hostname The: Name or service not known > which: ssh: Could not resolve hostname which: Name or service not known > have: ssh: Could not resolve hostname have: Name or service not known > disabled: ssh: Could not resolve hostname disabled: Name or service not > known > VM: ssh: Could not resolve hostname VM: Name or service not known > It's: ssh: Could not resolve hostname It's: Name or service not known > fix: ssh: Could not resolve hostname fix: Name or service not known > the: ssh: Could not resolve hostname the: Name or service not known > warning:: ssh: Could not resolve hostname warning:: Name or service not > known > will: ssh: Could not resolve hostname will: Name or service not known > the: ssh: Could not resolve hostname the: Name or service not known > library: ssh: Could not resolve hostname library: Name or service not known > that: ssh: Could not resolve hostname that: Name or service not known > highly: ssh: Could not resolve hostname highly: Name or service not known > 'execstack: ssh: Could not resolve hostname 'execstack: Name or service > not known > try: ssh: Could not resolve hostname try: Name or service not known > guard: ssh: Could not resolve hostname guard: Name or service not known > 64-Bit: ssh: Could not resolve hostname 64-Bit: Name or service not known > loaded: ssh: Could not resolve hostname loaded: Name or service not known > library: ssh: Could not resolve hostname library: Name or service not known > fix: ssh: Could not resolve hostname fix: Name or service not known > to: ssh: connect to host to port 22: Connection refused > link: ssh: Could not resolve hostname link: Name or service not known > stack: ssh: Could not resolve hostname stack: Name or service not known > '-z: ssh: Could not resolve hostname '-z: Name or service not known > you: ssh: Could not resolve hostname you: Name or service not known > with: ssh: Could not resolve hostname with: Name or service not known > with: ssh: Could not resolve hostname with: Name or service not known > recommended: ssh: Could not resolve hostname recommended: Name or service > not known > stack: ssh: Could not resolve hostname stack: Name or service not known > now.: ssh: Could not resolve hostname now.: Name or service not known > ',: ssh: Could not resolve hostname ',: Name or service > not known > or: ssh: Could not resolve hostname or: Name or service not known > noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Name or > service not known > it: ssh: Could not resolve hostname it: Name or service not known > ^C0.0.0.0: Host key verification failed. > ^C > > My core-site.xml file contains this: > > > > fs.default.name > hdfs://localhost:9000 > > > > My .profile(replacement for .bashrc) contains these lines: > > export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64 export > HADOOP_INSTALL=/usr/local/hadoop export PATH=$PATH:$HADOOP_INSTALL/bin > export PATH=$PATH:$HADOOP_INSTALL/sbin export > HADOOP_MAPRED_HOME=$HADOOP_INSTALL export > HADOOP_COMMON_HOME=$HADOOP_INSTALL export HADOOP_HDFS_HOME=$HADOOP_INSTALL > export YARN_HOME=$HADOOP_INSTALL export > HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_INSTALL/lib/native export > HADOOP_OPTS="-Djava.library.path=$HADOOP_INSTALL/lib" > > And I can easily ssh my localhost saying: > > ssh localhost Welcome to Linux Mint 16 Petra (GNU/Linux 3.11.0-12-generic > x86_64) > > Welcome to Linux Mint * Documentation: http://www.linuxmint.com Last > login: Wed Jul 2 16:51:15 2014 from localhost > > --089e011764d1cd4f4904fd4400c1 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

What is the hostname of your NaneNode? How are you doing nam= e resolution?

On Jul 3, 2014 2:05 AM, "Ritesh Kumar Singh= " <riteshoneinamil= lion@gmail.com> wrote:
When I try to start dfs using start-dfs.sh I get this erro= r message:
14/07/03 11:03:21 WARN util.NativeCodeLoader: Unable to= load native-hadoop library for your platform... using builtin-java classes= where applicable
Starting namenodes on [OpenJDK 64-Bit Server VM warning: You have load= ed library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have= disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execsta= ck -c <libfile>', or link it with '-z noexecstack'.
=
localhost]
sed: -e expression #1, char 6: unknown option to = `s'
Server: ssh: Could not resolve hostname Server: Name or service not kn= own
-c: Unknown cipher type 'cd'
stack: ssh: Co= uld not resolve hostname stack: Name or service not known
64-Bit:= ssh: Could not resolve hostname 64-Bit: Name or service not known
guard.: ssh: Could not resolve hostname guard.: Name or service not kn= own
The: ssh: Could not resolve hostname The: Name or service not= known
guard: ssh: Could not resolve hostname guard: Name or serv= ice not known
might: ssh: Could not resolve hostname might: Name or service not know= n
stack: ssh: Could not resolve hostname stack: Name or service n= ot known
will: ssh: Could not resolve hostname will: Name or serv= ice not known
the: ssh: Could not resolve hostname the: Name or service not known
fix: ssh: Could not resolve hostname fix: Name or service not known=
VM: ssh: Could not resolve hostname VM: Name or service not know= n
You: ssh: Could not resolve hostname You: Name or service not known
which: ssh: Could not resolve hostname which: Name or service not k= nown
It's: ssh: Could not resolve hostname It's: Name or = service not known
disabled: ssh: Could not resolve hostname disabled: Name or service no= t known
try: ssh: Could not resolve hostname try: Name or service= not known
localhost: namenode running as process 4463. Stop it f= irst.
library: ssh: Could not resolve hostname library: Name or service not = known
with: ssh: Could not resolve hostname with: Name or service= not known
the: ssh: Could not resolve hostname the: Name or serv= ice not known
warning:: ssh: Could not resolve hostname warning:: Name or service no= t known
VM: ssh: Could not resolve hostname VM: Name or service n= ot known
now.: ssh: Could not resolve hostname now.: Name or serv= ice not known
loaded: ssh: Could not resolve hostname loaded: Name or service not kn= own
library: ssh: Could not resolve hostname library: Name or ser= vice not known
<libfile>',: ssh: Could not resolve host= name <libfile>',: Name or service not known
to: ssh: connect to host to port 22: Connection refused
Open= JDK: ssh: Could not resolve hostname OpenJDK: Name or service not known
have: ssh: Could not resolve hostname have: Name or service not know= n
have: ssh: Could not resolve hostname have: Name or service not known<= /div>
with: ssh: Could not resolve hostname with: Name or service not k= nown
fix: ssh: Could not resolve hostname fix: Name or service no= t known
noexecstack'.: ssh: Could not resolve hostname noexecstack'.: = Name or service not known
that: ssh: Could not resolve hostname t= hat: Name or service not known
you: ssh: Could not resolve hostna= me you: Name or service not known
or: ssh: Could not resolve hostname or: Name or service not known
highly: ssh: Could not resolve hostname highly: Name or service not k= nown
recommended: ssh: Could not resolve hostname recommended: Na= me or service not known
'execstack: ssh: Could not resolve hostname 'execstack: Name o= r service not known
link: ssh: Could not resolve hostname link: N= ame or service not known
it: ssh: Could not resolve hostname it: = Name or service not known
'-z: ssh: Could not resolve hostname '-z: Name or service not = known
localhost: datanode running as process 4561. Stop it first.=
Starting secondary namenodes [OpenJDK 64-Bit Server VM warning: = You have loaded library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 whi= ch might have disabled stack guard. The VM will try to fix the stack guard = now.
It's highly recommended that you fix the library with 'execsta= ck -c <libfile>', or link it with '-z noexecstack'.
=
0.0.0.0]
sed: -e expression #1, char 6: unknown option to `s= '
OpenJDK: ssh: Could not resolve hostname OpenJDK: Name or service not = known
-c: Unknown cipher type 'cd'
VM: ssh: Cou= ld not resolve hostname VM: Name or service not known
The authent= icity of host '0.0.0.0 (0.0.0.0)' can't be established.
ECDSA key fingerprint is dd:64:53:7e:c0:62:40:c0:63:2b:5c:6d:1e:b6:cd:= 23.
Are you sure you want to continue connecting (yes/no)? might:= ssh: Could not resolve hostname might: Name or service not known
Server: ssh: Could not resolve hostname Server: Name or service not kn= own
guard.: ssh: Could not resolve hostname guard.: Name or servi= ce not known
have: ssh: Could not resolve hostname have: Name or = service not known
You: ssh: Could not resolve hostname You: Name or service not known
The: ssh: Could not resolve hostname The: Name or service not known=
which: ssh: Could not resolve hostname which: Name or service no= t known
have: ssh: Could not resolve hostname have: Name or service not known<= /div>
disabled: ssh: Could not resolve hostname disabled: Name or servi= ce not known
VM: ssh: Could not resolve hostname VM: Name or serv= ice not known
It's: ssh: Could not resolve hostname It's: Name or service no= t known
fix: ssh: Could not resolve hostname fix: Name or service= not known
the: ssh: Could not resolve hostname the: Name or serv= ice not known
warning:: ssh: Could not resolve hostname warning:: Name or service no= t known
will: ssh: Could not resolve hostname will: Name or servi= ce not known
the: ssh: Could not resolve hostname the: Name or se= rvice not known
library: ssh: Could not resolve hostname library: Name or service not = known
that: ssh: Could not resolve hostname that: Name or service= not known
highly: ssh: Could not resolve hostname highly: Name o= r service not known
'execstack: ssh: Could not resolve hostname 'execstack: Name o= r service not known
try: ssh: Could not resolve hostname try: Nam= e or service not known
guard: ssh: Could not resolve hostname gua= rd: Name or service not known
64-Bit: ssh: Could not resolve hostname 64-Bit: Name or service not kn= own
loaded: ssh: Could not resolve hostname loaded: Name or servi= ce not known
library: ssh: Could not resolve hostname library: Na= me or service not known
fix: ssh: Could not resolve hostname fix: Name or service not known
to: ssh: connect to host to port 22: Connection refused
l= ink: ssh: Could not resolve hostname link: Name or service not known
stack: ssh: Could not resolve hostname stack: Name or service not know= n
'-z: ssh: Could not resolve hostname '-z: Name or servi= ce not known
you: ssh: Could not resolve hostname you: Name or se= rvice not known
with: ssh: Could not resolve hostname with: Name or service not known<= /div>
with: ssh: Could not resolve hostname with: Name or service not k= nown
recommended: ssh: Could not resolve hostname recommended: Na= me or service not known
stack: ssh: Could not resolve hostname stack: Name or service not know= n
now.: ssh: Could not resolve hostname now.: Name or service not= known
<libfile>',: ssh: Could not resolve hostname <= ;libfile>',: Name or service not known
or: ssh: Could not resolve hostname or: Name or service not known
noexecstack'.: ssh: Could not resolve hostname noexecstack'.:= Name or service not known
it: ssh: Could not resolve hostname it= : Name or service not known
^C0.0.0.0: Host key verification failed.
^C
=

My core-site.xml file contains this:


<configuration>
    <property>
       <name>fs.=
default.name</name>
       <value>hdfs://localhost:9000</value>
    </property>
</configuration>

My .profile(replacement for .bashrc) contains these lines:

export JAVA_HOME=3D/usr/lib/jvm/java-= 7-openjdk-amd64 export HADOOP_INSTALL=3D/usr/local/hadoop export PATH=3D$PA= TH:$HADOOP_INSTALL/bin export PATH=3D$PATH:$HADOOP_INSTALL/sbin export HADO= OP_MAPRED_HOME=3D$HADOOP_INSTALL export HADOOP_COMMON_HOME=3D$HADOOP_INSTAL= L export HADOOP_HDFS_HOME=3D$HADOOP_INSTALL export YARN_HOME=3D$HADOOP_INST= ALL export HADOOP_COMMON_LIB_NATIVE_DIR=3D$HADOOP_INSTALL/lib/native export= HADOOP_OPTS=3D"-Djava.library.path=3D$HADOOP_INSTALL/lib"

And I can easily ssh my localhost saying:

ssh localhost Welcome to Linux Mint 1= 6 Petra (GNU/Linux 3.11.0-12-generic x86_64)

Welcome to Linux Mint * Documentation:=C2=A0http://www.linuxmint.com=C2=A0Last login: Wed= Jul 2 16:51:15 2014 from localhost

--089e011764d1cd4f4904fd4400c1--