Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0665B11616 for ; Thu, 3 Jul 2014 06:05:43 +0000 (UTC) Received: (qmail 56877 invoked by uid 500); 3 Jul 2014 06:05:38 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 56716 invoked by uid 500); 3 Jul 2014 06:05:38 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 56704 invoked by uid 99); 3 Jul 2014 06:05:38 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Jul 2014 06:05:38 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of riteshoneinamillion@gmail.com designates 209.85.214.177 as permitted sender) Received: from [209.85.214.177] (HELO mail-ob0-f177.google.com) (209.85.214.177) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Jul 2014 06:05:35 +0000 Received: by mail-ob0-f177.google.com with SMTP id uy5so12975239obc.22 for ; Wed, 02 Jul 2014 23:05:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=zPkssqzumJc4tUW17TomlY11ZCvXhnPkvyQ9nJq7e4s=; b=VMnyq013fsv9rMYPpkOlmRU2mDfbxnNEVXL6BqLZXdqubxKvgj5Kjn544BhlomrsHa LbPIoAouPiOUWb/5Zjom2eh3sPhh+sx2SeOujZF9CguyArfBntbWDkMgLNYavL21hhq6 kuLYufJPJkOdxRhV96zOWEJB/5WtX1wGzYCYgTZe/QurCP0CnXs2K6llktIgEZsVzyfp kmU/5rorD3OBckwUIGtaoYcDFfn+7qfJWiXoTPCWc8HuNm9jEb87tZfFYQ5eaeLdGVmk DMMOX9LI3DQIUPyCqr5dBIzrvbceOiw+wdBVOy8K98lRj1JWN8XJ8s6UAgpEqUaf/RYS sUwg== MIME-Version: 1.0 X-Received: by 10.182.28.104 with SMTP id a8mr2464469obh.30.1404367510786; Wed, 02 Jul 2014 23:05:10 -0700 (PDT) Received: by 10.182.181.10 with HTTP; Wed, 2 Jul 2014 23:05:10 -0700 (PDT) Date: Thu, 3 Jul 2014 11:35:10 +0530 Message-ID: Subject: Bugs while installing apache hadoop 2.4.0 From: Ritesh Kumar Singh To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=089e015372c69d5cfa04fd43ca61 X-Virus-Checked: Checked by ClamAV on apache.org --089e015372c69d5cfa04fd43ca61 Content-Type: text/plain; charset=UTF-8 When I try to start dfs using start-dfs.sh I get this error message: 14/07/03 11:03:21 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Starting namenodes on [OpenJDK 64-Bit Server VM warning: You have loaded library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now. It's highly recommended that you fix the library with 'execstack -c ', or link it with '-z noexecstack'. localhost] sed: -e expression #1, char 6: unknown option to `s' Server: ssh: Could not resolve hostname Server: Name or service not known -c: Unknown cipher type 'cd' stack: ssh: Could not resolve hostname stack: Name or service not known 64-Bit: ssh: Could not resolve hostname 64-Bit: Name or service not known guard.: ssh: Could not resolve hostname guard.: Name or service not known The: ssh: Could not resolve hostname The: Name or service not known guard: ssh: Could not resolve hostname guard: Name or service not known might: ssh: Could not resolve hostname might: Name or service not known stack: ssh: Could not resolve hostname stack: Name or service not known will: ssh: Could not resolve hostname will: Name or service not known the: ssh: Could not resolve hostname the: Name or service not known fix: ssh: Could not resolve hostname fix: Name or service not known VM: ssh: Could not resolve hostname VM: Name or service not known You: ssh: Could not resolve hostname You: Name or service not known which: ssh: Could not resolve hostname which: Name or service not known It's: ssh: Could not resolve hostname It's: Name or service not known disabled: ssh: Could not resolve hostname disabled: Name or service not known try: ssh: Could not resolve hostname try: Name or service not known localhost: namenode running as process 4463. Stop it first. library: ssh: Could not resolve hostname library: Name or service not known with: ssh: Could not resolve hostname with: Name or service not known the: ssh: Could not resolve hostname the: Name or service not known warning:: ssh: Could not resolve hostname warning:: Name or service not known VM: ssh: Could not resolve hostname VM: Name or service not known now.: ssh: Could not resolve hostname now.: Name or service not known loaded: ssh: Could not resolve hostname loaded: Name or service not known library: ssh: Could not resolve hostname library: Name or service not known ',: ssh: Could not resolve hostname ',: Name or service not known to: ssh: connect to host to port 22: Connection refused OpenJDK: ssh: Could not resolve hostname OpenJDK: Name or service not known have: ssh: Could not resolve hostname have: Name or service not known have: ssh: Could not resolve hostname have: Name or service not known with: ssh: Could not resolve hostname with: Name or service not known fix: ssh: Could not resolve hostname fix: Name or service not known noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Name or service not known that: ssh: Could not resolve hostname that: Name or service not known you: ssh: Could not resolve hostname you: Name or service not known or: ssh: Could not resolve hostname or: Name or service not known highly: ssh: Could not resolve hostname highly: Name or service not known recommended: ssh: Could not resolve hostname recommended: Name or service not known 'execstack: ssh: Could not resolve hostname 'execstack: Name or service not known link: ssh: Could not resolve hostname link: Name or service not known it: ssh: Could not resolve hostname it: Name or service not known '-z: ssh: Could not resolve hostname '-z: Name or service not known localhost: datanode running as process 4561. Stop it first. Starting secondary namenodes [OpenJDK 64-Bit Server VM warning: You have loaded library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now. It's highly recommended that you fix the library with 'execstack -c ', or link it with '-z noexecstack'. 0.0.0.0] sed: -e expression #1, char 6: unknown option to `s' OpenJDK: ssh: Could not resolve hostname OpenJDK: Name or service not known -c: Unknown cipher type 'cd' VM: ssh: Could not resolve hostname VM: Name or service not known The authenticity of host '0.0.0.0 (0.0.0.0)' can't be established. ECDSA key fingerprint is dd:64:53:7e:c0:62:40:c0:63:2b:5c:6d:1e:b6:cd:23. Are you sure you want to continue connecting (yes/no)? might: ssh: Could not resolve hostname might: Name or service not known Server: ssh: Could not resolve hostname Server: Name or service not known guard.: ssh: Could not resolve hostname guard.: Name or service not known have: ssh: Could not resolve hostname have: Name or service not known You: ssh: Could not resolve hostname You: Name or service not known The: ssh: Could not resolve hostname The: Name or service not known which: ssh: Could not resolve hostname which: Name or service not known have: ssh: Could not resolve hostname have: Name or service not known disabled: ssh: Could not resolve hostname disabled: Name or service not known VM: ssh: Could not resolve hostname VM: Name or service not known It's: ssh: Could not resolve hostname It's: Name or service not known fix: ssh: Could not resolve hostname fix: Name or service not known the: ssh: Could not resolve hostname the: Name or service not known warning:: ssh: Could not resolve hostname warning:: Name or service not known will: ssh: Could not resolve hostname will: Name or service not known the: ssh: Could not resolve hostname the: Name or service not known library: ssh: Could not resolve hostname library: Name or service not known that: ssh: Could not resolve hostname that: Name or service not known highly: ssh: Could not resolve hostname highly: Name or service not known 'execstack: ssh: Could not resolve hostname 'execstack: Name or service not known try: ssh: Could not resolve hostname try: Name or service not known guard: ssh: Could not resolve hostname guard: Name or service not known 64-Bit: ssh: Could not resolve hostname 64-Bit: Name or service not known loaded: ssh: Could not resolve hostname loaded: Name or service not known library: ssh: Could not resolve hostname library: Name or service not known fix: ssh: Could not resolve hostname fix: Name or service not known to: ssh: connect to host to port 22: Connection refused link: ssh: Could not resolve hostname link: Name or service not known stack: ssh: Could not resolve hostname stack: Name or service not known '-z: ssh: Could not resolve hostname '-z: Name or service not known you: ssh: Could not resolve hostname you: Name or service not known with: ssh: Could not resolve hostname with: Name or service not known with: ssh: Could not resolve hostname with: Name or service not known recommended: ssh: Could not resolve hostname recommended: Name or service not known stack: ssh: Could not resolve hostname stack: Name or service not known now.: ssh: Could not resolve hostname now.: Name or service not known ',: ssh: Could not resolve hostname ',: Name or service not known or: ssh: Could not resolve hostname or: Name or service not known noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Name or service not known it: ssh: Could not resolve hostname it: Name or service not known ^C0.0.0.0: Host key verification failed. ^C My core-site.xml file contains this: fs.default.name hdfs://localhost:9000 My .profile(replacement for .bashrc) contains these lines: export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64 export HADOOP_INSTALL=/usr/local/hadoop export PATH=$PATH:$HADOOP_INSTALL/bin export PATH=$PATH:$HADOOP_INSTALL/sbin export HADOOP_MAPRED_HOME=$HADOOP_INSTALL export HADOOP_COMMON_HOME=$HADOOP_INSTALL export HADOOP_HDFS_HOME=$HADOOP_INSTALL export YARN_HOME=$HADOOP_INSTALL export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_INSTALL/lib/native export HADOOP_OPTS="-Djava.library.path=$HADOOP_INSTALL/lib" And I can easily ssh my localhost saying: ssh localhost Welcome to Linux Mint 16 Petra (GNU/Linux 3.11.0-12-generic x86_64) Welcome to Linux Mint * Documentation: http://www.linuxmint.com Last login: Wed Jul 2 16:51:15 2014 from localhost --089e015372c69d5cfa04fd43ca61 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
When I try to start dfs using start-dfs.sh I get this erro= r message:
14/07/03 11:03:21 WARN util.NativeCodeLoader: Unable to= load native-hadoop library for your platform... using builtin-java classes= where applicable
Starting namenodes on [OpenJDK 64-Bit Server VM warning: You have load= ed library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have= disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execsta= ck -c <libfile>', or link it with '-z noexecstack'.
=
localhost]
sed: -e expression #1, char 6: unknown option to = `s'
Server: ssh: Could not resolve hostname Server: Name or service not kn= own
-c: Unknown cipher type 'cd'
stack: ssh: Co= uld not resolve hostname stack: Name or service not known
64-Bit:= ssh: Could not resolve hostname 64-Bit: Name or service not known
guard.: ssh: Could not resolve hostname guard.: Name or service not kn= own
The: ssh: Could not resolve hostname The: Name or service not= known
guard: ssh: Could not resolve hostname guard: Name or serv= ice not known
might: ssh: Could not resolve hostname might: Name or service not know= n
stack: ssh: Could not resolve hostname stack: Name or service n= ot known
will: ssh: Could not resolve hostname will: Name or serv= ice not known
the: ssh: Could not resolve hostname the: Name or service not known
fix: ssh: Could not resolve hostname fix: Name or service not known=
VM: ssh: Could not resolve hostname VM: Name or service not know= n
You: ssh: Could not resolve hostname You: Name or service not known
which: ssh: Could not resolve hostname which: Name or service not k= nown
It's: ssh: Could not resolve hostname It's: Name or = service not known
disabled: ssh: Could not resolve hostname disabled: Name or service no= t known
try: ssh: Could not resolve hostname try: Name or service= not known
localhost: namenode running as process 4463. Stop it f= irst.
library: ssh: Could not resolve hostname library: Name or service not = known
with: ssh: Could not resolve hostname with: Name or service= not known
the: ssh: Could not resolve hostname the: Name or serv= ice not known
warning:: ssh: Could not resolve hostname warning:: Name or service no= t known
VM: ssh: Could not resolve hostname VM: Name or service n= ot known
now.: ssh: Could not resolve hostname now.: Name or serv= ice not known
loaded: ssh: Could not resolve hostname loaded: Name or service not kn= own
library: ssh: Could not resolve hostname library: Name or ser= vice not known
<libfile>',: ssh: Could not resolve host= name <libfile>',: Name or service not known
to: ssh: connect to host to port 22: Connection refused
Open= JDK: ssh: Could not resolve hostname OpenJDK: Name or service not known
have: ssh: Could not resolve hostname have: Name or service not know= n
have: ssh: Could not resolve hostname have: Name or service not known<= /div>
with: ssh: Could not resolve hostname with: Name or service not k= nown
fix: ssh: Could not resolve hostname fix: Name or service no= t known
noexecstack'.: ssh: Could not resolve hostname noexecstack'.: = Name or service not known
that: ssh: Could not resolve hostname t= hat: Name or service not known
you: ssh: Could not resolve hostna= me you: Name or service not known
or: ssh: Could not resolve hostname or: Name or service not known
highly: ssh: Could not resolve hostname highly: Name or service not k= nown
recommended: ssh: Could not resolve hostname recommended: Na= me or service not known
'execstack: ssh: Could not resolve hostname 'execstack: Name o= r service not known
link: ssh: Could not resolve hostname link: N= ame or service not known
it: ssh: Could not resolve hostname it: = Name or service not known
'-z: ssh: Could not resolve hostname '-z: Name or service not = known
localhost: datanode running as process 4561. Stop it first.=
Starting secondary namenodes [OpenJDK 64-Bit Server VM warning: = You have loaded library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 whi= ch might have disabled stack guard. The VM will try to fix the stack guard = now.
It's highly recommended that you fix the library with 'execsta= ck -c <libfile>', or link it with '-z noexecstack'.
=
0.0.0.0]
sed: -e expression #1, char 6: unknown option to `s= '
OpenJDK: ssh: Could not resolve hostname OpenJDK: Name or service not = known
-c: Unknown cipher type 'cd'
VM: ssh: Cou= ld not resolve hostname VM: Name or service not known
The authent= icity of host '0.0.0.0 (0.0.0.0)' can't be established.
ECDSA key fingerprint is dd:64:53:7e:c0:62:40:c0:63:2b:5c:6d:1e:b6:cd:= 23.
Are you sure you want to continue connecting (yes/no)? might:= ssh: Could not resolve hostname might: Name or service not known
Server: ssh: Could not resolve hostname Server: Name or service not kn= own
guard.: ssh: Could not resolve hostname guard.: Name or servi= ce not known
have: ssh: Could not resolve hostname have: Name or = service not known
You: ssh: Could not resolve hostname You: Name or service not known
The: ssh: Could not resolve hostname The: Name or service not known=
which: ssh: Could not resolve hostname which: Name or service no= t known
have: ssh: Could not resolve hostname have: Name or service not known<= /div>
disabled: ssh: Could not resolve hostname disabled: Name or servi= ce not known
VM: ssh: Could not resolve hostname VM: Name or serv= ice not known
It's: ssh: Could not resolve hostname It's: Name or service no= t known
fix: ssh: Could not resolve hostname fix: Name or service= not known
the: ssh: Could not resolve hostname the: Name or serv= ice not known
warning:: ssh: Could not resolve hostname warning:: Name or service no= t known
will: ssh: Could not resolve hostname will: Name or servi= ce not known
the: ssh: Could not resolve hostname the: Name or se= rvice not known
library: ssh: Could not resolve hostname library: Name or service not = known
that: ssh: Could not resolve hostname that: Name or service= not known
highly: ssh: Could not resolve hostname highly: Name o= r service not known
'execstack: ssh: Could not resolve hostname 'execstack: Name o= r service not known
try: ssh: Could not resolve hostname try: Nam= e or service not known
guard: ssh: Could not resolve hostname gua= rd: Name or service not known
64-Bit: ssh: Could not resolve hostname 64-Bit: Name or service not kn= own
loaded: ssh: Could not resolve hostname loaded: Name or servi= ce not known
library: ssh: Could not resolve hostname library: Na= me or service not known
fix: ssh: Could not resolve hostname fix: Name or service not known
to: ssh: connect to host to port 22: Connection refused
l= ink: ssh: Could not resolve hostname link: Name or service not known
stack: ssh: Could not resolve hostname stack: Name or service not know= n
'-z: ssh: Could not resolve hostname '-z: Name or servi= ce not known
you: ssh: Could not resolve hostname you: Name or se= rvice not known
with: ssh: Could not resolve hostname with: Name or service not known<= /div>
with: ssh: Could not resolve hostname with: Name or service not k= nown
recommended: ssh: Could not resolve hostname recommended: Na= me or service not known
stack: ssh: Could not resolve hostname stack: Name or service not know= n
now.: ssh: Could not resolve hostname now.: Name or service not= known
<libfile>',: ssh: Could not resolve hostname <= ;libfile>',: Name or service not known
or: ssh: Could not resolve hostname or: Name or service not known
noexecstack'.: ssh: Could not resolve hostname noexecstack'.:= Name or service not known
it: ssh: Could not resolve hostname it= : Name or service not known
^C0.0.0.0: Host key verification failed.
^C
=

My core-site.xml file contains this:

<configuration>
    <property>
       <name>fs.default.name&l=
t;/name>
       <value>hdfs://localhost:9000</value>
    </property>
</configuration>

My .profile(replacement for .bashrc) contains these lines:

export JAVA_HOME=3D/usr/lib/jvm/java-= 7-openjdk-amd64 export HADOOP_INSTALL=3D/usr/local/hadoop export PATH=3D$PA= TH:$HADOOP_INSTALL/bin export PATH=3D$PATH:$HADOOP_INSTALL/sbin export HADO= OP_MAPRED_HOME=3D$HADOOP_INSTALL export HADOOP_COMMON_HOME=3D$HADOOP_INSTAL= L export HADOOP_HDFS_HOME=3D$HADOOP_INSTALL export YARN_HOME=3D$HADOOP_INST= ALL export HADOOP_COMMON_LIB_NATIVE_DIR=3D$HADOOP_INSTALL/lib/native export= HADOOP_OPTS=3D"-Djava.library.path=3D$HADOOP_INSTALL/lib"

And I can easily ssh my localhost saying:

ssh localhost Welcome to Linux Mint 1= 6 Petra (GNU/Linux 3.11.0-12-generic x86_64)

Welcome to Linux Mint * Documentation:=C2=A0http://www.linuxmint.com=C2=A0Last login: Wed Jul 2 16:51:15 20= 14 from localhost

--089e015372c69d5cfa04fd43ca61--