Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 180F91074A for ; Thu, 31 Oct 2013 18:20:10 +0000 (UTC) Received: (qmail 84480 invoked by uid 500); 31 Oct 2013 18:20:04 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 84355 invoked by uid 500); 31 Oct 2013 18:20:03 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 84348 invoked by uid 99); 31 Oct 2013 18:20:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Oct 2013 18:20:03 +0000 X-ASF-Spam-Status: No, hits=-2.8 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_HI,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [66.241.42.246] (HELO SMTP-Out01.rsi.lexisnexis.com) (66.241.42.246) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Oct 2013 18:19:59 +0000 Received: from ([10.176.128.57]) by SMTP-Out01.rsi.lexisnexis.com with ESMTP with TLS id F4T09K1.123543716; Thu, 31 Oct 2013 14:18:46 -0400 Received: from RISBCTMBXP002.risk.regn.net ([fe80::6c46:30ba:718b:c5e1]) by RISBCTHUBP002.risk.regn.net ([::1]) with mapi id 14.02.0309.002; Thu, 31 Oct 2013 14:18:46 -0400 From: "Pastrana, Rodrigo (RIS-BCT)" To: "user@hadoop.apache.org" Subject: Apache Hadoop 2.2 install and setup help Thread-Topic: Apache Hadoop 2.2 install and setup help Thread-Index: Ac7WQUUxscGGoxqWQDueCKwZIstn0A== Date: Thu, 31 Oct 2013 18:18:46 +0000 Message-ID: <54A8EF336FC15D4F946B9FE253F80F824A36F39B@RISBCTMBXP002.risk.regn.net> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.176.152.205] MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="_000_54A8EF336FC15D4F946B9FE253F80F824A36F39BRISBCTMBXP002ri_" X-Virus-Checked: Checked by ClamAV on apache.org --_000_54A8EF336FC15D4F946B9FE253F80F824A36F39BRISBCTMBXP002ri_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Having a hard time setting-up a single node hadoop 2=2E2 on Ubuntu 12=2E04= =2E I'm following this doc: http://hadoop=2Eapache=2Eorg/docs/current2/hado= op-project-dist/hadoop-common/SingleCluster=2Ehtml ( eventhough it is versi= oned 2=2E1=2E1-beta )=2E=0D=0A=0D=0A=0D=0AI've setup a dedicated hduser, lo= calhost no pass ssh is setup, JAVA_HOME properly set, Pv6 disabled, and had= oop-2=2E2=2E0=2Etar=2Egz extracted to /home/hduser/yar= n/Hadoop-2=2E2=2E0=2E=0D=0A=0D=0A=0D=0A=0D=0AThe doc starts out with the as= sumption that hadoop-common/hadoop-hdfs are installed=2E (I'm assuming that= means simply extracting the Hadoop-2=2E2=2Etar file since I couldn't find = a stand-alone Hadoop-common or Hadoop-hdfs package)=2E=0D=0A=0D=0A=0D=0A=0D= =0AIt assumes the following (seems like common sense, but I'll display what= I did in case I screwed that up)=0D=0A=0D=0A$HADOOP_COMMON_HOME - /home/h= duser/yarn/Hadoop-2=2E2=2E0=0D=0A=0D=0A$HADOOP_HDFS_HOME - /home/hduser/yar= n/Hadoop-2=2E2=2E0=0D=0A=0D=0A$HADOO_MAPRED_HOME - /home/hduser/yarn/Hadoop= -2=2E2=2E0=0D=0A=0D=0A$HADOOP_YARN_HOME - /home/hduser/yarn/Hadoop-2=2E2=2E= 0=0D=0A=0D=0A$HADOOP_CONF_DIR - /home/hduser/yarn/Hadoop-2=2E2=2E0/etc/hado= op=0D=0A=0D=0Auntar hadoop mapreduce tarball - hmmm I assume this is the = Hadoop-2=2E2=2E0 tar file=0D=0A=0D=0AHDFS should be running=2E - I'm sure t= his is trivial to do, but can anybody point out how to do this? In previous= versions the Hfile system had be formatted, but the command has apparently= been deprecated=2E=0D=0A=0D=0A"bin/Hadoop namenode -format" - DEPRECATED: = Use of this script to execute hdfs command is deprecated=2E Instead use the= hdfs command for it=2E=0D=0A=0D=0A=0D=0A=0D=0Asbin/yarn-daemon=2Esh start = resourcemanager - no visible errors=0D=0A=0D=0Asbin/yarn-daemon=2Esh start = nodemanager - no visible errors=0D=0A=0D=0A=0D=0A=0D=0AI'm assuming that th= e previous two commands don't start every component=2E I tried the followin= g: sbin/Hadoop-daemon=2Esh start namenode=0D=0A=0D=0ABut I see the followin= g error:=0D=0A=0D=0AJava=2Eio=2EIOException: NameNode is not formatted=2E= =0D=0A=0D=0A=0D=0A=0D=0AThanks in advance to anybody that can help me get t= he single node up and running=2E Thanks=2E=0D=0A=0D=0A=0D=0AThanks, Rodrigo= =2E=0D=0A=0D=0A=0D=0A=0D=0A-----------------------------------------=0D=0AT= he information contained in this e-mail message is intended only=0D=0Afor t= he personal and confidential use of the recipient(s) named=0D=0Aabove=2E Th= is message may be an attorney-client communication and/or=0D=0Awork product= and as such is privileged and confidential=2E If the=0D=0Areader of this m= essage is not the intended recipient or an agent=0D=0Aresponsible for deliv= ering it to the intended recipient, you are=0D=0Ahereby notified that you h= ave received this document in error and=0D=0Athat any review, dissemination= , distribution, or copying of this=0D=0Amessage is strictly prohibited=2E I= f you have received this=0D=0Acommunication in error, please notify us imme= diately by e-mail, and=0D=0Adelete the original message=2E --_000_54A8EF336FC15D4F946B9FE253F80F824A36F39BRISBCTMBXP002ri_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable =0D=0A=0D=0A=0D=0A=0D=0A=0D=0A=0D=0A=0D=0A
=0D= =0A

Having a hard time setting-up a single node hadoop 2= =2E2 on Ubuntu 12=2E04=2E I’m following this doc:=0D=0A=0D=0Ahttp://hadoop=2Eapache=2Eorg/docs/current2/hadoo= p-project-dist/hadoop-common/SingleCluster=2Ehtml ( eventhough it is ve= rsioned 2=2E1=2E1-beta )=2E

=0D=0A

=  

=0D=0A
I’ve setup a dedicated=
 hduser, localhost no pass ssh is setup, JAVA_HOME properly set, Pv6 disabl=
ed, and hadoop-2=2E2=2E0=2Etar=2Egz<=
/a> extracted to /home/hduser/yarn/Hadoop-2=2E2=2E0=2E
=0D= =0A
 
=0D=0A
The doc starts out with the assum=
ption that hadoop-common/hadoop-hdfs are installed=2E (I’m assuming t=
hat means simply extracting the Hadoop-2=2E2=2Etar file since I couldn̵=
7;t find a stand-alone Hadoop-common or Hadoop-hdfs package)=2E<=
/pre>=0D=0A
 
=0D=0A
It assumes the following =
(seems like common sense, but I’ll display what I did in case I screw=
ed that up)
=0D=0A
$HADOOP_COMMON_HOME  - /=
home/hduser/yarn/Hadoop-2=2E2=2E0
=0D=0A
$HAD=
OOP_HDFS_HOME - /home/hduser/yarn/Hadoop-2=2E2=2E0
=0D=
=0A
$HADOO_MAPRED_HOME - /home/hduser/yarn/Hadoop-2=2E2=2E0=

=0D=0A
$HADOOP_YARN_HOME - /home/hduser/yarn/Hadoop-=
2=2E2=2E0
=0D=0A
$HADOOP_CONF_DIR - /home/hduser=
/yarn/Hadoop-2=2E2=2E0/etc/hadoop
=0D=0A
untar hadoop m=
apreduce tarball  -  hmmm I assume this is the Hadoop-2=2E2=2E0 t=
ar file
=0D=0A
HDFS should be running=2E – I̵=
7;m sure this is trivial to do, but can anybody point out how to do this? I=
n previous versions the Hfile system had be formatted, but the command has =
apparently been deprecated=2E
=0D=0A
“bin/Hadoop =
namenode –format” – DEPRECATED: Use of this script to exe=
cute hdfs command is deprecated=2E Instead use the hdfs command for it=2E
=0D=0A
 
=0D=0A
sbin/yarn-daemo=
n=2Esh start resourcemanager – no visible errors
=0D=
=0A
sbin/yarn-daemon=2Esh start nodemanager – no visible errors
=0D=0A
 
=0D=0A
I’m assum=
ing that the previous two commands don’t start every component=2E I t=
ried the following: sbin/Hadoop-daemon=2Esh start namenode
=
=0D=0A
But I see the following error:
=0D=0A
Java=
=2Eio=2EIOException: NameNode is not formatted=2E 
=0D=0A 
=0D=0A
Thanks in advance to anybody that can =
help me get the single node up and running=2E Thanks=2E
=0D= =0A
 
=0D=0A

Thanks, Rodrigo=2E=  =0D=0A

=0D=0A<= /div>=0D=0A=0D=0A=0D=0A=0D=0A

= =0D=0A

=0D=0AThe information contained in this e-mail message is = intended only for the personal and confidential use of the recipient(s) nam= ed above=2E This message may be an attorney-client communication and/or wor= k product and as such is privileged and confidential=2E If the reader of th= is message is not the intended recipient or an agent responsible for delive= ring it to the intended recipient, you are hereby notified that you have re= ceived this document in error and that any review, dissemination, distribut= ion, or copying of this message is strictly prohibited=2E If you have recei= ved this communication in error, please notify us immediately by e-mail, an= d delete the original message=2E=0D=0A

--_000_54A8EF336FC15D4F946B9FE253F80F824A36F39BRISBCTMBXP002ri_--