From common-commits-return-12519-apmail-hadoop-common-commits-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 15 14:48:44 2011 Return-Path: Delivered-To: apmail-hadoop-common-commits-archive@www.apache.org Received: (qmail 80560 invoked from network); 15 Feb 2011 14:48:43 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 15 Feb 2011 14:48:43 -0000 Received: (qmail 62107 invoked by uid 500); 15 Feb 2011 14:48:43 -0000 Delivered-To: apmail-hadoop-common-commits-archive@hadoop.apache.org Received: (qmail 61482 invoked by uid 500); 15 Feb 2011 14:48:37 -0000 Mailing-List: contact common-commits-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-dev@hadoop.apache.org Delivered-To: mailing list common-commits@hadoop.apache.org Received: (qmail 61474 invoked by uid 500); 15 Feb 2011 14:48:36 -0000 Delivered-To: apmail-hadoop-core-commits@hadoop.apache.org Received: (qmail 61470 invoked by uid 99); 15 Feb 2011 14:48:36 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Feb 2011 14:48:36 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.131] (HELO eos.apache.org) (140.211.11.131) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Feb 2011 14:48:26 +0000 Received: from eosnew.apache.org (localhost [127.0.0.1]) by eos.apache.org (Postfix) with ESMTP id 1906917D; Tue, 15 Feb 2011 14:47:55 +0000 (UTC) MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable From: Apache Wiki To: Apache Wiki Date: Tue, 15 Feb 2011 14:47:55 -0000 Message-ID: <20110215144755.72973.50678@eosnew.apache.org> Subject: =?utf-8?q?=5BHadoop_Wiki=5D_Update_of_=22GettingStartedWithHadoop=22_by_D?= =?utf-8?q?avidBiesack?= X-Virus-Checked: Checked by ClamAV on apache.org Dear Wiki user, You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for ch= ange notification. The "GettingStartedWithHadoop" page has been changed by DavidBiesack. The comment on this change is: add note that this page is not current; link= to config doc. http://wiki.apache.org/hadoop/GettingStartedWithHadoop?action=3Ddiff&rev1= =3D30&rev2=3D31 -------------------------------------------------- ## page was renamed from GettingStartedWithHadoop =3D Downloading and installing Hadoop =3D = - Hadoop can be downloaded from one of the [[http://www.apache.org/dyn/clos= er.cgi/hadoop/|Apache download mirrors]]. You may also download a [[http://= people.apache.org/builds/lucene/hadoop/nightly/|nightly build]] or check ou= t the code from [[http://lucene.apache.org/hadoop/version_control.html|subv= ersion]] and build it with [[http://ant.apache.org|Ant]]. Select a director= y to install Hadoop under (let's say {{{/foo/bar/hadoop-install}}}) and unt= ar the tarball in that directory. A directory corresponding to the version = of Hadoop downloaded will be created under the {{{/foo/bar/hadoop-install}}= } directory. For instance, if version 0.6.0 of Hadoop was downloaded untarr= ing as described above will create the directory {{{/foo/bar/hadoop-install= /hadoop-0.6.0}}}. The examples in this document assume the existence of an = environment variable {{{$HADOOP_INSTALL}}} that represents the path to all = versions of Hadoop installed. In the above instance {{{HADOOP_INSTALL=3D/fo= o/bar/hadoop-install}}}. They further assume the existence of a symlink nam= ed {{{hadoop}}} in {{{$HADOOP_INSTALL}}} that points to the version of Hado= op being used. For instance, if version 0.6.0 is being used then {{{$HADOOP= _INSTALL/hadoop -> hadoop-0.6.0}}}. All tools used to run Hadoop will be pr= esent in the directory {{{$HADOOP_INSTALL/hadoop/bin}}}. All configuration = files for Hadoop will be present in the directory {{{$HADOOP_INSTALL/hadoop= /conf}}}. + Hadoop can be downloaded from one of the [[http://www.apache.org/dyn/clos= er.cgi/hadoop/|Apache download mirrors]]. You may also download a [[http://= people.apache.org/builds/lucene/hadoop/nightly/|nightly build]] or check ou= t the code from [[http://lucene.apache.org/hadoop/version_control.html|subv= ersion]] and build it with [[http://ant.apache.org|Ant]]. Select a director= y to install Hadoop under (let's say {{{/foo/bar/hadoop-install}}}) and unt= ar the tarball in that directory. A directory corresponding to the version = of Hadoop downloaded will be created under the {{{/foo/bar/hadoop-install}}= } directory. For instance, if version 0.21.0 of Hadoop was downloaded untar= ring as described above will create the directory {{{/foo/bar/hadoop-instal= l/hadoop-0.21.0}}}. The examples in this document assume the existence of a= n environment variable {{{$HADOOP_INSTALL}}} that represents the path to al= l versions of Hadoop installed. In the above instance {{{HADOOP_INSTALL=3D/= foo/bar/hadoop-install}}}. They further assume the existence of a symlink n= amed {{{hadoop}}} in {{{$HADOOP_INSTALL}}} that points to the version of Ha= doop being used. For instance, if version 0.21.0 is being used then {{{$HAD= OOP_INSTALL/hadoop -> hadoop-0.21.0}}}. All tools used to run Hadoop will b= e present in the directory {{{$HADOOP_INSTALL/hadoop/bin}}}. All configurat= ion files for Hadoop will be present in the directory {{{$HADOOP_INSTALL/ha= doop/conf}}}. = =3D=3D Startup scripts =3D=3D = The {{{$HADOOP_INSTALL/hadoop/bin}}} directory contains some scripts used= to launch Hadoop DFS and Hadoop Map/Reduce daemons. These are: = - * {{{start-all.sh}}} - Starts all Hadoop daemons, the namenode, datanode= s, the jobtracker and tasktrackers. + * {{{start-dfs.sh}}} - Starts the Hadoop DFS daemons, the namenode and d= atanodes. Use this before {{{start-mapred.sh}}} = - * {{{stop-all.sh}}} - Stops all Hadoop daemons. + * {{{stop-dfs.sh}}} - Stops the Hadoop DFS daemons. * {{{start-mapred.sh}}} - Starts the Hadoop Map/Reduce daemons, the jobt= racker and tasktrackers. * {{{stop-mapred.sh}}} - Stops the Hadoop Map/Reduce daemons. - * {{{start-dfs.sh}}} - Starts the Hadoop DFS daemons, the namenode and d= atanodes. - * {{{stop-dfs.sh}}} - Stops the Hadoop DFS daemons. + * {{{start-all.sh}}} - Starts all Hadoop daemons, the namenode, datanode= s, the jobtracker and tasktrackers. Deprecated; use {{{start-dfs.sh}}} then= {{{start-mapred.sh}}} = + * {{{stop-all.sh}}} - Stops all Hadoop daemons. Deprecated; use {{{stop-= mapred.sh}}} then {{{stop-dfs.sh}}} = It is also possible to run the Hadoop daemons as Windows Services using t= he [[http://wrapper.tanukisoftware.org/|Java Service Wrapper]] (download th= is separately). This still requires Cygwin to be installed as Hadoop requir= es its df command. See the following JIRA issues for details: = @@ -23, +23 @@ * https://issues.apache.org/jira/browse/HADOOP-1526 = =3D=3D Configuration files =3D=3D + = + [[http://hadoop.apache.org/common/docs/current/cluster_setup.html#Configu= rationml | Hadoop Cluster Setup/Configuration]] contains a description of H= adoop configuration for 0.21.0. The information on this wiki page is not cu= rrent. See also QuickStart which is current for 0.21.0. = The {{{$HADOOP_INSTALL/hadoop/conf}}} directory contains some configurati= on files for Hadoop. These are: =20