Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 68373 invoked from network); 30 Aug 2010 02:50:25 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 30 Aug 2010 02:50:25 -0000 Received: (qmail 93496 invoked by uid 500); 30 Aug 2010 02:50:22 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 93305 invoked by uid 500); 30 Aug 2010 02:50:20 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 93297 invoked by uid 99); 30 Aug 2010 02:50:19 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 30 Aug 2010 02:50:19 +0000 X-ASF-Spam-Status: No, hits=0.7 required=10.0 tests=FREEMAIL_FROM,SPF_NEUTRAL,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [202.165.103.48] (HELO web15903.mail.cnb.yahoo.com) (202.165.103.48) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 30 Aug 2010 02:50:13 +0000 Received: (qmail 66869 invoked by uid 60001); 30 Aug 2010 02:49:50 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com.cn; s=s1024; t=1283136590; bh=jlf9kkJAS/mkIIPXv72spGEm7TUH5i2KHnP4jXt9QsE=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=YNxSlVxnL1avldmMTnruozPt+10VU4wiTL0CkLwFmcm4vJBTCn5gVSaLoCKxZ0kh7CXPRJKgDWQqBoKSzFBTF7zy1uk18MLUFoGBu+tZwhaVBI2ggS2S5tXuEyxd3P+9kFopmPwDxARVnsJEcsK8ThSBE0uRAAWg+q2fFE5Fapw= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com.cn; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=PWBDNwXZHJ3yB5P+XtAZG50naL5qN+Lhfvi+SC5MolcDb6LBXj5f9CCGCVKE8dxYP5QZLV+wpvtSpOAw/82Colm1xJEuXbP2IZn1Wj6GY53L3ed+OVq27htkl/9nmeWsurRtixz3q6WD3k9L6yRNpy4QeOsC2uqrRaBc0dE2H0A=; Message-ID: <298769.66859.qm@web15903.mail.cnb.yahoo.com> X-YMail-OSG: WHPye9wVM1kqKsROE8gac.htYlatgUb3zZmavCZjJ1P.tZR XgFUa.APnPJpXcUQ4UQt6ABsCpWh36iZ62EAtTGZhu1lKTQS05c4SlD6LNBa rCg6MyKRrpB9FDJjCp8il.6Jc0OvUtkeEWSXliiEnLxrWKm5AGhjAY6FI9HP RhW9YY8lcc1trKKwgSbIw5e692mXfIH2nkOewyY99s_kCf8iICyJbHqhRlzy gV14GvKBxmlbXZsxyVk4lFurkot9ePudzjR2CvQKeFM3ZpmHlAqRfgSN4ql1 DuG2DjSOb8uOl5r2Is0fMaLgAJfE- Received: from [98.122.176.35] by web15903.mail.cnb.yahoo.com via HTTP; Mon, 30 Aug 2010 10:49:50 CST X-Mailer: YahooMailRC/470 YahooMailWebService/0.8.105.279950 References: <4C7AEF9D.7020702@gmail.com> Date: Mon, 30 Aug 2010 10:49:50 +0800 (CST) From: Gang Luo Subject: cluster startup problem To: common-user@hadoop.apache.org In-Reply-To: <4C7AEF9D.7020702@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi all,=0AI am trying to configure and start a hadoop cluster on EC2. I got= some problems =0Ahere. =0A=0A=0A1. Can I share hadoop code and its configu= ration across nodes? Say I have a =0Adistributed file system running in the= cluster and all the nodes could see the =0Ahadoop code and conf there. So = all the nodes will use the same copy of code and =0Aconf to run. Is it poss= ible?=0A=0A2. if all the nodes could share hadoop and conf, does it mean I = can launch =0Ahadoop (bin/start-dfs.sh, bin/start-mapred.sh) from any node = (even slave node)?=0A=0A3. I think I specify and master and slave correctly= . When I launch hadoop from =0Amaster node, no tasktracker or datanode was = launched on slave nodes. The log on =0Aslave nodes says: =0A=0AERROR org.ap= ache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: =0AIncompat= ible namespaceIDs in /mnt/hadoop/dfs/data: namenode namespaceID =3D =0A1048= 149291; datanode namespaceID =3D 313740560=0A=0Awhat is the problem?=0A=0AT= hanks,=0A-Gang=0A=0A=0A=0A