Return-Path: Delivered-To: apmail-lucene-hadoop-user-archive@locus.apache.org Received: (qmail 37148 invoked from network); 24 May 2007 17:51:49 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 24 May 2007 17:51:49 -0000 Received: (qmail 39365 invoked by uid 500); 24 May 2007 17:51:52 -0000 Delivered-To: apmail-lucene-hadoop-user-archive@lucene.apache.org Received: (qmail 39337 invoked by uid 500); 24 May 2007 17:51:52 -0000 Mailing-List: contact hadoop-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-user@lucene.apache.org Delivered-To: mailing list hadoop-user@lucene.apache.org Received: (qmail 39328 invoked by uid 99); 24 May 2007 17:51:52 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 May 2007 10:51:52 -0700 X-ASF-Spam-Status: No, hits=0.3 required=10.0 tests=MAILTO_TO_SPAM_ADDR X-Spam-Check-By: apache.org Received-SPF: pass (herse.apache.org: local policy) Received: from [146.169.1.194] (HELO finch.doc.ic.ac.uk) (146.169.1.194) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 May 2007 10:51:46 -0700 Received: from ip-89-168-40-36.cust.homechoice.net ([89.168.40.36]) by finch.doc.ic.ac.uk with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.63) (envelope-from ) id 1HrHT9-0002YW-Td for hadoop-user@lucene.apache.org; Thu, 24 May 2007 18:51:24 +0100 Message-ID: <4655D098.5050007@doc.ic.ac.uk> Date: Thu, 24 May 2007 18:51:20 +0100 From: yu-yang chen User-Agent: Thunderbird 1.5.0.10 (Macintosh/20070221) MIME-Version: 1.0 To: hadoop-user@lucene.apache.org Subject: Re: Beginner to Hadoop, please help References: <46549D84.7000406@doc.ic.ac.uk> <46556C8F.4010203@doc.ic.ac.uk> <46557395.5070004@doc.ic.ac.uk> <002c01c79e25$a5e056f0$d09215ac@ds.corp.yahoo.com> In-Reply-To: <002c01c79e25$a5e056f0$d09215ac@ds.corp.yahoo.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-ICDoC-Trusted: YES X-BrightMail-Verdict: X-BrightMail-Tracker: X-Spam-Level: X-Virus-Checked: Checked by ClamAV on apache.org X-Old-Spam-Flag: NO Thanks to all those answered my question, I solved the problem finally: After getting path not found error, I manually deleted the dfs file system in /tmp/hadoop-yyc04/mapred/system and reformat( bin/hadoop namenode -format) again, which then worked. Just in case someone else run into the same problem as me in the future, here is one suggestion :) ps: to shut down the dfs, it actually takes a while before it kills all the namenodes completely...so after you run bin/stop-all.sh, you might want to wait for few second before start again. Thanks again Regards yu-yang Hairong Kuang wrote: > Please make sure to shut down your dfs before you restart it. To shut down > your dfs, you can either run stop-dfs.sh on namenode or go to each datanode > kill each datanode java process. > > After you start your dfs, you may check your cluster status by either > running "hadoop dfsadmin -report" or browsing to a web UI, which by default > should be at http://namenode:50070. > > Hairong > > -----Original Message----- > From: yu-yang chen [mailto:yyc04@doc.ic.ac.uk] > Sent: Thursday, May 24, 2007 4:14 AM > To: hadoop-user@lucene.apache.org > Subject: Re: Beginner to Hadoop, please help > > Oh, here is the error reported in the log: > > 2007-05-23 23:34:01,716 WARN org.apache.hadoop.dfs.StateChange: DIR* > FSDirectory.unprotectedDelete: failed to remove > /tmp/hadoop-yyc04/mapred/system because it does not exist > 2007-05-23 23:34:01,723 ERROR org.apache.hadoop.dfs.NameNode: > java.io.FileNotFoundException: Parent path does not exist: > /tmp/hadoop-yyc04/mapred/system > at > org.apache.hadoop.dfs.FSDirectory$INode.addNode(FSDirectory.java:195) > > but i checked, and /tmp/hadoop-yyc04/mapred/system does exist in the > system....how should I fix this? > > Thank you for answering > > yuyang > > yu-yang chen wrote: > >> Hello, thank you for the reply. >> I checked the hosts list and all the name I am using is fully >> resolvable. And I even tried to use ip address, but still obtain: >> >> Retrying connect to server: camelot01-ib.doc.ic.ac.uk/10.100.1.1:9000. >> Already tried 1 time(s) >> .... >> Retrying connect to server: camelot01-ib.doc.ic.ac.uk/10.100.1.1:9000. >> Already tried 10 time(s) >> >> I read some post in internet, and thinking could it be my nadenode >> problem? which port 9000 was not opened.. >> >> this is what happened when i do bin/start-*.sh >> >> it shows: datanode running as process 32322. Stop it first.......is >> this normal? why stop it first? >> >> I checked the process list on the datanode, there are 3 java processes >> running, but the port 9000 wasn't Listening...what is the possible cause? >> >> >> camelot01% bin/start-dfs.sh >> starting namenode, logging to >> /homes/yyc04/hadoop-install/hadoop/bin/../logs/hadoop-yyc04-namenode-c >> amelot01.out >> >> camelot01-ib.doc.ic.ac.uk: datanode running as process 32322. Stop it >> first. >> localhost: @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ >> localhost: @ WARNING: POSSIBLE DNS SPOOFING DETECTED! @ >> localhost: @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ >> localhost: The RSA host key for localhost has changed, >> localhost: and the key for the according IP address 146.169.2.131 >> localhost: is unchanged. This could either mean that >> localhost: DNS SPOOFING is happening or the IP address for the host >> localhost: and its host key have changed at the same time. >> localhost: Offending key for IP in /homes/yyc04/.ssh/known_hosts:7 >> localhost: @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ >> localhost: @ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @ >> localhost: @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ >> localhost: IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY! >> localhost: Someone could be eavesdropping on you right now >> (man-in-the-middle attack)! >> localhost: It is also possible that the RSA host key has just been >> changed. >> localhost: The fingerprint for the RSA key sent by the remote host is >> localhost: 25:2d:94:54:7f:7b:a6:1f:eb:26:83:8f:9b:f8:b0:a4. >> localhost: Please contact your system administrator. >> localhost: Add correct host key in /homes/yyc04/.ssh/known_hosts to >> get rid of this message. >> localhost: Offending key in /homes/yyc04/.ssh/known_hosts:24 >> localhost: Password authentication is disabled to avoid >> man-in-the-middle attacks. >> localhost: Keyboard-interactive authentication is disabled to avoid >> man-in-the-middle attacks. >> localhost: X11 forwarding is disabled to avoid man-in-the-middle attacks. >> localhost: starting secondarynamenode, logging to >> /homes/yyc04/hadoop-install/hadoop/bin/../logs/hadoop-yyc04-secondaryn >> amenode-camelot01.out >> >> camelot01% bin/start- >> start-all.sh* start-dfs.sh* start-mapred.sh* >> >> camelot01% bin/start-mapred.sh >> jobtracker running as process 32604. Stop it first. >> camelot01-ib.doc.ic.ac.uk: tasktracker running as process 343. Stop it >> first. >> >> >> this is my hadoop-site.xml >> >> property> >> fs.default.name >> camelot-ib.doc.ic.ac.uk:9000 >> >> >> >> mapred.job.tracker >> camelot-ib.doc.ic.ac.uk:9001 >> >> >> >> dfs.replication >> 1 >> >> >> Thank you all for answering, and if possible, help me with this case >> again~ >> >> yu-yang >> >> >> >> >> Wayne Liu wrote: >> >>> 2007/5/24, yu-yang chen : >>> >>>> Hello, after change the domain name, it still fails. >>>> >>>> I just realise something: >>>> >>>> when i run : >>>> camelot01% bin/hadoop jar hadoop-0.12.3-test.jar testrpc >>>> >>> >>> Well, I think you'd better check the file /etc/hosts. >>> for example,my computer name : wayne , so the file hosts may be like >>> this: >>> 127.0.0.1 localhost >>> 202.197.18.27 wayne >>> If you are not sure about this,just have a try to ping your computer >>> name. >>> >>> > > >