Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A3C7C8C43 for ; Fri, 26 Aug 2011 03:25:21 +0000 (UTC) Received: (qmail 55469 invoked by uid 500); 26 Aug 2011 03:25:18 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 55032 invoked by uid 500); 26 Aug 2011 03:25:06 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 55018 invoked by uid 99); 26 Aug 2011 03:25:04 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Aug 2011 03:25:04 +0000 X-ASF-Spam-Status: No, hits=-0.6 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of marcosluis2186@googlemail.com designates 209.85.210.43 as permitted sender) Received: from [209.85.210.43] (HELO mail-pz0-f43.google.com) (209.85.210.43) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Aug 2011 03:24:56 +0000 Received: by pzk1 with SMTP id 1so5205084pzk.30 for ; Thu, 25 Aug 2011 20:24:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=5Y8SVEacHAr+WWHhdDyDDNUiK9Hnnxh8NYJ6vHMTQGI=; b=D7R2wAz4LNIhRfWcbsJnL7iEJCRszNyWSMc9MnMDd2tTX25+paMkf6csyiNb4aKStA iMaW13zkhfDwkHyuBVn53CHjAves91hETcn8OT7ctguebCMLWCWzyXSpS5nX2yhVcne4 xjLLIIk4fOX+d6LsAMmiNziBCWEEHXqFQTSD8= MIME-Version: 1.0 Received: by 10.142.47.2 with SMTP id u2mr302612wfu.80.1314329076004; Thu, 25 Aug 2011 20:24:36 -0700 (PDT) Received: by 10.68.60.168 with HTTP; Thu, 25 Aug 2011 20:24:35 -0700 (PDT) In-Reply-To: References: <1314318486.80551.YahooMailNeo@web125412.mail.ne1.yahoo.com> <1314319988.96915.YahooMailNeo@web125406.mail.ne1.yahoo.com> Date: Thu, 25 Aug 2011 23:24:35 -0400 Message-ID: Subject: Re: Error while trying to start hadoop on ubuntu lucene first time. From: Marcos Luis Ortiz Valmaseda To: common-user@hadoop.apache.org Cc: cdh-user@cloudera.org, sean wagner Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello, Sean, Can you provide the information how do you initialize the HDFS service? 2011/8/25, Harsh J : > Hello Sean, > > Welcome to the hadoop mailing lists, and thanks for asking your > question supplied with good data! > > Moving this to cdh-user@cloudera.org list as you're using the CDH3 > version of Apache Hadoop. (bcc'd common-user@hadoop.apache.org and > cc'd you) > > Some questions below: > > - Can you run "sudo -u hdfs df -kh /var/lib/hadoop-0.20/cache/dfs"? > What does the output carry? > > On Fri, Aug 26, 2011 at 6:23 AM, sean wagner wrote: >> >> >> Can anyone offer me some insight. It may have been due to me trying to r= un >> the start-all.sh script instead of starting the services. Not sure. >> >> Thanks >> Sean >> >> >> >> /************************************************************ >> STARTUP_MSG: Starting NameNode >> STARTUP_MSG: host =3D ubuntu-mogile-1/127.0.1.1 >> STARTUP_MSG: args =3D [] >> STARTUP_MSG: version =3D 0.20.2-cdh3u1 >> STARTUP_MSG: build =3D >> file:///tmp/nightly_2011-07-18_07-57-52_3/hadoop-0.20-0.20.2+923.97-1~lu= cid >> -r bdafb1dbffd0d5f2fbc6ee022e1c8df6500fd638; compiled by 'root' on Mon J= ul >> 18 09:40:01 PDT 2011 >> ************************************************************/ >> 2011-08-25 17:16:48,653 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: >> Initializing JVM Metrics with processName=3DNameNode, sessionId=3Dnull >> 2011-08-25 17:16:48,655 INFO >> org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics: >> Initializing NameNodeMeterics using context >> object:org.apache.hadoop.metrics.spi.NoEmitMetricsContext >> 2011-08-25 17:16:48,664 INFO org.apache.hadoop.hdfs.util.GSet: VM >> type =3D 64-bit >> 2011-08-25 17:16:48,664 INFO org.apache.hadoop.hdfs.util.GSet: 2% max >> memory =3D 17.77875 MB >> 2011-08-25 17:16:48,665 INFO org.apache.hadoop.hdfs.util.GSet: >> capacity =3D 2^21 =3D 2097152 entries >> 2011-08-25 17:16:48,665 INFO org.apache.hadoop.hdfs.util.GSet: >> recommended=3D2097152, actual=3D2097152 >> 2011-08-25 17:16:48,676 ERROR >> org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem >> initialization failed. >> java.io.IOException: Expecting a line not the end of stream >> at >> org.apache.hadoop.fs.DF.parseExecResult(DF.java:117) >> at org.apache.hadoop.util.Shell.runCommand(Shell.java:237) >> at org.apache.hadoop.util.Shell.run(Shell.java:182) >> at org.apache.hadoop.fs.DF.getFilesystem(DF.java:63) >> at >> org.apache.hadoop.hdfs.server.namenode.NameNodeResourceChecker.addDirsTo= Check(NameNodeResourceChecker.java:87) >> at >> org.apache.hadoop.hdfs.server.namenode.NameNodeResourceChecker.(Na= meNodeResourceChecker.java:71) >> at >> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesys= tem.java:348) >> at >> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.= java:327) >> at >> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java= :271) >> at >> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:46= 5) >> at >> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.= java:1224) >> at >> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1233) >> 2011-08-25 17:16:48,678 ERROR >> org.apache.hadoop.hdfs.server.namenode.NameNode: >> java.lang.NullPointerException >> at >> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.close(FSNamesystem.j= ava:560) >> at >> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.= java:330) >> at >> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java= :271) >> at >> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:465= ) >> at >> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.= java:1224) >> at >> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1233= ) >> >> 2011-08-25 17:16:48,678 INFO >> org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: >> /************************************************************ >> SHUTDOWN_MSG: Shutting down NameNode at ubuntu-mogile-1/127.0.1.1 >> ************************************************************/ >> >> >> >> 20$ sudo ls -lR >> .: >> total 4 >> drwxrwxrwx 4 root root 4096 2011-08-25 17:15 cache >> >> ./cache: >> total 8 >> drwxr-xr-x 3 hdfs hdfs 4096 2011-08-25 17:15 hdfs >> drwxr-xr-x 3 mapred mapred 4096 2011-08-25 17:15 mapred >> >> ./cache/hdfs: >> total 4 >> drwxr-xr-x 3 hdfs hdfs 4096 2011-08-25 17:15 dfs >> >> ./cache/hdfs/dfs: >> total 4 >> drwx------ 2 hdfs hdfs 4096 2011-08-25 17:15 data >> >> ./cache/hdfs/dfs/data: >> total 0 >> >> ./cache/mapred: >> total 4 >> drwxr-xr-x 3 mapred mapred 4096 >> 2011-08-25 17:15 mapred >> >> ./cache/mapred/mapred: >> total 4 >> drwxr-xr-x 6 mapred mapred 4096 2011-08-25 17:16 local >> >> ./cache/mapred/mapred/local: >> total 16 >> drwxr-xr-x 2 mapred mapred 4096 2011-08-25 17:16 taskTracker >> drwxr-xr-x 2 mapred mapred 4096 2011-08-25 17:16 toBeDeleted >> drwxr-xr-x 2 mapred mapred 4096 2011-08-25 17:16 tt_log_tmp >> drwx------ 2 mapred mapred 4096 2011-08-25 17:16 ttprivate >> >> ./cache/mapred/mapred/local/taskTracker: >> total 0 >> >> ./cache/mapred/mapred/local/toBeDeleted: >> total 0 >> >> ./cache/mapred/mapred/local/tt_log_tmp: >> total 0 >> >> ./cache/mapred/mapred/local/ttprivate: >> total 0 > > > > -- > Harsh J > --=20 --=20 Marcos Luis Ort=EDz Valmaseda Software Engineer (UCI) Linux User # 418229 http://marcosluis2186.posterous.com http://www.linkedin.com/in/marcosluis2186 https://fedoraproject.org/wiki/User:Marcosluis