Return-Path: Delivered-To: apmail-hbase-user-archive@www.apache.org Received: (qmail 20334 invoked from network); 5 Apr 2011 06:59:26 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 5 Apr 2011 06:59:26 -0000 Received: (qmail 3569 invoked by uid 500); 5 Apr 2011 06:59:24 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 3488 invoked by uid 500); 5 Apr 2011 06:59:22 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 3469 invoked by uid 99); 5 Apr 2011 06:59:20 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Apr 2011 06:59:20 +0000 X-ASF-Spam-Status: No, hits=3.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of eltonsky9404@gmail.com designates 74.125.82.169 as permitted sender) Received: from [74.125.82.169] (HELO mail-wy0-f169.google.com) (74.125.82.169) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Apr 2011 06:59:13 +0000 Received: by wyf19 with SMTP id 19so73612wyf.14 for ; Mon, 04 Apr 2011 23:58:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=udbyQLmKU3RUY02Un7K4LKrhvtAF2q+wm+UdqabrExU=; b=lzvg2IwSB7T+Cw4zsLp30mmRbQF8r6o94d7I4arvUFSy8yZMD4VTs5QTDIyrFmuh3T hMtderxFXtdMIx8GC1m8lpmgTliN/eS3Tcn3E2b4Da7EfNVJWtoE/aRkL2mEgdvy0KlJ tjy5e+iixUHuGL16GHNuhLKdsiYZzTsABgW6s= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=GJaR57vCfBN9m25BXY8phF/crXNfF7rk6eiRm26m7TtjIlHAnYLl32uIYJWTSAT55D hlOJeick9EBkoBDrKq1xfkeZ9gxzTKycZ8X37Ux8r21HlcxlZGl3sUL7NZGLyCqqUGLb iFFHgR5CSGic+H47qyLdz0izSC/BAUEAd0mPc= MIME-Version: 1.0 Received: by 10.227.110.37 with SMTP id l37mr7889742wbp.114.1301986733408; Mon, 04 Apr 2011 23:58:53 -0700 (PDT) Received: by 10.227.3.21 with HTTP; Mon, 4 Apr 2011 23:58:53 -0700 (PDT) In-Reply-To: <31321155.post@talk.nabble.com> References: <31321155.post@talk.nabble.com> Date: Tue, 5 Apr 2011 16:58:53 +1000 Message-ID: Subject: Re: Getting Error in Hadoop Cluster Mode From: elton sky To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=000e0cd30774bf489204a0266827 X-Virus-Checked: Checked by ClamAV on apache.org --000e0cd30774bf489204a0266827 Content-Type: text/plain; charset=ISO-8859-1 Hi, Have you formatted your name node and data nodes before start daemons? If not, that is the reason. Try: hadoop namenode -format then on each data node: hadoop datanode -format Then try to start daemons. -elton On Tue, Apr 5, 2011 at 4:04 PM, prasunb wrote: > > Hello, > > I am new in Hadoop and I am struggling to configure it in fully > distribution > mode. > > I have created three virtual machines (hadoop1, hadoop2 and hadoop3) with > Fedora 12 and installed Hadoop in pseudo distributed mode on each of them > successfully. I have followed the steps from cloudera site to configure > hadoop cluster > (https://docs.cloudera.com/display/DOC/CDH2+Deployment+on+a+Cluster ). > > I am getting following error when I am trying to run the "put" command on > the cluster. Here is the error... > > ========================================================================= > #hadoop-0.20 fs -put foo test/ > 11/04/05 10:56:55 WARN hdfs.DFSClient: DataStreamer Exception: > org.apache.hadoop.ipc.RemoteException: java.io.IOException: File > /user/root/test/foo could only be replicated to 0 nodes, instead of 1 > at > > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:643) > at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1416) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1412) > . > . > . > 11/04/05 10:56:55 WARN hdfs.DFSClient: Error Recovery for block null bad > datanode[0] nodes == null > 11/04/05 10:56:55 WARN hdfs.DFSClient: Could not get block locations. > Source > file "/user/root/test/foo" - Aborting... > put: java.io.IOException: File /user/root/test/foo could only be replicated > to 0 nodes, instead of 1 > 11/04/05 10:56:55 ERROR hdfs.DFSClient: Exception closing file > /user/root/test/foo : org.apache.hadoop.ipc.RemoteException: > java.io.IOException: File /user/root/test/foo could only be replicated to 0 > nodes, instead of 1 > at > > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:643) > at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > > ============================================================================= > > > When I checked through the web ( http://hadoop1:50070/ ), it is showing > Dead > Nodes- 3 and Live Nodes- 0. > > Can anyone please help me to understand the problem. I have uploaded the > configuration files, please have a look into them in case i have missed > anything. > > Thanks. http://old.nabble.com/file/p31321155/hdfs-site.xml hdfs-site.xml > http://old.nabble.com/file/p31321155/mapred-site.xml mapred-site.xml > http://old.nabble.com/file/p31321155/hadoop-env.sh hadoop-env.sh > http://old.nabble.com/file/p31321155/core-site.xml core-site.xml > -- > View this message in context: > http://old.nabble.com/Getting-Error-in-Hadoop-Cluster-Mode-tp31321155p31321155.html > Sent from the HBase User mailing list archive at Nabble.com. > > --000e0cd30774bf489204a0266827--