Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 27792 invoked from network); 9 Jul 2008 13:55:38 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 9 Jul 2008 13:55:38 -0000 Received: (qmail 72329 invoked by uid 500); 9 Jul 2008 13:55:34 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 72295 invoked by uid 500); 9 Jul 2008 13:55:34 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Delivered-To: moderator for core-user@hadoop.apache.org Received: (qmail 56300 invoked by uid 99); 9 Jul 2008 13:48:01 -0000 X-ASF-Spam-Status: No, hits=3.9 required=10.0 tests=FS_REPLICA,SPF_PASS,TRACKER_ID X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Message-ID: <4874C165.2050208@adacor.com> Date: Wed, 09 Jul 2008 15:47:17 +0200 From: Christian Saar Organization: ADACOR Hosting GmbH User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.14) Gecko/20080421 Lightning/0.8 Thunderbird/2.0.0.14 Mnenhy/0.7.5.0 MIME-Version: 1.0 To: core-user@hadoop.apache.org Subject: NotReplicatedYetException X-Enigmail-Version: 0.95.6 OpenPGP: id=7D8B7B37 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig130D1BEEAE310F32C58C6346" X-Virus-Checked: Checked by ClamAV on apache.org --------------enig130D1BEEAE310F32C58C6346 Content-Type: multipart/mixed; boundary="------------020804090203080800080203" This is a multi-part message in MIME format. --------------020804090203080800080203 Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: quoted-printable Hi all, When we are copying big files in our hadoop cluster, we become between 0 and 4 times the "NotReplicatedYetException". Is there any Solution to prevent this Exception? I thing it slows down? Bigger Buffers or anything else? Each Node has 3x 1Gb/s bonded interface. Each Datanode has an 3Ware 9650 24 Port with 24 1TB Western Digital in RAID 6 with one Hotspare. all Systems are CentOS 5.1 64bit with 64bit Java JDK 1.6.0_06 > 08/07/09 15:28:17 WARN dfs.DFSClient: NotReplicatedYetException sleepin= g /rbc/testadacor/5.dat retries left 1 > 08/07/09 15:28:21 INFO dfs.DFSClient: org.apache.hadoop.ipc.RemoteExcep= tion: org.apache.hadoop.dfs.NotReplicatedYetException: Not replicated yet= :/rbc/testadacor/5.dat > at org.apache.hadoop.dfs.FSNamesystem.getAdditionalBlock(FSName= system.java:1131) > at org.apache.hadoop.dfs.NameNode.addBlock(NameNode.java:300) > at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe= thodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:446) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896) >=20 > at org.apache.hadoop.ipc.Client.call(Client.java:557) > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:212) > at org.apache.hadoop.dfs.$Proxy0.addBlock(Unknown Source) > at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe= thodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMeth= od(RetryInvocationHandler.java:82) > at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(Ret= ryInvocationHandler.java:59) > at org.apache.hadoop.dfs.$Proxy0.addBlock(Unknown Source) > at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.locateFollow= ingBlock(DFSClient.java:2334) > at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.nextBlockOut= putStream(DFSClient.java:2219) > at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.access$1700(= DFSClient.java:1702) > at org.apache.hadoop.dfs.DFSClient$DFSOutputStream$DataStreamer= =2Erun(DFSClient.java:1842) >=20 > 08/07/09 15:28:21 INFO dfs.DFSClient: Waiting for replication for 6 sec= onds > 08/07/09 15:28:21 WARN dfs.DFSClient: NotReplicatedYetException sleepin= g /rbc/testadacor/5.dat retries left 0 > 08/07/09 15:28:27 INFO dfs.DFSClient: org.apache.hadoop.ipc.RemoteExcep= tion: org.apache.hadoop.dfs.NotReplicatedYetException: Not replicated yet= :/rbc/testadacor/5.dat > at org.apache.hadoop.dfs.FSNamesystem.getAdditionalBlock(FSName= system.java:1131) > at org.apache.hadoop.dfs.NameNode.addBlock(NameNode.java:300) > at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe= thodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:446) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896) >=20 > at org.apache.hadoop.ipc.Client.call(Client.java:557) > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:212) > at org.apache.hadoop.dfs.$Proxy0.addBlock(Unknown Source) > at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe= thodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMeth= od(RetryInvocationHandler.java:82) > at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(Ret= ryInvocationHandler.java:59) > at org.apache.hadoop.dfs.$Proxy0.addBlock(Unknown Source) > at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.locateFollow= ingBlock(DFSClient.java:2334) > at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.nextBlockOut= putStream(DFSClient.java:2219) > at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.access$1700(= DFSClient.java:1702) > at org.apache.hadoop.dfs.DFSClient$DFSOutputStream$DataStreamer= =2Erun(DFSClient.java:1842) >=20 > 08/07/09 15:28:27 INFO dfs.DFSClient: Waiting for replication for 12 se= conds > 08/07/09 15:28:27 WARN dfs.DFSClient: NotReplicatedYetException sleepin= g /rbc/testadacor/5.dat retries left -1 --=20 mit freundlichen Gr=FC=DFen Christian Saar =2E............................................... Adacor Hosting GmbH Kaiserleistrasse 51 D-63067 Offenbach am Main Telefon +49 (0)69 905089 2110 Telefax +49 (0)69 905089 29 Email saar@adacor.com Zentrale: Telefon +49 (0)69 905089 0 Telefax +49 (0)69 905089 29 Web http://www.adacor.com Amtsgericht Frankfurt am Main HRB 56690 Gesch=E4ftsf=FChrer: Thomas Wittbecker, Andreas Bachmann, Patrick Fend ------------------------------------------------------------------- This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorised copying, disclosure or distribution of the contents of this e-mail is strictly prohibited. ------------------------------------------------------------------- --------------020804090203080800080203 Content-Type: text/x-vcard; charset=utf-8; name="saar.vcf" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="saar.vcf" begin:vcard fn:Christian Saar n:Saar;Christian org:ADACOR Hosting GmbH adr;quoted-printable:;;Kaiserleistra=3DC3=3D9Fe 51;Offenbach am Main;Hess= en;63067;Germany email;internet:saar@adacor.com tel;work:+49 69 905089 2110 x-mozilla-html:FALSE url:http://www.adacor.com version:2.1 end:vcard --------------020804090203080800080203-- --------------enig130D1BEEAE310F32C58C6346 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkh0wWkACgkQPjOFqn2LezfOBQCgnvYBr3I+UAn1YZNOnzvT+uuw xnYAn2JfZ5SFBwrdMbtrzGOWyACuDkVl =WeO8 -----END PGP SIGNATURE----- --------------enig130D1BEEAE310F32C58C6346--