Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 13869 invoked from network); 7 Oct 2008 21:59:37 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 7 Oct 2008 21:59:37 -0000 Received: (qmail 5146 invoked by uid 500); 7 Oct 2008 21:59:33 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 5114 invoked by uid 500); 7 Oct 2008 21:59:33 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 5103 invoked by uid 99); 7 Oct 2008 21:59:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Oct 2008 14:59:33 -0700 X-ASF-Spam-Status: No, hits=-1999.9 required=10.0 tests=ALL_TRUSTED,DNS_FROM_SECURITYSAGE X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Oct 2008 21:58:38 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 6858A234C213 for ; Tue, 7 Oct 2008 14:58:44 -0700 (PDT) Message-ID: <1661784912.1223416724426.JavaMail.jira@brutus> Date: Tue, 7 Oct 2008 14:58:44 -0700 (PDT) From: "Hairong Kuang (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-4351) ArrayIndexOutOfBoundsException during fsck In-Reply-To: <1763871932.1223302424203.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-4351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12637671#action_12637671 ] Hairong Kuang commented on HADOOP-4351: --------------------------------------- > it appears that the error happens when there are corrupt entries which are not in the blocksMap, but they are in the corruptReplicas object. The solutions discussed avoid the exception to be thrown, but it does not fix the above fundamental problem. > ArrayIndexOutOfBoundsException during fsck > ------------------------------------------ > > Key: HADOOP-4351 > URL: https://issues.apache.org/jira/browse/HADOOP-4351 > Project: Hadoop Core > Issue Type: Bug > Affects Versions: 0.18.1 > Reporter: Brian Bockelman > Attachments: fsck_hadoop_4351.patch > > > After observing a lot of corrupted blocks, I suddenly started to get a lot of ArrayIndexOutOfBoundsException. > It appears to be an issue very similar to HADOOP-3649, which is supposed to be fixed in 0.18.1. > 2008-10-06 08:48:43,241 WARN /: /fsck?path=%2F: > java.lang.ArrayIndexOutOfBoundsException: 2 > at org.apache.hadoop.dfs.FSNamesystem.getBlockLocationsInternal(FSNamesystem.java:789) > at org.apache.hadoop.dfs.FSNamesystem.getBlockLocations(FSNamesystem.java:727) > at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:167) > at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162) > at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162) > at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162) > at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162) > at org.apache.hadoop.dfs.NamenodeFsck.fsck(NamenodeFsck.java:128) > at org.apache.hadoop.dfs.FsckServlet.doGet(FsckServlet.java:48) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427) > at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475) > at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567) > at org.mortbay.http.HttpContext.handle(HttpContext.java:1565) > at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635) > at org.mortbay.http.HttpContext.handle(HttpContext.java:1517) > at org.mortbay.http.HttpServer.service(HttpServer.java:954) > at org.mortbay.http.HttpConnection.service(HttpConnection.java:814) > at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981) > at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831) > at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244) > at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357) > at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.