Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: core-dev@hadoop.apache.org
Message-ID: <54768094.1214601585259.JavaMail.jira@brutus>
Date: Fri, 27 Jun 2008 14:19:45 -0700 (PDT)
From: "Lohit Vijayarenu (JIRA)" <jira@apache.org>
To: core-dev@hadoop.apache.org
Subject: [jira] Updated: (HADOOP-3649) ArrayIndexOutOfBounds in
 FSNamesystem.getBlockLocationsInternal
In-Reply-To: <1473486244.1214501384909.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HADOOP-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lohit Vijayarenu updated HADOOP-3649:
-------------------------------------

    Attachment: HADOOP-3649-1.patch

By writing a testcase we were able to reproduce this. The attached patch fixes this issue as described by Konstantin. Also, when a bad replica is reported, it is added to neededReplication. 

> ArrayIndexOutOfBounds in FSNamesystem.getBlockLocationsInternal
> ---------------------------------------------------------------
>
>                 Key: HADOOP-3649
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3649
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.18.0
>            Reporter: Arun C Murthy
>            Assignee: Lohit Vijayarenu
>            Priority: Blocker
>             Fix For: 0.18.0
>
>         Attachments: HADOOP-3649-1.patch
>
>
> A job-submission failed with:
> {noformat}
> org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.lang.ArrayIndexOutOfBoundsException: 2
>   at org.apache.hadoop.dfs.FSNamesystem.getBlockLocationsInternal(FSNamesystem.java:772)
>   at org.apache.hadoop.dfs.FSNamesystem.getBlockLocations(FSNamesystem.java:709)
>   at org.apache.hadoop.dfs.FSNamesystem.getBlockLocations(FSNamesystem.java:685)
>   at org.apache.hadoop.dfs.NameNode.getBlockLocations(NameNode.java:257)
>   at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
>   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   at java.lang.reflect.Method.invoke(Method.java:597)
>   at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
>   at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
>   at org.apache.hadoop.ipc.Client.call(Client.java:707)
>   at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:216)
>   at org.apache.hadoop.dfs.$Proxy0.getBlockLocations(Unknown Source)
>   at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
>   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   at java.lang.reflect.Method.invoke(Method.java:597)
>   at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>   at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>   at org.apache.hadoop.dfs.$Proxy0.getBlockLocations(Unknown Source)
>   at org.apache.hadoop.dfs.DFSClient.callGetBlockLocations(DFSClient.java:299)
>   at org.apache.hadoop.dfs.DFSClient.getBlockLocations(DFSClient.java:320)
>   at org.apache.hadoop.dfs.DistributedFileSystem.getFileBlockLocations(DistributedFileSystem.java:122)
>   at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:241)
>   at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:686)
>   at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:966)
>   at org.apache.hadoop.mapred.SortValidator$RecordStatsChecker.checkRecords(SortValidator.java:360)
>   at org.apache.hadoop.mapred.SortValidator.run(SortValidator.java:559)
>   at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>   at org.apache.hadoop.mapred.SortValidator.main(SortValidator.java:574)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   at java.lang.reflect.Method.invoke(Method.java:597)
>   at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
>   at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
>   at org.apache.hadoop.test.AllTestDriver.main(AllTestDriver.java:79)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   at java.lang.reflect.Method.invoke(Method.java:597)
>   at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
> {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.