From hdfs-issues-return-257724-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org Sun Mar 24 19:47:02 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 40CBA18075F for ; Sun, 24 Mar 2019 20:47:02 +0100 (CET) Received: (qmail 25739 invoked by uid 500); 24 Mar 2019 19:47:01 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 25485 invoked by uid 99); 24 Mar 2019 19:47:01 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 24 Mar 2019 19:47:01 +0000 Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 82787E0704 for ; Sun, 24 Mar 2019 19:47:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 3DD992459B for ; Sun, 24 Mar 2019 19:47:00 +0000 (UTC) Date: Sun, 24 Mar 2019 19:47:00 +0000 (UTC) From: "Shashikant Banerjee (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDDS-1317) KeyOutputStream#write throws ArrayIndexOutOfBoundsException when running RandomWrite MR examples MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDDS-1317?page=3Dcom.atlassian= .jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-1317: -------------------------------------- Attachment: HDDS-1317.003.patch > KeyOutputStream#write throws ArrayIndexOutOfBoundsException when running = RandomWrite MR examples > -------------------------------------------------------------------------= ----------------------- > > Key: HDDS-1317 > URL: https://issues.apache.org/jira/browse/HDDS-1317 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task > Affects Versions: 0.4.0 > Reporter: Xiaoyu Yao > Assignee: Shashikant Banerjee > Priority: Major > Labels: pull-request-available > Attachments: HDDS-1317.000.patch, HDDS-1317.001.patch, HDDS-1317.= 002.patch, HDDS-1317.003.patch > > Time Spent: 50m > Remaining Estimate: 0h > > Repro steps: > {code}=C2=A0 > jar $HADOOP_MAPRED_HOME/hadoop-mapreduce-examples-*.jar randomwriter -Dte= st.randomwrite.total_bytes=3D10000000=C2=A0 o3fs://bucket1.vol1/randomwrite= .out > {code} > =C2=A0 > Error Stack: > {code} > 2019-03-20 19:02:37 INFO Job:1686 - Task Id : attempt_1553108378906_0002_= m_000000_0, Status : FAILED > Error: java.lang.ArrayIndexOutOfBoundsException: -5 > at java.util.ArrayList.elementData(ArrayList.java:422) > at java.util.ArrayList.get(ArrayList.java:435) > at org.apache.hadoop.hdds.scm.storage.BufferPool.getBuffer(BufferPool.ja= va:45) > at org.apache.hadoop.hdds.scm.storage.BufferPool.allocateBufferIfNeeded(= BufferPool.java:59) > at org.apache.hadoop.hdds.scm.storage.BlockOutputStream.write(BlockOutpu= tStream.java:215) > at org.apache.hadoop.ozone.client.io.BlockOutputStreamEntry.write(BlockO= utputStreamEntry.java:130) > at org.apache.hadoop.ozone.client.io.KeyOutputStream.handleWrite(KeyOutp= utStream.java:311) > at org.apache.hadoop.ozone.client.io.KeyOutputStream.write(KeyOutputStre= am.java:273) > at org.apache.hadoop.fs.ozone.OzoneFSOutputStream.write(OzoneFSOutputStr= eam.java:46) > at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOut= putStream.java:57) > at java.io.DataOutputStream.write(DataOutputStream.java:107) > at org.apache.hadoop.io.SequenceFile$Writer.append(SequenceFile.java:144= 4) > at org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat$1.wri= te(SequenceFileOutputFormat.java:83) > at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTa= sk.java:670) > at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(Tas= kInputOutputContextImpl.java:89) > at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(Wrapp= edMapper.java:112) > at org.apache.hadoop.examples.RandomWriter$RandomMapper.map(RandomWriter= .java:199) > at org.apache.hadoop.examples.RandomWriter$RandomMapper.map(RandomWriter= .java:165) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma= tion.java:1730) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org