Return-Path: X-Original-To: apmail-avro-dev-archive@www.apache.org Delivered-To: apmail-avro-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 74521181CC for ; Sat, 23 Jan 2016 18:59:57 +0000 (UTC) Received: (qmail 32968 invoked by uid 500); 23 Jan 2016 18:59:57 -0000 Delivered-To: apmail-avro-dev-archive@avro.apache.org Received: (qmail 32911 invoked by uid 500); 23 Jan 2016 18:59:57 -0000 Mailing-List: contact dev-help@avro.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@avro.apache.org Delivered-To: mailing list dev@avro.apache.org Received: (qmail 32900 invoked by uid 99); 23 Jan 2016 18:59:57 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 23 Jan 2016 18:59:57 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 82D6DC0943 for ; Sat, 23 Jan 2016 18:59:56 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.675 X-Spam-Level: ** X-Spam-Status: No, score=2.675 tagged_above=-999 required=6.31 tests=[FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.554, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id 8HgjydW1OwJD for ; Sat, 23 Jan 2016 18:59:55 +0000 (UTC) Received: from SNT004-OMC3S13.hotmail.com (snt004-omc3s13.hotmail.com [65.55.90.152]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 6AFED43EF5 for ; Sat, 23 Jan 2016 18:59:55 +0000 (UTC) Received: from SNT149-W72 ([65.55.90.136]) by SNT004-OMC3S13.hotmail.com over TLS secured channel with Microsoft SMTPSVC(7.5.7601.23008); Sat, 23 Jan 2016 10:59:49 -0800 X-TMN: [RbMTVZ1iCQxLgNPFkLwDKHtHetFVMKkY] X-Originating-Email: [java8964@hotmail.com] Message-ID: Content-Type: multipart/alternative; boundary="_745ccfa8-4138-46f2-be1e-58dbd1ffb4f4_" From: Yong Zhang To: "dev@avro.apache.org" Subject: Question related to org.apache.avro.io.DirectBinaryDecoder Date: Sat, 23 Jan 2016 13:59:48 -0500 Importance: Normal MIME-Version: 1.0 X-OriginalArrivalTime: 23 Jan 2016 18:59:49.0112 (UTC) FILETIME=[3BAD1780:01D15610] --_745ccfa8-4138-46f2-be1e-58dbd1ffb4f4_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hi=2C Avro Developers: Is anyone familiar the code logic related to org.apache.avro.io.DirectBinar= yDecoder? I am asking this question related to AVRO-1786=2C which I believe I am faci= ng a bug related to this class. A valid Avro record sent from Mapper to the Reducer=2C but Reducer cannot r= ead it due to IndexOutOfBoundException=2C because the readInt() method of t= his class return "-51". I even can dump the local variables of the method in this exception case=2C= and described in the comments area of Jira ticket. I don't understand the internal logic of this class=2C and how the readInt(= ) method implemented. But an inputstream read 101 bytes out will cause this= method return a negative number=2C and causes following method IndexOutofB= oundException looks like a bug to me. Can anyone understand this class's logic confirm this is a bug or not? If i= t is a bug=2C what is the best way to fix it? I can consistently reproduce this bug on our production cluster=2C which me= an I can verify any code fix works or not for this case. Let me know any question related to this JIRA. Thanks Yong = --_745ccfa8-4138-46f2-be1e-58dbd1ffb4f4_--