Return-Path: X-Original-To: apmail-hive-issues-archive@minotaur.apache.org Delivered-To: apmail-hive-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CDBBC10C4E for ; Wed, 18 Mar 2015 00:17:38 +0000 (UTC) Received: (qmail 35066 invoked by uid 500); 18 Mar 2015 00:17:38 -0000 Delivered-To: apmail-hive-issues-archive@hive.apache.org Received: (qmail 35046 invoked by uid 500); 18 Mar 2015 00:17:38 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 35036 invoked by uid 99); 18 Mar 2015 00:17:38 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Mar 2015 00:17:38 +0000 Date: Wed, 18 Mar 2015 00:17:38 +0000 (UTC) From: "Sergey Shelukhin (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Comment Edited] (HIVE-9986) LLAP: EOFException in reader MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-9986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366366#comment-14366366 ] Sergey Shelukhin edited comment on HIVE-9986 at 3/18/15 12:16 AM: ------------------------------------------------------------------ This is the issue that was fixed in tests in the linked JIRA; if some data was in cache and some wasn't, and the missing data was at the end of the range, end of the range would be set incorrectly (too high), resulting in EOF after that. Happens on stripe other than first was (Author: sershe): This is the issue that was fixed in tests in the linked JIRA; if some data was in cache and some wasn't, and the missing data was at the end of the range, end of the range would be set incorrectly. > LLAP: EOFException in reader > ---------------------------- > > Key: HIVE-9986 > URL: https://issues.apache.org/jira/browse/HIVE-9986 > Project: Hive > Issue Type: Sub-task > Reporter: Gopal V > Assignee: Sergey Shelukhin > Fix For: llap > > > From HIVE-9979 > {noformat} > 2015-03-16 10:20:51,439 [pool-2-thread-3(container_222212222_1141_01_000192_gopal_20150316102020_c8c92488-6a61-401e-8298-401dace286dc:1_Map 1_191_0)] INFO org.apache.hadoop.hive.ql.io.orc.EncodedReaderImpl: Getting data for column 9 RG 112 stream DATA at 62278935, 1057137 index position 0: compressed [62614934, 63139228) > 2015-03-16 10:20:51,439 [pool-2-thread-6(container_222212222_1141_01_000211_gopal_20150316102020_c8c92488-6a61-401e-8298-401dace286dc:1_Map 1_210_0)] INFO org.apache.hadoop.hive.ql.io.orc.EncodedReaderImpl: Getting stripe-level stream [LENGTH, kind: DICTIONARY_V2 > dictionarySize: 3 > ] for column 9 RG 91 at 64139927, 5 > ... > Caused by: java.io.EOFException > at org.apache.hadoop.hive.ql.io.orc.RecordReaderUtils.readDirect(RecordReaderUtils.java:286) > at org.apache.hadoop.hive.ql.io.orc.RecordReaderUtils.readDiskRanges(RecordReaderUtils.java:266) > at org.apache.hadoop.hive.ql.io.orc.EncodedReaderImpl.readEncodedColumns(EncodedReaderImpl.java:234) > at org.apache.hadoop.hive.llap.io.encoded.OrcEncodedDataReader.callInternal(OrcEncodedDataReader.java:280) > at org.apache.hadoop.hive.llap.io.encoded.OrcEncodedDataReader.callInternal(OrcEncodedDataReader.java:44) > at org.apache.hadoop.hive.common.CallableWithNdc.call(CallableWithNdc.java:37) > ... 4 more > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)