Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 37E9018BB9 for ; Fri, 4 Mar 2016 11:04:07 +0000 (UTC) Received: (qmail 61109 invoked by uid 500); 4 Mar 2016 11:04:05 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 61036 invoked by uid 500); 4 Mar 2016 11:04:05 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 61026 invoked by uid 99); 4 Mar 2016 11:04:05 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Mar 2016 11:04:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 1FAE41A03BA for ; Fri, 4 Mar 2016 11:04:05 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.199 X-Spam-Level: * X-Spam-Status: No, score=1.199 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=altiscale.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id fKzF3DgeOMmh for ; Fri, 4 Mar 2016 11:04:01 +0000 (UTC) Received: from mail-ob0-f171.google.com (mail-ob0-f171.google.com [209.85.214.171]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 7F5275FB5F for ; Fri, 4 Mar 2016 11:04:01 +0000 (UTC) Received: by mail-ob0-f171.google.com with SMTP id xx9so46731875obc.2 for ; Fri, 04 Mar 2016 03:04:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=altiscale.com; s=google; h=mime-version:in-reply-to:references:date:message-id:subject:from:to; bh=dQd8RQldL2HAt67FscQh0gpAXjDvbmaauVO2fu85k5s=; b=PNJUkqaGC4rK5bF94RGGcmiPptvPGCqDRJLP8qbRogMyYJMMEchbaW0oSeGpmRYmVs WccNxQjrQe4lsYw7JZSFX6avp9cE53GM+GM5EuIjaW63y4w/pacGN9Q8wy6LpvIgF3TO euqxkVkHAOj+yVa2wRacW3UeOs/Fnt7+l32x4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to; bh=dQd8RQldL2HAt67FscQh0gpAXjDvbmaauVO2fu85k5s=; b=RFKlKHno6F2IfqnKLLbKzNB1k9piske9X8GzeJKipoNZRGYfiSrxhs5D2okSPa+8vI 4Jh9fJN4gS7/aFo+gnzm51KUq4lw61M3UlNdHb9EiM4+HANDUSbY6gzuwNH53YRMe7cY P2oa01p8rMBtNKKVZU9Qw7mJOC0VR78CO/DEC5G6sdRKhaT3x6LKLufokGPGcRmgnP/4 uLIJMoFoc7tDIyAd1vFbepzyiiFpvBACBh6zNURh52bSVvKPEcekRzd2mTCH39hn+p/J zl9d+Cs7gObRT2t876Cq9h2FxxzPTl/RyHGOiuBwtGr0Ve8DPjlEd8sx8GuDBhyAY4yE e7/Q== X-Gm-Message-State: AD7BkJKLlCT8pbultUu/JKZlHHa11UHXpJC0pVVvrc73YSNCzGtUllMywllafIZQQnfBVxbfiMugmikhxU2KlA== MIME-Version: 1.0 X-Received: by 10.182.29.2 with SMTP id f2mr5775700obh.6.1457089435420; Fri, 04 Mar 2016 03:03:55 -0800 (PST) Received: by 10.76.36.10 with HTTP; Fri, 4 Mar 2016 03:03:55 -0800 (PST) In-Reply-To: References: Date: Fri, 4 Mar 2016 16:33:55 +0530 Message-ID: Subject: Re: Hive Cli ORC table read error with limit option From: Biswajit Nayak To: user@hive.apache.org Content-Type: multipart/alternative; boundary=001a11c2c104346657052d3712ae --001a11c2c104346657052d3712ae Content-Type: text/plain; charset=UTF-8 Any one has any idea about this.. Really stuck with this. On Tue, Mar 1, 2016 at 4:09 PM, Biswajit Nayak wrote: > Hi, > > It works for MR engine, while in TEZ it fails. > > *hive> set hive.execution.engine=tez;* > > *hive> set hive.fetch.task.conversion=none;* > > *hive> select h from test*db.table_orc* where year = 2016 and month =1 > and day >29 limit 10;* > > *Query ID = 26f9a510-c10c-475c-9988-081998b66b0c* > > *Total jobs = 1* > > *Launching Job 1 out of 1* > > > > *Status: Running (Executing on YARN cluster with App id > application_1456379707708_1135)* > > > > *--------------------------------------------------------------------------------* > > * VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED > KILLED* > > > *--------------------------------------------------------------------------------* > > *Map 1 FAILED -1 0 0 -1 0 > 0* > > > *--------------------------------------------------------------------------------* > > *VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 0.37 > s * > > > *--------------------------------------------------------------------------------* > > *Status: Failed* > > *Vertex failed, vertexName=Map 1, vertexId=vertex_1456379707708_1135_1_00, > diagnostics=[Vertex vertex_1456379707708_1135_1_00 [Map 1] killed/failed > due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: t*able_orc* initializer > failed, vertex=vertex_1456379707708_1135_1_00 [Map 1], > java.lang.RuntimeException: serious problem* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1021)* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:1048)* > > * at > org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFormat.java:306)* > > * at > org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:408)* > > * at > org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:131)* > > * at > org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:245)* > > * at > org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:239)* > > * at java.security.AccessController.doPrivileged(Native Method)* > > * at javax.security.auth.Subject.doAs(Subject.java:415)* > > * at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)* > > * at > org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:239)* > > * at > org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:226)* > > * at java.util.concurrent.FutureTask.run(FutureTask.java:262)* > > * at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)* > > * at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)* > > * at java.lang.Thread.run(Thread.java:744)* > > *Caused by: java.util.concurrent.ExecutionException: > java.lang.IndexOutOfBoundsException: Index: 0* > > * at java.util.concurrent.FutureTask.report(FutureTask.java:122)* > > * at java.util.concurrent.FutureTask.get(FutureTask.java:188)* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1016)* > > * ... 15 more* > > *Caused by: java.lang.IndexOutOfBoundsException: Index: 0* > > * at java.util.Collections$EmptyList.get(Collections.java:3212)* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcProto$Type.getSubtypes(OrcProto.java:12240)* > > * at > org.apache.hadoop.hive.ql.io.orc.ReaderImpl.getColumnIndicesFromNames(ReaderImpl.java:651)* > > * at > org.apache.hadoop.hive.ql.io.orc.ReaderImpl.getRawDataSizeOfColumns(ReaderImpl.java:634)* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.populateAndCacheStripeDetails(OrcInputFormat.java:927)* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.call(OrcInputFormat.java:836)* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.call(OrcInputFormat.java:702)* > > * ... 4 more* > > *]* > > *DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 > killedVertices:0* > > *FAILED: Execution Error, return code 2 from > org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map > 1, vertexId=vertex_1456379707708_1135_1_00, diagnostics=[Vertex > vertex_1456379707708_1135_1_00 [Map 1] killed/failed due > to:ROOT_INPUT_INIT_FAILURE, Vertex Input: *table_orc* initializer failed, > vertex=vertex_1456379707708_1135_1_00 [Map 1], java.lang.RuntimeException: > serious problem* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1021)* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:1048)* > > * at > org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFormat.java:306)* > > * at > org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:408)* > > * at > org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:131)* > > * at > org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:245)* > > * at > org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:239)* > > * at java.security.AccessController.doPrivileged(Native Method)* > > * at javax.security.auth.Subject.doAs(Subject.java:415)* > > * at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)* > > * at > org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:239)* > > * at > org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:226)* > > * at java.util.concurrent.FutureTask.run(FutureTask.java:262)* > > * at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)* > > * at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)* > > * at java.lang.Thread.run(Thread.java:744)* > > *Caused by: java.util.concurrent.ExecutionException: > java.lang.IndexOutOfBoundsException: Index: 0* > > * at java.util.concurrent.FutureTask.report(FutureTask.java:122)* > > * at java.util.concurrent.FutureTask.get(FutureTask.java:188)* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1016)* > > * ... 15 more* > > *Caused by: java.lang.IndexOutOfBoundsException: Index: 0* > > * at java.util.Collections$EmptyList.get(Collections.java:3212)* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcProto$Type.getSubtypes(OrcProto.java:12240)* > > * at > org.apache.hadoop.hive.ql.io.orc.ReaderImpl.getColumnIndicesFromNames(ReaderImpl.java:651)* > > * at > org.apache.hadoop.hive.ql.io.orc.ReaderImpl.getRawDataSizeOfColumns(ReaderImpl.java:634)* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.populateAndCacheStripeDetails(OrcInputFormat.java:927)* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.call(OrcInputFormat.java:836)* > > * at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.call(OrcInputFormat.java:702)* > > * ... 4 more* > > *]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 > killedVertices:0* > > *hive> * > > > On Tue, Mar 1, 2016 at 1:09 PM, Biswajit Nayak > wrote: > >> Gopal, >> >> Any plan of provide the fix to Hive 1.x versions or to backport it? >> >> Regards >> Biswa >> >> On Tue, Mar 1, 2016 at 11:44 AM, Biswajit Nayak >> wrote: >> >>> Thanks Gopal for the details .. happy to know it has been counted and >>> fixed. >>> >>> Biswa >>> >>> >>> On Tue, Mar 1, 2016 at 11:37 AM, Gopal Vijayaraghavan >> > wrote: >>> >>>> >>>> > Yes it is kerberos cluster. >>>> ... >>>> > After disabling the optimization in hive cli, it works with limit >>>> >option. >>>> >>>> Alright, then it is fixed in - >>>> https://issues.apache.org/jira/browse/HIVE-13120 >>>> >>>> >>>> Cheers, >>>> Gopal >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>> >> > --001a11c2c104346657052d3712ae Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Any one has any idea about this.. Really stuck with this.= =C2=A0

On Tu= e, Mar 1, 2016 at 4:09 PM, Biswajit Nayak <biswajit@altiscale.com= > wrote:
Hi,= =C2=A0

It works for MR engine, while in TEZ it fails= .=C2=A0

hive> set h= ive.execution.engine=3Dtez;

hive> set hive.fetch.task.conversion=3Dnone;=

hive> select h from testdb.table_orc = where year =3D 2016 and month =3D1 and day >29 limit 10;

Query ID =3D 26f9a510-c10c-475c-9988-081998b66b= 0c

Total jobs =3D 1

Launching Job 1 out of 1



Status: Running (Executing on YARN cluster with= App id application_1456379707708_1135)


-----------------------------------------------= ---------------------------------

=C2=A0 =C2=A0 =C2=A0 =C2=A0 VERTICES=C2=A0 = =C2=A0 =C2=A0 STATUS=C2=A0 TOTAL=C2=A0 COMPLETED=C2=A0 RUNNING=C2=A0 PENDIN= G=C2=A0 FAILED=C2=A0 KILLED

-----------------------------------------------= ---------------------------------

Map 1 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 FAILED =C2=A0 =C2=A0 -1=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 0 =C2=A0 =C2=A0 =C2=A0 -1 =C2=A0 =C2=A0 =C2=A0 = 0 =C2=A0 =C2=A0 =C2=A0 0

-----------------------------------------------= ---------------------------------

VERTICES: 00/01=C2=A0 [>>-------------= -------------] 0%=C2=A0 =C2=A0 ELAPSED TIME: 0.37 s=C2=A0 =C2=A0 =C2=A0=

-----------------------------------------------= ---------------------------------

Status: Failed

Vertex failed, vertexName=3DMap 1, vertexId=3Dv= ertex_1456379707708_1135_1_00, diagnostics=3D[Vertex vertex_1456379707708_1= 135_1_00 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input= : table_orc initializer failed, vertex=3Dvertex_1456379707708_1135_1= _00 [Map 1], java.lang.RuntimeException: serious problem

at= org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInpu= tFormat.java:1021)

at= org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.j= ava:1048)

at= org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFo= rmat.java:306)

at= org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.jav= a:408)

at= org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplit= Generator.java:131)

at= org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCal= lable$1.run(RootInputInitializerManager.java:245)

at= org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCal= lable$1.run(RootInputInitializerManager.java:239)

at= java.security.AccessController.doPrivileged(Native Method)

at= javax.security.auth.Subject.doAs(Subject.java:415)

at= org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.= java:1657)

at= org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCal= lable.call(RootInputInitializerManager.java:239)

at= org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCal= lable.call(RootInputInitializerManager.java:226)

at= java.util.concurrent.FutureTask.run(FutureTask.java:262)

at= java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:= 1145)

at= java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java= :615)

at= java.lang.Thread.run(Thread.java:744)

Caused by: java.util.concurrent.ExecutionExcept= ion: java.lang.IndexOutOfBoundsException: Index: 0

at= java.util.concurrent.FutureTask.report(FutureTask.java:122)

at= java.util.concurrent.FutureTask.get(FutureTask.java:188)

at= org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInpu= tFormat.java:1016)

..= . 15 more

Caused by: java.lang.IndexOutOfBoundsException:= Index: 0

at= java.util.Collections$EmptyList.get(Collections.java:3212)

at= org.apache.hadoop.hive.ql.io.orc.OrcProto$Type.getSubtypes(OrcProto.java:1= 2240)

at= org.apache.hadoop.hive.ql.io.orc.ReaderImpl.getColumnIndicesFromNames(Read= erImpl.java:651)

at= org.apache.hadoop.hive.ql.io.orc.ReaderImpl.getRawDataSizeOfColumns(Reader= Impl.java:634)

at= org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.populateAnd= CacheStripeDetails(OrcInputFormat.java:927)

at= org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.call(OrcInp= utFormat.java:836)

at= org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.call(OrcInp= utFormat.java:702)

..= . 4 more

]

DAG did not succeed due to VERTEX_FAILURE. fail= edVertices:1 killedVertices:0

FAILED: Execution Error, return code 2 from org= .apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=3DMap 1,= vertexId=3Dvertex_1456379707708_1135_1_00, diagnostics=3D[Vertex vertex_14= 56379707708_1135_1_00 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE,= Vertex Input: table_orc initializer failed, vertex=3Dvertex_1456379= 707708_1135_1_00 [Map 1], java.lang.RuntimeException: serious problem

at= org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInpu= tFormat.java:1021)

at= org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.j= ava:1048)

at= org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFo= rmat.java:306)

at= org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.jav= a:408)

at= org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplit= Generator.java:131)

at= org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCal= lable$1.run(RootInputInitializerManager.java:245)

at= org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCal= lable$1.run(RootInputInitializerManager.java:239)

at= java.security.AccessController.doPrivileged(Native Method)

at= javax.security.auth.Subject.doAs(Subject.java:415)

at= org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.= java:1657)

at= org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCal= lable.call(RootInputInitializerManager.java:239)

at= org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCal= lable.call(RootInputInitializerManager.java:226)

at= java.util.concurrent.FutureTask.run(FutureTask.java:262)

at= java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:= 1145)

at= java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java= :615)

at= java.lang.Thread.run(Thread.java:744)

Caused by: java.util.concurrent.ExecutionExcept= ion: java.lang.IndexOutOfBoundsException: Index: 0

at= java.util.concurrent.FutureTask.report(FutureTask.java:122)

at= java.util.concurrent.FutureTask.get(FutureTask.java:188)

at= org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInpu= tFormat.java:1016)

..= . 15 more

Caused by: java.lang.IndexOutOfBoundsException:= Index: 0

at= java.util.Collections$EmptyList.get(Collections.java:3212)

at= org.apache.hadoop.hive.ql.io.orc.OrcProto$Type.getSubtypes(OrcProto.java:1= 2240)

at= org.apache.hadoop.hive.ql.io.orc.ReaderImpl.getColumnIndicesFromNames(Read= erImpl.java:651)

at= org.apache.hadoop.hive.ql.io.orc.ReaderImpl.getRawDataSizeOfColumns(Reader= Impl.java:634)

at= org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.populateAnd= CacheStripeDetails(OrcInputFormat.java:927)

at= org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.call(OrcInp= utFormat.java:836)

at= org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.call(OrcInp= utFormat.java:702)

..= . 4 more

]DAG did not succeed due to VERTEX_FAILURE. fai= ledVertices:1 killedVertices:0

hive>=C2=A0



On Tue, Mar 1, 2016 at 1:09 PM, Biswajit Na= yak <biswajit@altiscale.com> wrote:
Gopal,=C2=A0

Any plan o= f provide the fix to Hive 1.x versions or to backport it?

Regards
Biswa

On Tue, Mar 1, 2016 at 11:44 AM, Biswaj= it Nayak <biswajit@altiscale.com> wrote:
Thanks Gopal for the details .. happy = to know it has been counted and fixed.=C2=A0

Biswa
=


On Tue, Mar 1, 2016 at 11:37 AM, Gopal Vijayaraghavan <gopal= v@apache.org> wrote:
=
> Yes it is kerberos cluster.
...
> After disabling the optimization in hive cli, it works with limi= t
>option.

Alright, then it is fixed in -
https://issues.apache.org/jira/browse/HIVE-13120=


Cheers,
Gopal










--001a11c2c104346657052d3712ae--