hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14264) ArrayIndexOutOfBoundsException when cbo is enabled
Date Thu, 28 Jul 2016 05:56:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15396993#comment-15396993
] 

Amareshwari Sriramadasu commented on HIVE-14264:
------------------------------------------------

[~gszadovszky] We are running queries on hive server on version 2.1 and using MR execution
engine. The tables are partitioned and the issue mostly happens when col is not projected
but it is only in filter clause with 'IS NOT NULL' filter. But we have seen failures in some
cases when column is projected as well.

> ArrayIndexOutOfBoundsException when cbo is enabled 
> ---------------------------------------------------
>
>                 Key: HIVE-14264
>                 URL: https://issues.apache.org/jira/browse/HIVE-14264
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 2.1.0
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Gabor Szadovszky
>
> We have noticed ArrayIndexOutOfBoundsException for queries with IS NOT NULL filter. Exception
goes away when hive.cbo.enable=false
> Here is a  stacktrace in our production environment :
> {noformat}
> Caused by: java.lang.ArrayIndexOutOfBoundsException: -1
>         at java.util.ArrayList.elementData(ArrayList.java:418) ~[na:1.8.0_72]
>         at java.util.ArrayList.set(ArrayList.java:446) ~[na:1.8.0_72]
>         at org.apache.hadoop.hive.ql.optimizer.physical.MapJoinResolver$LocalMapJoinTaskDispatcher.processCurrentTask(MapJoinResolver.java:173)
~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.optimizer.physical.MapJoinResolver$LocalMapJoinTaskDispatcher.dispatch(MapJoinResolver.java:239)
~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.dispatch(TaskGraphWalker.java:111)
~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.walk(TaskGraphWalker.java:180)
~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.startWalking(TaskGraphWalker.java:125)
~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.optimizer.physical.MapJoinResolver.resolve(MapJoinResolver.java:81)
~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.optimizer.physical.PhysicalOptimizer.optimize(PhysicalOptimizer.java:107)
~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.parse.MapReduceCompiler.optimizeTaskPlan(MapReduceCompiler.java:271)
~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.parse.TaskCompiler.compile(TaskCompiler.java:274)
~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10764)
~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:234)
~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:250)
~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:436) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:328) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1156) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1143) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
>         at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:147)
~[hive-service-2.1.2-inm.jar:2.1.2-inm]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message