hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vikram Dixit <>
Subject Re: Hive 1.0 on Tez 0.5.3 reproduced HIVE-8204
Date Thu, 02 Jul 2015 18:03:59 GMT
Moved user@tez to bcc. Looks like that jira just added a test case and was closed as 'not reproducible'.
However, this jira seems to have found and fixed the issue:


From: Jim Green <<>>
Reply-To: "<>" <<>>
Date: Wednesday, July 1, 2015 at 1:43 PM
To: "<>" <<>>,
"<>" <<>>
Subject: Hive 1.0 on Tez 0.5.3 reproduced HIVE-8204

Hi Team,

Is HIVE-8204 really fixed or not?
Below test can reproduce exactly the same stacktrace when dynamic partition pruning is enabled.

1. Create test tables
create table h1_fact(id int, id2 string) PARTITIONED BY (yyyymmdd string) row format delimited
fields terminated by ',';
create table h1_dim1(id int, id2 string) PARTITIONED BY (yyyymmdd string) row format delimited
fields terminated by ',';

2. Load some data.

3. Below SQL will fail:

set hive.execution.engine=tez;

select h1_fact.id2 from h1_fact join h1_dim1
on h1_fact.yyyymmdd=h1_dim1.yyyymmdd
where h1_dim1.id2 <> 'adfsdfd';

2015-07-01 20:37:51,210 ERROR [main]: ql.Driver ( - FAILED:
IndexOutOfBoundsException Index: 0, Size: 0
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at java.util.ArrayList.rangeCheck(
at java.util.ArrayList.get(
at org.apache.hadoop.hive.ql.optimizer.RemoveDynamicPruningBySize.process(
at org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(
at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(
at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(
at org.apache.hadoop.hive.ql.lib.ForwardWalker.walk(
at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(
at org.apache.hadoop.hive.ql.parse.TezCompiler.runStatsDependentOptimizations(
at org.apache.hadoop.hive.ql.parse.TezCompiler.optimizeOperatorPlan(
at org.apache.hadoop.hive.ql.parse.TaskCompiler.compile(
at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(
at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(
at org.apache.hadoop.hive.ql.parse.ExplainSemanticAnalyzer.analyzeInternal(
at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(
at org.apache.hadoop.hive.ql.Driver.compile(
at org.apache.hadoop.hive.ql.Driver.compile(
at org.apache.hadoop.hive.ql.Driver.compileInternal(
at org.apache.hadoop.hive.ql.Driver.runInternal(
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(
at org.apache.hadoop.hive.cli.CliDriver.processCmd(
at org.apache.hadoop.hive.cli.CliDriver.processLine(
at org.apache.hadoop.hive.cli.CliDriver.executeDriver(
at org.apache.hadoop.hive.cli.CliDriver.main(
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(
at sun.reflect.DelegatingMethodAccessorImpl.invoke(
at java.lang.reflect.Method.invoke(
at org.apache.hadoop.util.RunJar.main(

(Open KnowledgeBase for Hadoop/Database/OS/Network/Tool)

View raw message