hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gunther Hagleitner (JIRA)" <j...@apache.org>
Subject [jira] [Reopened] (HIVE-7283) CBO: plumb in HepPlanner and FieldTrimmer(ColumnPruner) into Optiq based planning
Date Fri, 27 Jun 2014 23:01:26 GMT

     [ https://issues.apache.org/jira/browse/HIVE-7283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Gunther Hagleitner reopened HIVE-7283:
--------------------------------------


I'm seeing this in the unit tests:

Exception: null
java.lang.AssertionError
  at org.eigenbase.relopt.RelOptUtil.classifyFilters(RelOptUtil.java:1871)
  at org.apache.hadoop.hive.ql.optimizer.optiq.rules.HivePushFilterPastJoinRule.perform(HivePushFilterPastJoinRule.java:95)
  at org.apache.hadoop.hive.ql.optimizer.optiq.rules.HivePushFilterPastJoinRule$2.onMatch(HivePushFilterPastJoinRule.java:41)
  at org.eigenbase.relopt.AbstractRelOptPlanner.fireRule(AbstractRelOptPlanner.java:280)
  at org.eigenbase.relopt.hep.HepPlanner.applyRule(HepPlanner.java:482)
  at org.eigenbase.relopt.hep.HepPlanner.applyRules(HepPlanner.java:359)
  at org.eigenbase.relopt.hep.HepPlanner.executeInstruction(HepPlanner.java:222)
  at org.eigenbase.relopt.hep.HepInstruction$RuleInstance.execute(HepInstruction.java:119)
  at org.eigenbase.relopt.hep.HepPlanner.executeProgram(HepPlanner.java:173)
  at org.eigenbase.relopt.hep.HepPlanner.findBestExp(HepPlanner.java:160)
  at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer$OptiqBasedPlanner.applyPreCBOTransforms(SemanticAnalyzer.java:11818)
  at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer$OptiqBasedPlanner.apply(SemanticAnalyzer.java:11768)
  at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer$OptiqBasedPlanner.apply(SemanticAnalyzer.java:11715)
  at net.hydromatic.optiq.tools.Frameworks$1.apply(Frameworks.java:146)
  at net.hydromatic.optiq.prepare.OptiqPrepareImpl.perform(OptiqPrepareImpl.java:536)
  at net.hydromatic.optiq.tools.Frameworks.withPrepare(Frameworks.java:168)
  at net.hydromatic.optiq.tools.Frameworks.withPlanner(Frameworks.java:142)
  at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer$OptiqBasedPlanner.getOptimizedAST(SemanticAnalyzer.java:11731)
  at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer$OptiqBasedPlanner.access$200(SemanticAnalyzer.java:11715)
  at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:9536)
  at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:328)
  at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:412)
  at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308)
  at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:962)
  at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1027)
  at org.apache.hadoop.hive.ql.Driver.run(Driver.java:898)
  at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888)
  at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:277)
  at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:229)
  at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:439)
  at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:375)
  at org.apache.hadoop.hive.ql.QTestUtil.executeClient(QTestUtil.java:920)
  at org.apache.hadoop.hive.cli.TestCliDriver.runTest(TestCliDriver.java:133)
  at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_cbo_correctness(TestCliDriver.java:117)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
  at java.lang.reflect.Method.invoke(Method.java:597)
  at junit.framework.TestCase.runTest(TestCase.java:168)
  at junit.framework.TestCase.runBare(TestCase.java:134)
  at junit.framework.TestResult$1.protect(TestResult.java:110)
  at junit.framework.TestResult.runProtected(TestResult.java:128)
  at junit.framework.TestResult.run(TestResult.java:113)
  at junit.framework.TestCase.run(TestCase.java:124)
  at junit.framework.TestSuite.runTest(TestSuite.java:243)
  at junit.framework.TestSuite.run(TestSuite.java:238)
  at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83)
  at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
  at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
  at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
  at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
  at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
  at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)

> CBO: plumb in HepPlanner and FieldTrimmer(ColumnPruner) into Optiq based planning
> ---------------------------------------------------------------------------------
>
>                 Key: HIVE-7283
>                 URL: https://issues.apache.org/jira/browse/HIVE-7283
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Query Processor
>            Reporter: Harish Butani
>            Assignee: Harish Butani
>         Attachments: HIVE-7283.1.patch
>
>
> 1.
> HepPlanner initially used for:
> - Predicate Pushdown
> - Transitive Predicate inference
> - Partition Pruning
> 2. Use Optiq's FieldTrimmer for ColumnPruner
> To begin with the rules are copies of Optiq base rules. Once Optiq is refactored to work
on Base RelNode classes, the copied rules will be removed.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message