hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From He Yongqiang <heyongqi...@software.ict.ac.cn>
Subject Unknown exception:null on Predicate push down.
Date Tue, 19 May 2009 18:37:24 GMT
Hi, all
A simple test on Hive¹s predicate push down:
select tablerc1.col1, tablerc1.col2,tablerc2.col1 from tablerc1 join
tablerc2 on (tablerc1.col1=tablerc2.col2) where tablerc1.col1>20 and
tablerc2.col2>40;

It seems that at the last step, the top Table Scan Operator fails because
column ³0² can not be recognized. It can only recognize real column names.
The stacktrace when it failes:
    at 
org.apache.hadoop.hive.ql.ppd.ExprWalkerProcFactory$ColumnExprProcessor.proc
ess(ExprWalkerProcFactory.java:84)    at
org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDisp
atcher.java:80)    at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker
.java:83)    at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk(DefaultGraphWalker.jav
a:116)    at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWa
lker.java:95)    at
org.apache.hadoop.hive.ql.ppd.ExprWalkerProcFactory.extractPushdownPreds(Exp
rWalkerProcFactory.java:314)    at
org.apache.hadoop.hive.ql.ppd.OpProcFactory$DefaultPPD.mergeWithChildrenPred
(OpProcFactory.java:322)    at
org.apache.hadoop.hive.ql.ppd.OpProcFactory$TableScanPPD.process(OpProcFacto
ry.java:97)    at 
org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDisp
atcher.java:80)    at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker
.java:83)    at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk(DefaultGraphWalker.jav
a:116)    at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWa
lker.java:95)    at
org.apache.hadoop.hive.ql.ppd.PredicatePushDown.transform(PredicatePushDown.
java:101)    at 
org.apache.hadoop.hive.ql.optimizer.Optimizer.optimize(Optimizer.java:62)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAna
lyzer.java:3662)    at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAna
lyzer.java:84)    at
org.apache.hadoop.hive.ql.Driver.compile(Driver.java:180)    at
org.apache.hadoop.hive.ql.Driver.run(Driver.java:213)    at
org.apache.hadoop.hive.CliDriver.processCmd(CliDriver.java:195)    at
org.apache.hadoop.hive.CliDriver.processLine(CliDriver.java:232)    at
org.apache.hadoop.hive.CliDriver.main(CliDriver.java:304)

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message