hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Prasad Chakka <pcha...@facebook.com>
Subject Re: Unknown exception:null on Predicate push down.
Date Tue, 19 May 2009 19:32:24 GMT
There is a similar unit test ppd_join1.q but I suspect it is something todo with schema. Please
send in schema for tables in the join.


________________________________
From: Yongqiang He <heyongqiang@software.ict.ac.cn>
Reply-To: <hive-dev@hadoop.apache.org>
Date: Tue, 19 May 2009 11:37:24 -0700
To: <hive-dev@hadoop.apache.org>
Subject: Unknown exception:null on Predicate push down.

Hi, all
A simple test on Hive's predicate push down:
select tablerc1.col1, tablerc1.col2,tablerc2.col1 from tablerc1 join
tablerc2 on (tablerc1.col1=tablerc2.col2) where tablerc1.col1>20 and
tablerc2.col2>40;

It seems that at the last step, the top Table Scan Operator fails because
column "0" can not be recognized. It can only recognize real column names.
The stacktrace when it failes:
    at
org.apache.hadoop.hive.ql.ppd.ExprWalkerProcFactory$ColumnExprProcessor.proc
ess(ExprWalkerProcFactory.java:84)    at
org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDisp
atcher.java:80)    at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker
.java:83)    at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk(DefaultGraphWalker.jav
a:116)    at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWa
lker.java:95)    at
org.apache.hadoop.hive.ql.ppd.ExprWalkerProcFactory.extractPushdownPreds(Exp
rWalkerProcFactory.java:314)    at
org.apache.hadoop.hive.ql.ppd.OpProcFactory$DefaultPPD.mergeWithChildrenPred
(OpProcFactory.java:322)    at
org.apache.hadoop.hive.ql.ppd.OpProcFactory$TableScanPPD.process(OpProcFacto
ry.java:97)    at
org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDisp
atcher.java:80)    at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker
.java:83)    at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk(DefaultGraphWalker.jav
a:116)    at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWa
lker.java:95)    at
org.apache.hadoop.hive.ql.ppd.PredicatePushDown.transform(PredicatePushDown.
java:101)    at
org.apache.hadoop.hive.ql.optimizer.Optimizer.optimize(Optimizer.java:62)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAna
lyzer.java:3662)    at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAna
lyzer.java:84)    at
org.apache.hadoop.hive.ql.Driver.compile(Driver.java:180)    at
org.apache.hadoop.hive.ql.Driver.run(Driver.java:213)    at
org.apache.hadoop.hive.CliDriver.processCmd(CliDriver.java:195)    at
org.apache.hadoop.hive.CliDriver.processLine(CliDriver.java:232)    at
org.apache.hadoop.hive.CliDriver.main(CliDriver.java:304)


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message