hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From wzc1...@gmail.com
Subject 回复: BUG IN HIVE-4650 seems not fixed
Date Mon, 29 Jul 2013 06:46:20 GMT
Hi:
I attach the output of EXPLAIN, and the hive I use is compiled from trunk and my hadoop version
is 1.0.1. I use default hive configuration.  


--  
wzc1989@gmail.com
已使用 Sparrow (http://www.sparrowmailapp.com/?sig)

已使用 Sparrow (http://www.sparrowmailapp.com/?sig)  

在 2013年7月29日星期一,下午1:08,Yin Huai 写道:

> Hi,
>  
> Can you also post the output of EXPLAIN? The execution plan may be helpful to locate
the problem.
>  
> Thanks,
>  
> Yin
>  
>  
> On Sun, Jul 28, 2013 at 8:06 PM, <wzc1989@gmail.com (mailto:wzc1989@gmail.com)>
wrote:
> > What I mean by "not pass the testcase in HIVE-4650" is that I compile the trunk
code and run the query in HIVE-4650:  
> > SELECT *
> > FROM
> >   (SELECT VAL001 x1,
> >           VAL002 x2,
> >           VAL003 x3,
> >           VAL004 x4,
> >           VAL005 y
> >    FROM
> >      (SELECT /*+ mapjoin(v2) */ (VAL001- mu1) * 1/(sd1) VAL001,(VAL002- mu2) * 1/(sd2)
VAL002,(VAL003- mu3) * 1/(sd3) VAL003,(VAL004- mu4) * 1/(sd4) VAL004,(VAL005- mu5) * 1/(sd5)
VAL005
> >       FROM
> >         (SELECT *
> >          FROM
> >            (SELECT x1 VAL001,
> >                    x2 VAL002,
> >                    x3 VAL003,
> >                    x4 VAL004,
> >                    y VAL005
> >             FROM cmnt) obj1_3) v3
> >       JOIN
> >         (SELECT count(*) c,
> >                 avg(VAL001) mu1,
> >                 avg(VAL002) mu2,
> >                 avg(VAL003) mu3,
> >                 avg(VAL004) mu4,
> >                 avg(VAL005) mu5,
> >                 stddev_pop(VAL001) sd1,
> >                 stddev_pop(VAL002) sd2,
> >                 stddev_pop(VAL003) sd3,
> >                 stddev_pop(VAL004) sd4,
> >                 stddev_pop(VAL005) sd5
> >          FROM
> >            (SELECT *
> >             FROM
> >               (SELECT x1 VAL001,
> >                       x2 VAL002,
> >                       x3 VAL003,
> >                       x4 VAL004,
> >                       y VAL005
> >                FROM cmnt) obj1_3) v1) v2) obj1_7) obj1_6 ;
> >  
> >  
> > and it still fail at the same place:
> > …
> > Diagnostic Messages for this Task:
> > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException
> >         at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:162)
> >         at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
> >         at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
> >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
> >         at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at javax.security.auth.Subject.doAs(Subject.java:416)
> >         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> >         at org.apache.hadoop.mapred.Child.main(Child.java:249)
> > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException
> >         at org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable(MapJoinOperator.java:198)
> >         at org.apache.hadoop.hive.ql.exec.MapJoinOperator.cleanUpInputFileChangedOp(MapJoinOperator.java:212)
> >         at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1377)
> >         at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1381)
> >         at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1381)
> >         at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:611)
> >         at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:144)
> >         ... 8 more
> > Caused by: java.lang.NullPointerException
> >         at org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable(MapJoinOperator.java:186)
> >         ... 14 more
> >  
> >  
> > --  
> > wzc1989@gmail.com (mailto:wzc1989@gmail.com)
> > 已使用 Sparrow (http://www.sparrowmailapp.com/?sig)
> >  
> > 已使用 Sparrow (http://www.sparrowmailapp.com/?sig)  
> >  
> > 在 2013年7月28日星期日,下午8:08,wzc1989@gmail.com (mailto:wzc1989@gmail.com)
写道:
> >  
> > > hi all:  
> > >  
> > > We are currently testing hive 0.11 against our production environment and run
into some problems. Some of them are related to the param "hive.auto.convert.join".  
> > > We disable this param and some failed testcases passed. By searching in hive
jira issues I find that the patch in HIVE-4650(https://issues.apache.org/jira/browse/HIVE-4650)
may be helpful.
> > > I compile the newest code in trunk and try the failed testcase in HIVE-4650,
but it doesn't pass. It seems that this issue is not fixed while it's closed.
> > >  
> > > Am I missed something?
> > >  
> > > --  
> > > wzc1989@gmail.com (mailto:wzc1989@gmail.com)
> > > 已使用 Sparrow (http://www.sparrowmailapp.com/?sig)
> > >  
> > > 已使用 Sparrow (http://www.sparrowmailapp.com/?sig)  
> >  
>  


Mime
View raw message