hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tony Murphy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4770) Null Pointer Exception in Group By Operator
Date Wed, 10 Jul 2013 21:55:50 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13705126#comment-13705126
] 

Tony Murphy commented on HIVE-4770:
-----------------------------------

The issues only happens when vectorization is enabled. 
                
> Null Pointer Exception in Group By Operator
> -------------------------------------------
>
>                 Key: HIVE-4770
>                 URL: https://issues.apache.org/jira/browse/HIVE-4770
>             Project: Hive
>          Issue Type: Sub-task
>    Affects Versions: vectorization-branch
>            Reporter: Tony Murphy
>             Fix For: vectorization-branch
>
>         Attachments: output.txt, tableAndData.zip
>
>
> Table and data attached.
> {noformat}
> SELECT   cfloat,
>          csmallint,
>          cint,
>          ctimestamp,
>          (cfloat + 10),
>          STDDEV_SAMP(cfloat),
>          (-((cfloat + 10))),
>          (cint / cfloat),
>          MAX(cint),
>          (-(cint)),
>          (cint * STDDEV_SAMP(cfloat)),
>          STDDEV_SAMP(cint),
>          VAR_SAMP(cint),
>          (-(MAX(cint))),
>          ((-(MAX(cint))) / 0.00000000000000000000E+000)
> FROM     alltypes_orc
> WHERE    (((1 >= cfloat)
>            OR (cstring2 LIKE '%b'))
>           OR ((cint <= csmallint)
>               OR (cstring2 LIKE '%ss')))
> GROUP BY cfloat, csmallint, cint, ctimestamp
> ORDER BY cint, cfloat;
> {noformat}
> {noformat}
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime
Error while processing row {"ctinyint":null,"csmallint":-3806,"cint":-66533315,"cbigint":null,"cdouble":null,"cfloat":152.95706,"cstring1":null,"cstring2":null,"ctimestamp":"9131-01-01
16:52:03.53","cboolean":null}
> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:162)
> 	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:271)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:265)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
processing row {"ctinyint":null,"csmallint":-3806,"cint":-66533315,"cbigint":null,"cdouble":null,"cfloat":152.95706,"cstring1":null,"cstring2":null,"ctimestamp":"9131-01-01
16:52:03.53","cboolean":null}
> 	at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:671)
> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:144)
> 	... 8 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException
> 	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:796)
> 	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
> 	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
> 	at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:88)
> 	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
> 	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
> 	at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:136)
> 	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
> 	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
> 	at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:90)
> 	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
> 	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
> 	at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:652)
> 	... 9 more
> Caused by: java.lang.NullPointerException
> 	at org.apache.hadoop.hive.ql.exec.GroupByOperator.shouldBeFlushed(GroupByOperator.java:941)
> 	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processHashAggr(GroupByOperator.java:836)
> 	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processKey(GroupByOperator.java:723)
> 	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:791)
> 	... 21 more
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message