Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8DD711053E for ; Wed, 10 Jul 2013 21:55:51 +0000 (UTC) Received: (qmail 5368 invoked by uid 500); 10 Jul 2013 21:55:50 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 5302 invoked by uid 500); 10 Jul 2013 21:55:50 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 5150 invoked by uid 500); 10 Jul 2013 21:55:50 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 5114 invoked by uid 99); 10 Jul 2013 21:55:50 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Jul 2013 21:55:50 +0000 Date: Wed, 10 Jul 2013 21:55:50 +0000 (UTC) From: "Tony Murphy (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-4770) Null Pointer Exception in Group By Operator MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-4770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13705126#comment-13705126 ] Tony Murphy commented on HIVE-4770: ----------------------------------- The issues only happens when vectorization is enabled. > Null Pointer Exception in Group By Operator > ------------------------------------------- > > Key: HIVE-4770 > URL: https://issues.apache.org/jira/browse/HIVE-4770 > Project: Hive > Issue Type: Sub-task > Affects Versions: vectorization-branch > Reporter: Tony Murphy > Fix For: vectorization-branch > > Attachments: output.txt, tableAndData.zip > > > Table and data attached. > {noformat} > SELECT cfloat, > csmallint, > cint, > ctimestamp, > (cfloat + 10), > STDDEV_SAMP(cfloat), > (-((cfloat + 10))), > (cint / cfloat), > MAX(cint), > (-(cint)), > (cint * STDDEV_SAMP(cfloat)), > STDDEV_SAMP(cint), > VAR_SAMP(cint), > (-(MAX(cint))), > ((-(MAX(cint))) / 0.00000000000000000000E+000) > FROM alltypes_orc > WHERE (((1 >= cfloat) > OR (cstring2 LIKE '%b')) > OR ((cint <= csmallint) > OR (cstring2 LIKE '%ss'))) > GROUP BY cfloat, csmallint, cint, ctimestamp > ORDER BY cint, cfloat; > {noformat} > {noformat} > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"ctinyint":null,"csmallint":-3806,"cint":-66533315,"cbigint":null,"cdouble":null,"cfloat":152.95706,"cstring1":null,"cstring2":null,"ctimestamp":"9131-01-01 16:52:03.53","cboolean":null} > at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:162) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) > at org.apache.hadoop.mapred.Child$4.run(Child.java:271) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135) > at org.apache.hadoop.mapred.Child.main(Child.java:265) > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"ctinyint":null,"csmallint":-3806,"cint":-66533315,"cbigint":null,"cdouble":null,"cfloat":152.95706,"cstring1":null,"cstring2":null,"ctimestamp":"9131-01-01 16:52:03.53","cboolean":null} > at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:671) > at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:144) > ... 8 more > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException > at org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:796) > at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502) > at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832) > at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:88) > at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502) > at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832) > at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:136) > at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502) > at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832) > at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:90) > at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502) > at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832) > at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:652) > ... 9 more > Caused by: java.lang.NullPointerException > at org.apache.hadoop.hive.ql.exec.GroupByOperator.shouldBeFlushed(GroupByOperator.java:941) > at org.apache.hadoop.hive.ql.exec.GroupByOperator.processHashAggr(GroupByOperator.java:836) > at org.apache.hadoop.hive.ql.exec.GroupByOperator.processKey(GroupByOperator.java:723) > at org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:791) > ... 21 more > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira