hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hari Sekhon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12349) NPE in ORC SARG for IS NULL queries on Timestamp and Date columns
Date Thu, 03 Dec 2015 11:59:11 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037708#comment-15037708
] 

Hari Sekhon commented on HIVE-12349:
------------------------------------

Any ideas on the timeline for Hive 1.3 release including this fix? This problem is currently
affecting my users so we're eager to get a new release of Hive.

Hortonworks HDP 2.4 is due to be released some time this or next month based on the bi-annual
release schedule, would be good to get Hive 1.3 included in that release.

> NPE in ORC SARG for IS NULL queries on Timestamp and Date columns
> -----------------------------------------------------------------
>
>                 Key: HIVE-12349
>                 URL: https://issues.apache.org/jira/browse/HIVE-12349
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 1.3.0, 1.2.1, 2.0.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>             Fix For: 1.3.0, 2.0.0
>
>
> IS NULL queries can trigger an NPE for timestamp and date columns. All column values
per row group or stripe should be NULL to trigger this case. Following is the exception stack
trace
> {code}
> Caused by: java.lang.NullPointerException 
> at org.apache.hadoop.hive.ql.io.orc.ColumnStatisticsImpl$TimestampStatisticsImpl.getMinimum(ColumnStatisticsImpl.java:795)

> at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.getMin(RecordReaderImpl.java:2343)

> at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.evaluatePredicate(RecordReaderImpl.java:2366)

> at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.pickRowGroups(RecordReaderImpl.java:2564)

> at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.readStripe(RecordReaderImpl.java:2627)

> at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceStripe(RecordReaderImpl.java:3060)

> at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceToNextRow(RecordReaderImpl.java:3102)

> at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.<init>(RecordReaderImpl.java:288)

> at org.apache.hadoop.hive.ql.io.orc.ReaderImpl.rowsOptions(ReaderImpl.java:534) 
> at org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger$ReaderPair.<init>(OrcRawRecordMerger.java:183)

> at org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger$OriginalReaderPair.<init>(OrcRawRecordMerger.java:226)

> at org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger.<init>(OrcRawRecordMerger.java:437)

> at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getReader(OrcInputFormat.java:1141)

> at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRecordReader(OrcInputFormat.java:1039)

> at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:246)

> ... 26 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message