hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth J (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-5601) NPE in ORC's PPD when using select * from table with where predicate
Date Tue, 22 Oct 2013 10:15:44 GMT

     [ https://issues.apache.org/jira/browse/HIVE-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Prasanth J updated HIVE-5601:
-----------------------------

    Attachment:     (was: HIVE-5601.branch-0.12.3.patch.txt)

> NPE in ORC's PPD  when using select * from table with where predicate
> ---------------------------------------------------------------------
>
>                 Key: HIVE-5601
>                 URL: https://issues.apache.org/jira/browse/HIVE-5601
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.12.0
>            Reporter: Prasanth J
>            Assignee: Prasanth J
>            Priority: Critical
>              Labels: ORC
>         Attachments: HIVE-5601.branch-0.12.2.patch.txt, HIVE-5601.branch-12.1.patch.txt,
HIVE-5601.trunk.1.patch.txt, HIVE-5601.trunk.2.patch.txt, HIVE-5601.trunk.3.patch.txt
>
>
> ORCInputFormat has a method findIncludedColumns() which returns boolean array of included
columns. In case of the following query 
> {code}select * from qlog_orc where id<1000 limit 10;{code}
>  where all columns are selected the findIncludedColumns() returns null. This will result
in a NPE when PPD is enabled. Following is the stack trace
> {code}Caused by: java.lang.NullPointerException
> 	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.planReadPartialDataStreams(RecordReaderImpl.java:2387)
> 	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.readPartialDataStreams(RecordReaderImpl.java:2543)
> 	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.readStripe(RecordReaderImpl.java:2200)
> 	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceStripe(RecordReaderImpl.java:2573)
> 	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceToNextRow(RecordReaderImpl.java:2615)
> 	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.<init>(RecordReaderImpl.java:132)
> 	at org.apache.hadoop.hive.ql.io.orc.ReaderImpl.rows(ReaderImpl.java:348)
> 	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$OrcRecordReader.<init>(OrcInputFormat.java:99)
> 	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRecordReader(OrcInputFormat.java:241)
> 	at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:237)
> 	... 8 more{code}



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message