hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5601) NPE in ORC's PPD when using select * from table with where predicate
Date Fri, 15 Nov 2013 16:17:22 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823765#comment-13823765
] 

Hudson commented on HIVE-5601:
------------------------------

FAILURE: Integrated in Hive-branch-0.12-hadoop1 #32 (See [https://builds.apache.org/job/Hive-branch-0.12-hadoop1/32/])
HIVE-5601: NPE in ORC's PPD when using select * from table with where 
predicate pushdown (Prasanth J via Owen O'Malley and Gunther Hagleitner) (omalley: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1542024)
* /hive/branches/branch-0.12/ql/src/java/org/apache/hadoop/hive/ql/io/orc/ReaderImpl.java
* /hive/branches/branch-0.12/ql/src/test/queries/clientpositive/orc_predicate_pushdown.q
* /hive/branches/branch-0.12/ql/src/test/results/clientpositive/orc_predicate_pushdown.q.out


> NPE in ORC's PPD  when using select * from table with where predicate
> ---------------------------------------------------------------------
>
>                 Key: HIVE-5601
>                 URL: https://issues.apache.org/jira/browse/HIVE-5601
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.12.0
>            Reporter: Prasanth J
>            Assignee: Prasanth J
>            Priority: Critical
>              Labels: ORC
>             Fix For: 0.13.0, 0.12.1
>
>         Attachments: HIVE-5601.4-branch-0.12.patch.txt, HIVE-5601.5.patch.txt, HIVE-5601.branch-0.12.2.patch.txt,
HIVE-5601.branch-0.12.3.patch.txt, HIVE-5601.branch-0.12.4.patch.txt, HIVE-5601.branch-12.1.patch.txt,
HIVE-5601.trunk.1.patch.txt, HIVE-5601.trunk.2.patch.txt, HIVE-5601.trunk.3.patch.txt, HIVE-5601.trunk.4.patch.txt,
HIVE-5601.trunk.5.patch.txt
>
>
> ORCInputFormat has a method findIncludedColumns() which returns boolean array of included
columns. In case of the following query 
> {code}select * from qlog_orc where id<1000 limit 10;{code}
>  where all columns are selected the findIncludedColumns() returns null. This will result
in a NPE when PPD is enabled. Following is the stack trace
> {code}Caused by: java.lang.NullPointerException
> 	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.planReadPartialDataStreams(RecordReaderImpl.java:2387)
> 	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.readPartialDataStreams(RecordReaderImpl.java:2543)
> 	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.readStripe(RecordReaderImpl.java:2200)
> 	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceStripe(RecordReaderImpl.java:2573)
> 	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceToNextRow(RecordReaderImpl.java:2615)
> 	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.<init>(RecordReaderImpl.java:132)
> 	at org.apache.hadoop.hive.ql.io.orc.ReaderImpl.rows(ReaderImpl.java:348)
> 	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$OrcRecordReader.<init>(OrcInputFormat.java:99)
> 	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRecordReader(OrcInputFormat.java:241)
> 	at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:237)
> 	... 8 more{code}



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message