hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9978) LLAP: OrcColumnVectorProducer should handle reading isPresent columns only
Date Tue, 17 Mar 2015 17:31:38 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365596#comment-14365596
] 

Sergey Shelukhin commented on HIVE-9978:
----------------------------------------

I have a simple fix, however while writing a test case I found numerous issues in LLAP tests,
and when I fixed those I found failure reminiscent of HIVE-9986. So I am working on that now.
I will attach a patch now that causes tests to fail, but not commit it yet.
[~prasanth_j] fyi

> LLAP: OrcColumnVectorProducer should handle reading isPresent columns only
> --------------------------------------------------------------------------
>
>                 Key: HIVE-9978
>                 URL: https://issues.apache.org/jira/browse/HIVE-9978
>             Project: Hive
>          Issue Type: Sub-task
>          Components: File Formats
>    Affects Versions: llap
>            Reporter: Gopal V
>            Assignee: Sergey Shelukhin
>
> LlapInputFormat does not understand the difference between empty columns list and null
columns list.
> The empty columns list indicates no columns read except the root struct isPresent column,
while the null columns list indicates that all columns are being read.
> {code}
> select count(1) from store_sales join date_dim on ss_sold_date_sk = d_date_sk where d_date
= '1998-01-01';
> ...
> Caused by: java.lang.NullPointerException
>         at org.apache.hadoop.hive.llap.io.decode.OrcColumnVectorProducer.createReadPipeline(OrcColumnVectorProducer.java:72)
>         at org.apache.hadoop.hive.llap.io.api.impl.LlapInputFormat$LlapRecordReader.startRead(LlapInputFormat.java:181)
>         at org.apache.hadoop.hive.llap.io.api.impl.LlapInputFormat$LlapRecordReader.next(LlapInputFormat.java:140)
>         at org.apache.hadoop.hive.llap.io.api.impl.LlapInputFormat$LlapRecordReader.next(LlapInputFormat.java:99)
>         at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:350)
>         ... 22 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message