hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5876) Split elimination in ORC breaks for partitioned tables
Date Wed, 27 Nov 2013 06:05:37 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13833498#comment-13833498
] 

Ashutosh Chauhan commented on HIVE-5876:
----------------------------------------

+1 Just for clarification, was it the case that {{serdeConstants.columns}} config in job-conf
contains partition columns as well ? 

> Split elimination in ORC breaks for partitioned tables
> ------------------------------------------------------
>
>                 Key: HIVE-5876
>                 URL: https://issues.apache.org/jira/browse/HIVE-5876
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.13.0
>            Reporter: Prasanth J
>            Assignee: Prasanth J
>              Labels: orcfile
>         Attachments: HIVE-5876.1.patch, HIVE-5876.2.patch
>
>
> HIVE-5632 eliminates ORC stripes from split computation that do not satisfy SARG condition.
SARG expression can also refer to partition columns. But partition column will not be contained
in the column names list in ORC file. This was causing ArrayIndexOutOfBoundException in split
elimination logic when used with partitioned tables. The fix is to ignore evaluation of partition
column expressions in split elimination.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message