hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9067) OrcFileMergeOperator may create merge file that does not match properties of input files
Date Mon, 28 Sep 2015 02:37:04 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14909986#comment-14909986
] 

Prasanth Jayachandran commented on HIVE-9067:
---------------------------------------------

[~Feng Yuan]. This patch went in 1.0.0 (which is 0.14.1). What exact hive version are you
using?

> OrcFileMergeOperator may create merge file that does not match properties of input files
> ----------------------------------------------------------------------------------------
>
>                 Key: HIVE-9067
>                 URL: https://issues.apache.org/jira/browse/HIVE-9067
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.14.0, 0.15.0, 0.14.1
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>            Priority: Minor
>              Labels: Orc
>             Fix For: 1.0.0
>
>         Attachments: HIVE-9067.1.patch, HIVE-9067.2.patch
>
>
> OrcFileMergeOperator creates a new ORC file and appends the stripes from smaller orc
file. This new ORC file creation should retain the same configuration as the small ORC files.
Currently it does not set the orc row index stride and file version. Also merging of stripe
statistics to file statistics was incorrect leading to issues like in HIVE-9080



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message