hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9067) OrcFileMergeOperator may create merge file that does not match properties of input files
Date Tue, 29 Sep 2015 01:32:04 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934462#comment-14934462
] 

Prasanth Jayachandran commented on HIVE-9067:
---------------------------------------------

I just tried the test case provided in HIVE-9080, in hive-0.14.0 and hive-1.0.1 binaries.
In hive-0.14.0 the job failed and in hive-1.0.1 (which includes the patch) the job succeeded.


> OrcFileMergeOperator may create merge file that does not match properties of input files
> ----------------------------------------------------------------------------------------
>
>                 Key: HIVE-9067
>                 URL: https://issues.apache.org/jira/browse/HIVE-9067
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.14.0, 0.15.0, 0.14.1
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>            Priority: Minor
>              Labels: Orc
>             Fix For: 1.0.0
>
>         Attachments: HIVE-9067.1.patch, HIVE-9067.2.patch
>
>
> OrcFileMergeOperator creates a new ORC file and appends the stripes from smaller orc
file. This new ORC file creation should retain the same configuration as the small ORC files.
Currently it does not set the orc row index stride and file version. Also merging of stripe
statistics to file statistics was incorrect leading to issues like in HIVE-9080



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message