hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14007) Replace ORC module with ORC release
Date Sat, 10 Dec 2016 00:55:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736863#comment-15736863
] 

Owen O'Malley commented on HIVE-14007:
--------------------------------------

Ok, I've updated the pull request https://github.com/apache/hive/pull/81 and will post a new
patch once ORC 1.2.3 is released.

The patch ensures that the moved config variables don't create an error by adding them to
the exception map. https://github.com/omalley/hive/commit/d078aea84ecb1fe7d3e9b95cc845dfbdee63587c#diff-7f16e0de4170e5b6c031990da80f5643

As to why the patch is changing test files, it is because the ORC project has a couple of
fixes and features that hadn't been back ported to Hive.

In particular,
* ORC-101 fixes the bloom filters to use utf-8 rather than the jvm default encoding. This
changes the size of the ORC files and their write version. There is an option to write the
old broken bloom filters in addition to the new ones.
* ORC-54 makes the default for schema evolution to be by name instead of position if the ORC
files has real column names. Some of the tests required the old behavior and so I changed
the names to match for the intended matches. Note that Hive 1.x never got the fix to encode
the real column names in the file metadata, so all files written by Hive 1.x will use positional
matching.


> Replace ORC module with ORC release
> -----------------------------------
>
>                 Key: HIVE-14007
>                 URL: https://issues.apache.org/jira/browse/HIVE-14007
>             Project: Hive
>          Issue Type: Bug
>          Components: ORC
>    Affects Versions: 2.2.0
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>             Fix For: 2.2.0
>
>         Attachments: HIVE-14007.patch, HIVE-14007.patch, HIVE-14007.patch, HIVE-14007.patch
>
>
> This completes moving the core ORC reader & writer to the ORC project.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message