hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12037) ORC: allow disabling orc meta index for large string type column
Date Mon, 12 Oct 2015 06:22:05 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14952687#comment-14952687
] 

Gopal V commented on HIVE-12037:
--------------------------------

[~kshitiz8]: You can do orc.create.index=false and avoid metadata indexes.

It is still recommended to use BINARY for columns which you want to skip indexes for, which
is encoded faster than STRING when the row width exceeds 4kb.

> ORC: allow disabling orc meta index for large string type column
> ----------------------------------------------------------------
>
>                 Key: HIVE-12037
>                 URL: https://issues.apache.org/jira/browse/HIVE-12037
>             Project: Hive
>          Issue Type: Bug
>          Components: StorageHandler
>            Reporter: Kshitiz Tripathi
>              Labels: orcfile
>
> Our ORC table consist of a large string type field with average size >20KB. The ORC
meta explodes because of such field and we need a switch in hive to disable meta generation
for it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message