hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-17600) Make OrcFile's "enforceBufferSize" user-settable.
Date Wed, 08 Nov 2017 22:05:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16244800#comment-16244800
] 

Owen O'Malley commented on HIVE-17600:
--------------------------------------

+1 for branch-2.2.

> Make OrcFile's "enforceBufferSize" user-settable.
> -------------------------------------------------
>
>                 Key: HIVE-17600
>                 URL: https://issues.apache.org/jira/browse/HIVE-17600
>             Project: Hive
>          Issue Type: Improvement
>          Components: ORC
>    Affects Versions: 2.2.0, 3.0.0
>            Reporter: Mithun Radhakrishnan
>            Assignee: Mithun Radhakrishnan
>         Attachments: HIVE-17600.1-branch-2.2.patch
>
>
> This is a duplicate of ORC-238, but it applies to {{branch-2.2}}.
> Compression buffer-sizes in OrcFile are computed at runtime, except when enforceBufferSize
is set. The only snag here is that this flag can't be set by the user.
> When runtime-computed buffer-sizes are not optimal (for some reason), the user has no
way to work around it by setting a custom value.
> I have a patch that we use at Yahoo.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message