hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth J (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8650) Byte align ORC's rle v2 patched base
Date Thu, 30 Oct 2014 17:44:35 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190458#comment-14190458
] 

Prasanth J commented on HIVE-8650:
----------------------------------

[~owen.omalley] Since we are considering 90th percentile value now, 10% of values can qualify
for patching. So we need to update patch length size in preparePatchedBlob()
{code}
    // since we are considering only 95 percentile, the size of gap and
    // patch array can contain only be 5% values
    patchLength = (int) Math.ceil((numLiterals * 0.05));

    int[] gapList = new int[patchLength];
{code}

Even better if we can pull these constants out to static finals.

> Byte align ORC's rle v2 patched base
> ------------------------------------
>
>                 Key: HIVE-8650
>                 URL: https://issues.apache.org/jira/browse/HIVE-8650
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>         Attachments: HIVE-8650.patch
>
>
> Currently the ORC rle v2 doesn't align patched base chunks, even if the user has chosen
to byte align the encoding.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message