hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lefty Leverenz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7219) Improve performance of serialization utils in ORC
Date Sat, 09 Aug 2014 19:41:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091875#comment-14091875
] 

Lefty Leverenz commented on HIVE-7219:
--------------------------------------

Configuration parameter *hive.exec.orc.encoding.strategy* is documented in the wiki here for
release 0.14.0:

* [Configuration Properties -- hive.exec.orc.encoding.strategy | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.exec.orc.encoding.strategy]

> Improve performance of serialization utils in ORC
> -------------------------------------------------
>
>                 Key: HIVE-7219
>                 URL: https://issues.apache.org/jira/browse/HIVE-7219
>             Project: Hive
>          Issue Type: Improvement
>          Components: File Formats
>    Affects Versions: 0.14.0
>            Reporter: Prasanth J
>            Assignee: Prasanth J
>             Fix For: 0.14.0
>
>         Attachments: HIVE-7219.1.patch, HIVE-7219.2.patch, HIVE-7219.3.patch, HIVE-7219.4.patch,
orc-read-perf-jmh-benchmark.png
>
>
> ORC uses serialization utils heavily for reading and writing data. The bitpacking and
unpacking code in writeInts() and readInts() can be unrolled for better performance. Also
double reader/writer performance can be improved by bulk reading/writing from/to byte array.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message