hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin Liew (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-13680) HiveServer2: Provide a way to compress ResultSets
Date Wed, 17 Aug 2016 15:07:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15421390#comment-15421390
] 

Kevin Liew edited comment on HIVE-13680 at 8/17/16 3:06 PM:
------------------------------------------------------------

Example  compressor attached. Configure the server with 

{code:xml}
    <property>
      <name>hive.server2.thrift.resultset.compressor.list</name>
      <value>snappy.snappy</value>
    </property>
    <property>
      <name>hive.server2.thrift.resultset.serialize.in.tasks</name>
      <value>true</value>
    </property>
{code}
, add the example CompDe to the Hive lib folder, 
and start beeline with
{noformat}--hiveconf hive.server2.thrift.resultset.compressor.list=snappy.snappy{noformat}


Alternatively you can use the Docker image that I have been using for development: https://github.com/kliewkliew/docker-hive-dev/tree/HIVE-13680



was (Author: kliew):
Example  compressor attached. Configure the server with 

{code:xml}
    <property>
      <name>hive.server2.thrift.resultset.compressor.list</name>
      <value>.</value>
    </property>
    <property>
      <name>hive.server2.thrift.resultset.serialize.in.tasks</name>
      <value>true</value>
    </property>
{code}
, add the example CompDe to the Hive lib folder, 
and start beeline with
{noformat}--hiveconf hive.server2.thrift.resultset.compressor.list=.{noformat}


Alternatively you can use the Docker image that I have been using for development: https://github.com/kliewkliew/docker-hive-dev/tree/HIVE-13680


> HiveServer2: Provide a way to compress ResultSets
> -------------------------------------------------
>
>                 Key: HIVE-13680
>                 URL: https://issues.apache.org/jira/browse/HIVE-13680
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HiveServer2, JDBC
>            Reporter: Vaibhav Gumashta
>            Assignee: Kevin Liew
>         Attachments: HIVE-13680.2.patch, HIVE-13680.patch, SnappyCompDe.zip, proposal.pdf
>
>
> With HIVE-12049 in, we can provide an option to compress ResultSets before writing to
disk. The user can specify a compression library via a config param which can be used in the
tasks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message