hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rohit Dholakia" <roh...@simba.com>
Subject Review Request 35792: HIVE-10438 - Architecture for ResultSet Compression via external plugin
Date Tue, 23 Jun 2015 20:39:30 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/35792/
-----------------------------------------------------------

Review request for hive, Vaibhav Gumashta and Xuefu Zhang.


Repository: hive-git


Description
-------

This patch enables ResultSet compression for Hive using external plugins. The patch proposes
a plugin architecture that enables using external plugins to compress ResultSets on-the-fly.


Diffs
-----

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 27f68df 
  conf/hive-site.xml dab494e 
  service/if/TCLIService.thrift baf583f 
  service/src/gen/thrift/gen-cpp/TCLIService_types.h 7bceabd 
  service/src/gen/thrift/gen-cpp/TCLIService_types.cpp 86eeea3 
  service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TEnColumn.java PRE-CREATION

  service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TExecuteStatementReq.java
4f157ad 
  service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TGetTablesReq.java
c973fcc 
  service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TOpenSessionReq.java
c048161 
  service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TOpenSessionResp.java
351f78b 
  service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TProtocolVersion.java
a4279d2 
  service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TRowSet.java d16c8a4

  service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TStatus.java 24a746e

  service/src/gen/thrift/gen-py/TCLIService/ttypes.py 068727c 
  service/src/gen/thrift/gen-rb/t_c_l_i_service_types.rb b482533 
  service/src/java/org/apache/hive/service/cli/Column.java 2e21f18 
  service/src/java/org/apache/hive/service/cli/ColumnBasedSet.java 47a582e 
  service/src/java/org/apache/hive/service/cli/ColumnCompressor.java PRE-CREATION 
  service/src/java/org/apache/hive/service/cli/ColumnCompressorService.java PRE-CREATION 
  service/src/java/org/apache/hive/service/cli/EncodedColumnBasedSet.java PRE-CREATION 
  service/src/java/org/apache/hive/service/cli/RowSetFactory.java e8f68ea 
  service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java dfb7faa 

Diff: https://reviews.apache.org/r/35792/diff/


Testing
-------

Testing has been done using a docker container-based query submitter that has an integer decompressor
as part of it. Using the integer compressor (also provided) and the decompressor, the end-to-end
functionality can be observed.


File Attachments
----------------

Patch file
  https://reviews.apache.org/media/uploaded/files/2015/06/23/16aa08f8-2393-460a-83ef-72464fc537db__HIVE-10438.patch


Thanks,

Rohit Dholakia


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message