hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Navis Ryu" <navis....@nexr.com>
Subject Review Request 17652: Support column level encryption/decryption
Date Mon, 03 Feb 2014 03:22:50 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17652/
-----------------------------------------------------------

Review request for hive.


Bugs: HIVE-6329
    https://issues.apache.org/jira/browse/HIVE-6329


Repository: hive-git


Description
-------

Receiving some requirements on encryption recently but hive is not supporting it. Before the
full implementation via HIVE-5207, this might be useful for some cases.

{noformat}
hive> create table encode_test(id int, name STRING, phone STRING, address STRING) 
    > ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' 
    > WITH SERDEPROPERTIES ('column.encode.indices'='2,3', 'column.encode.classname'='org.apache.hadoop.hive.serde2.Base64WriteOnly')
STORED AS TEXTFILE;
OK
Time taken: 0.584 seconds
hive> insert into table encode_test select 100,'navis','010-0000-0000','Seoul, Seocho'
from src tablesample (1 rows);
......
OK
Time taken: 5.121 seconds
hive> select * from encode_test;
OK
100	navis	  MDEwLTAwMDAtMDAwMA==	U2VvdWwsIFNlb2Nobw==
Time taken: 0.078 seconds, Fetched: 1 row(s)
hive> 
{noformat}


Diffs
-----

  hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseCompositeKey.java 5008f15 
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/LazyHBaseCellMap.java cedef10 
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/LazyHBaseRow.java fc40195 
  hbase-handler/src/test/org/apache/hadoop/hive/hbase/HBaseTestCompositeKey.java 13c344b 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcSerde.java c4268c1 
  ql/src/test/queries/clientpositive/column_encoding.q PRE-CREATION 
  ql/src/test/results/clientpositive/column_encoding.q.out PRE-CREATION 
  serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde/serdeConstants.java 515cf25

  serde/src/java/org/apache/hadoop/hive/serde2/Base64Rewriter.java PRE-CREATION 
  serde/src/java/org/apache/hadoop/hive/serde2/Base64WriteOnly.java PRE-CREATION 
  serde/src/java/org/apache/hadoop/hive/serde2/ByteStream.java 73d9b29 
  serde/src/java/org/apache/hadoop/hive/serde2/DelimitedJSONSerDe.java 179f9b5 
  serde/src/java/org/apache/hadoop/hive/serde2/FieldRewriter.java PRE-CREATION 
  serde/src/java/org/apache/hadoop/hive/serde2/columnar/ColumnarStruct.java 157600e 
  serde/src/java/org/apache/hadoop/hive/serde2/columnar/ColumnarStructBase.java 1fd6853 
  serde/src/java/org/apache/hadoop/hive/serde2/columnar/LazyBinaryColumnarStruct.java 6d9715a

  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyArray.java ce0cfb3 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyBinary.java ae12f20 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyBoolean.java c741c3a 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyByte.java a3b8f76 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyDate.java 7af2374 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyDouble.java 05ca4e9 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFloat.java 37676d1 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyHiveChar.java ef469eb 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyHiveDecimal.java 78cc381 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyHiveVarchar.java bc8d41e 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyInteger.java ad82ebf 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyLong.java a9779a0 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyMap.java 84c2a5e 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyNonPrimitive.java e4cffc9 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyObjectBase.java 3334dff 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyPrimitive.java 222b9bc 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyShort.java f04e131 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java 606208c 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyString.java 28b3f86 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyStruct.java 8a1ea46 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyTimestamp.java 27895c5 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyUnion.java 9f6bc3f 
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyVoid.java 13d1b11 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryArray.java 55f96ee 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryBinary.java d398285 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryBoolean.java 96969fb 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryByte.java d430c96 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryDate.java d0c2504 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryDouble.java c2c4f9e 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryFloat.java 11e13dc 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryHiveChar.java b64a3b4

  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryHiveDecimal.java e56e2ca

  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryHiveVarchar.java 26df6f3

  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryInteger.java f2a6943 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryLong.java ea0eba2 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryMap.java 31ad78e 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryNonPrimitive.java 1d0783f

  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinarySerDe.java 0324453 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryShort.java 1bc01ce 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryString.java 9f691d7 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryStruct.java caf3517 
  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryTimestamp.java 98dd81c

  serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryVoid.java 4b7153d 
  serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioBoolean.java 64a237e 
  serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioByte.java 8cdbfd8 
  serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioDouble.java c86705d 
  serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioFloat.java fc3c1b2 
  serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioInteger.java e7eca65 
  serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioLong.java 98c7058 
  serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioShort.java 137d0c8 
  serde/src/test/org/apache/hadoop/hive/serde2/lazy/TestLazyPrimitive.java 868dd4c 
  serde/src/test/org/apache/hadoop/hive/serde2/lazybinary/TestLazyBinarySerDe.java 69c891d


Diff: https://reviews.apache.org/r/17652/diff/


Testing
-------


Thanks,

Navis Ryu


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message