hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wei-Chiu Chuang <weic...@cloudera.com.INVALID>
Subject Re: Does Hbase backup process support encryption while transporting the data from one cluster to other cluster
Date Tue, 09 Oct 2018 14:54:44 GMT
Hi neo0731,
depending on what you mean by encryption, it can mean Hadoop at-rest
encryption, Hadoop data transport encryption, Hadoop RPC necryption, HBase
data transport encryption, Hbase RPC encryption, SSL encryption (Hadoop
WebHDFS, HBase Thrift)

distcp supports Hadoop at-rest encryption, and it supports Hadoop data
transport encryption/Hadoop RPC encryption. There's a proposal to support
webhdfs styled URL in distcp, and that way it will be able to support SSL
encrypted traffic.

HBase replication supports Hadoop at-rest encryption. We've seen the use
case in production.
I am aware of some bugs in HBase backup tool that can't read Hadoop
encryption zone files.

On Tue, Oct 9, 2018 at 5:28 AM neo0731 <vva.baghel@gmail.com> wrote:

>
> Question arises when migrating the data from one hbase table to another.
>
> Input
>
> To sync the production cluster data with dev cluster. Additionaly, while
> copying we need to re-hash the following fields: hashed_email, lexer_id,
> foo_imsi, foo_msn, signal_uid, bar_imsi.
>
> Question is : Does copyTable support hashing of data while copying? Same
> for
> distcp utility ? Is it possible to supply some example code in scala as
> well
>
> Any help on it would be much appreciated?
>
>
>
> --
> Sent from:
> http://apache-hbase.679495.n3.nabble.com/HBase-Developer-f679493.html
>


-- 
A very happy Clouderan

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message