sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Attila Szabó <mau...@apache.org>
Subject Re: Secure sqoop transfer
Date Thu, 16 Mar 2017 15:34:39 GMT
Hey Sumit,

Thanks for the information. Most probably I've phrased my words in a
confusing way.

I've meant that according to my knowledge there's no single out of the box
free/open source solution for this (just a good example for that the
properties+settings differs from RBMS to RBMDS JDBC to JDBC, etc.).
Of course it would be possible to create such a tool, but IMHO it would be
out of the scope of Sqoop.

Thanks again Sumit for your additions!


On Thu, Mar 16, 2017 at 3:55 PM, Sumit Sarkar <Sumit.Sarkar@progress.com>

> For option B, there are a couple generic solutions available form my
> employer.
> 1) Generic Hybrid JDBC Connectors
> <https://www.progress.com/cloud-and-hybrid-data-integration> encrypts
> data over HTTPS and can run locally or hybrid and 2) SequeLink JDBC-JDBC
> Socket <https://www.progress.com/connectors/sequelink> encrypts using
> TCP/IP. We use option #1 to load our internal data lake via Sqoop and
> sample scripts are here
> <https://www.progress.com/blogs/bulk-data-movement-to-sql-databases-in-hybrid-cloud>
> for a hybrid example but works similar if completely run on-premises.
> From: Attila Szabó <maugli@apache.org>
> Reply-To: "user@sqoop.apache.org" <user@sqoop.apache.org>
> Date: Tuesday, March 14, 2017 at 6:30 PM
> To: "dev@sqoop.apache.org" <dev@sqoop.apache.org>
> Cc: "user@sqoop.apache.org" <user@sqoop.apache.org>
> Subject: Re: Secure sqoop transfer
> Hey Jagrut,
> Do you have a specific RDBMS you'd like to use, or would you like to do it
> in a generic way?
> If A. You should check the specific JDBC driver for the driver/transport
> level encryption options/properties, and feed it to the env execution your
> Sqoop command (Sqoop itself right now cannot, and IMHO should not implement
> it's own encryption solutions, as it has to happen on JDBC level).
> if B. AFAIK there is no general solution for this in case of JDBC
> supported Databases, but you could try to setup a secure + encrypted VPN
> network, which will solve this to you out of the box.
> My 2 cents,
> Attila
> On Tue, Mar 14, 2017 at 6:22 PM, Jagrut Sharma <jagrutsharma@gmail.com>
> wrote:
>> I'm trying to figure out if there is a way to do encrypted data transfer
>> between the source rdbms system and cluster when importing data via sqoop
>> (version 1.4.6). Any pointers would be helpful.
>> Thanks!
>> --
>> Jagrut

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message