hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Radia (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6134) Transparent data at rest encryption
Date Thu, 14 Aug 2014 04:56:17 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096570#comment-14096570

Sanjay Radia commented on HDFS-6134:

bq. If you set up httpfs, it runs using the 'httpfs' user, a HDFS regular user configured
as proxyuser to interact with HDFS and KMS doing doAs calls
Alejandro , we modified the original design in this Jira so that the NN is not a proxy for
the keys but instead the client get the keys directly from the KMS because  the best practice
in encryption  is to eliminate  proxies (see Owen's comment of June 11).  With your proposal
for  httpfs, the httpfs server is a proxy to  get the keys. Perhaps we are approaching the
problem wrong. Consider the following alternative: let webhdfs and httpfs simply send the
encrypted raw data to the client. For  the hdfs-native filesystem,  the encryption and decryption
happens on the client side;  we should consider the same for the rest protocol. Clearly it
requires more code on the rest client side.

BTW the webhdfs-fileSystem (as opposed to the  rest protocol that is discussed about) has
a client side library that can mimic the  hdfs filesystem's client side.

> Transparent data at rest encryption
> -----------------------------------
>                 Key: HDFS-6134
>                 URL: https://issues.apache.org/jira/browse/HDFS-6134
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: security
>    Affects Versions: 3.0.0, 2.3.0
>            Reporter: Alejandro Abdelnur
>            Assignee: Charles Lamb
>         Attachments: HDFS-6134.001.patch, HDFS-6134.002.patch, HDFS-6134_test_plan.pdf,
HDFSDataatRestEncryption.pdf, HDFSDataatRestEncryptionProposal_obsolete.pdf, HDFSEncryptionConceptualDesignProposal-2014-06-20.pdf
> Because of privacy and security regulations, for many industries, sensitive data at rest
must be in encrypted form. For example: the health­care industry (HIPAA regulations), the
card payment industry (PCI DSS regulations) or the US government (FISMA regulations).
> This JIRA aims to provide a mechanism to encrypt HDFS data at rest that can be used transparently
by any application accessing HDFS via Hadoop Filesystem Java API, Hadoop libhdfs C library,
> The resulting implementation should be able to be used in compliance with different regulation

This message was sent by Atlassian JIRA

View raw message