hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerry Chen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9331) Hadoop crypto codec framework and crypto codec implementations
Date Wed, 03 Apr 2013 02:11:16 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13620523#comment-13620523

Jerry Chen commented on HADOOP-9331:

{quote}Can you give a example how to config this feature?{quote}
1. For crypto codec, it is identical to the usage of compression codec and no general configuration
needed in API level. Please refer to “2.3 Use Cases” for API usage examples in design
document attached in this JIRA. Just the same as compression codec, codec implementation may
have its own configurations.  Please refer the “3.3 User Case” for usage example of AESCodec.
2. For MapReduce job to use crypto codec, including the configurations that needed for compression
codec, we need further configurations for providing the keys.  The section “4 MapReduce
Key Management” of the design document has a detailed description of configurations and
please refer the “4.6 Use Cases” for usage examples for this part.
> Hadoop crypto codec framework and crypto codec implementations
> --------------------------------------------------------------
>                 Key: HADOOP-9331
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9331
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: security
>    Affects Versions: 3.0.0
>            Reporter: Jerry Chen
>         Attachments: Hadoop Crypto Design.pdf
>   Original Estimate: 504h
>  Remaining Estimate: 504h
> For use cases that deal with sensitive data, we often need to encrypt data to be stored
safely at rest. Hadoop common provides a codec framework for compression algorithms. We start
here. However because encryption algorithms require some additional configuration and methods
for key management, we introduce a crypto codec framework that builds on the compression codec
framework. It cleanly distinguishes crypto algorithms from compression algorithms, but shares
common interfaces between them where possible, and also carries extended interfaces where
necessary to satisfy those needs. We also introduce a generic Key type, and supporting utility
methods and classes, as a necessary abstraction for dealing with both Java crypto keys and
PGP keys.
> The task for this feature breaks into two parts:
> 1. The crypto codec framework that based on compression codec which can be shared by
all crypto codec implementations.
> 2. The codec implementations such as AES and others.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message