hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5025) Key Distribution and Management for supporting crypto codec in Map Reduce
Date Thu, 30 May 2013 18:50:21 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13670593#comment-13670593
] 

Owen O'Malley commented on MAPREDUCE-5025:
------------------------------------------

This is a really problematic change. In particular, making changes to each input format seems
like a very error-prone idea. I'm also not comfortable with special casing the crypto codec
in the input/output formats.
                
> Key Distribution and Management for supporting crypto codec in Map Reduce
> -------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5025
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5025
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: security
>    Affects Versions: trunk
>            Reporter: Jerry Chen
>            Assignee: Jerry Chen
>         Attachments: MAPREDUCE-5025.patch
>
>   Original Estimate: 504h
>  Remaining Estimate: 504h
>
> This task defines the work to enable Map Reduce to utilize the Crypto Codec framework
to support encryption and decryption of data during MapReduce Job.
> According to the some real use case and discussions from the community, for encryption
and decryption files in Map Reduce, we have the following requirements:
>   1. Different stages (input, output, intermediate output) should have the flexibility
to choose whether encrypt or not, as well as which crypto codec to use.
>   2. Different stages may have different scheme of providing the keys.
>   3. Different Files (for example, different input files) may have or use different keys.

>   4. Support a flexible way of retrieving keys for encryption or decryption.
> So this task defines and provides the framework for supporting these requirements as
well as the implementations for common use and key retrieving scenarios.
> The design document of this part is included in the Hadoop Crypto Design attached in
HADOOP-9331.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message