Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-issues@hadoop.apache.org
Date: Mon, 9 Dec 2013 12:14:08 +0000 (UTC)
From: "Yi Liu (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Message-ID: <JIRA.12666081.1377762881190.1969.1386591248345@arcas>
In-Reply-To: <JIRA.12666081.1377762881190@arcas>
References: <JIRA.12666081.1377762881190@arcas>
Subject: [jira] [Commented] (HADOOP-10150) Hadoop cryptographic file system
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


    [ https://issues.apache.org/jira/browse/HADOOP-10150?page=3Dcom.atlassi=
an.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D13=
843097#comment-13843097 ]=20

Yi Liu commented on HADOOP-10150:
---------------------------------

Hi Owen, thanks for bringing it up here. I am working on breaking down the =
patches and creating sub-task JIRAs as already mentioned in my previous res=
ponse. Rest of your comment seems to be about a different JIRA and is proba=
bly best discussed on that JIRA.

* HADOOP-10149: since I have that patch already implemented, do you mind as=
signing it to me? I will take that piece of code and apply there for review=
.
* Since HADOOP-10141 tries to improve on HADOOP-9333, why not provide your =
feedback on HADOOP-9333 instead of opening a JIRA that duplicates part of t=
hat work?


> Hadoop cryptographic file system
> --------------------------------
>
>                 Key: HADOOP-10150
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10150
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: security
>    Affects Versions: 3.0.0
>            Reporter: Yi Liu
>            Assignee: Yi Liu
>              Labels: rhino
>             Fix For: 3.0.0
>
>         Attachments: CryptographicFileSystem.patch, HADOOP cryptographic =
file system.pdf
>
>
> There is an increasing need for securing data when Hadoop customers use v=
arious upper layer applications, such as Map-Reduce, Hive, Pig, HBase and s=
o on.
> HADOOP CFS (HADOOP Cryptographic File System) is used to secure data, bas=
ed on HADOOP =E2=80=9CFilterFileSystem=E2=80=9D decorating DFS or other fil=
e systems, and transparent to upper layer applications. It=E2=80=99s config=
urable, scalable and fast.
> High level requirements:
> 1.=09Transparent to and no modification required for upper layer applicat=
ions.
> 2.=09=E2=80=9CSeek=E2=80=9D, =E2=80=9CPositionedReadable=E2=80=9D are sup=
ported for input stream of CFS if the wrapped file system supports them.
> 3.=09Very high performance for encryption and decryption, they will not b=
ecome bottleneck.
> 4.=09Can decorate HDFS and all other file systems in Hadoop, and will not=
 modify existing structure of file system, such as namenode and datanode st=
ructure if the wrapped file system is HDFS.
> 5.=09Admin can configure encryption policies, such as which directory wil=
l be encrypted.
> 6.=09A robust key management framework.
> 7.=09Support Pread and append operations if the wrapped file system suppo=
rts them.


--
This message was sent by Atlassian JIRA
(v6.1.4#6159)