Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7A4CEBA75 for ; Fri, 20 Jan 2012 21:15:20 +0000 (UTC) Received: (qmail 93750 invoked by uid 500); 20 Jan 2012 21:15:19 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 93596 invoked by uid 500); 20 Jan 2012 21:15:18 -0000 Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-user@hadoop.apache.org Delivered-To: mailing list hdfs-user@hadoop.apache.org Received: (qmail 93588 invoked by uid 99); 20 Jan 2012 21:15:18 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Jan 2012 21:15:18 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of charlescearl@me.com designates 17.148.16.98 as permitted sender) Received: from [17.148.16.98] (HELO asmtpout023.mac.com) (17.148.16.98) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Jan 2012 21:15:11 +0000 MIME-version: 1.0 Content-type: multipart/alternative; boundary="Boundary_(ID_BC6JhfFBrGOTxF2UXOveIQ)" Received: from [10.1.10.26] (50-73-77-86-static.hfc.comcastbusiness.net [50.73.77.86]) by asmtp023.mac.com (Oracle Communications Messaging Server 7u4-23.01 (7.0.4.23.0) 64bit (built Aug 10 2011)) with ESMTPSA id <0LY4000OV8CAN460@asmtp023.mac.com> for hdfs-user@hadoop.apache.org; Fri, 20 Jan 2012 21:14:35 +0000 (GMT) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:5.6.7361,1.0.211,0.0.0000 definitions=2012-01-20_04:2012-01-20,2012-01-20,1970-01-01 signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 ipscore=0 suspectscore=1 phishscore=0 bulkscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=6.0.2-1012030000 definitions=main-1201200240 From: Charles Earl Subject: Re: encryption Date: Fri, 20 Jan 2012 16:14:32 -0500 In-reply-to: To: hdfs-user@hadoop.apache.org References: Message-id: <28CD14AD-4197-4AD4-AA3F-B597E79486F1@me.com> X-Mailer: Apple Mail (2.1251.1) X-Virus-Checked: Checked by ClamAV on apache.org --Boundary_(ID_BC6JhfFBrGOTxF2UXOveIQ) Content-type: text/plain; CHARSET=US-ASCII Content-transfer-encoding: 7BIT Koert, Slightly related but not exactly is a Tahoe-LAFS plugin for hadoop http://code.google.com/p/hadoop-lafs I believe there has been discussion in this list on an encryption codec. C On Jan 20, 2012, at 4:09 PM, Koert Kuipers wrote: > Does anyone know of any work/ideas to encrypt data stored on hdfs? > Ideally both temporary files and final files would be encrypted. Or there would have to be a mechanism in hdfs to securely wipe temporary files, like shred in linux. > > So far this is what i found: > https://github.com/geisbruch/HadoopCryptoCompressor > > Best, > Koert --Boundary_(ID_BC6JhfFBrGOTxF2UXOveIQ) Content-type: text/html; CHARSET=US-ASCII Content-transfer-encoding: 7BIT Koert,
Slightly related but not exactly is a Tahoe-LAFS plugin for hadoop
I believe there has been discussion in this list on an encryption codec.
C
On Jan 20, 2012, at 4:09 PM, Koert Kuipers wrote:

Does anyone know of any work/ideas to encrypt data stored on hdfs?
Ideally both temporary files and final files would be encrypted. Or there would have to be a mechanism in hdfs to securely wipe temporary files, like shred in linux.

So far this is what i found:
https://github.com/geisbruch/HadoopCryptoCompressor

Best,
Koert

--Boundary_(ID_BC6JhfFBrGOTxF2UXOveIQ)--