Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6FD9010D5E for ; Thu, 5 Sep 2013 15:06:02 +0000 (UTC) Received: (qmail 85282 invoked by uid 500); 5 Sep 2013 15:06:01 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 84843 invoked by uid 500); 5 Sep 2013 15:05:56 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 84526 invoked by uid 500); 5 Sep 2013 15:05:54 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 84510 invoked by uid 99); 5 Sep 2013 15:05:54 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Sep 2013 15:05:54 +0000 Date: Thu, 5 Sep 2013 15:05:53 +0000 (UTC) From: "Larry McCay (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-4227) Add column level encryption to ORC files MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759139#comment-13759139 ] Larry McCay commented on HIVE-4227: ----------------------------------- I am in the process of reworking the patch for HADOOP-9534 Credential Management Framework in order to support accessing keying material for this issue. Current thinking is that CMF can abstract the source of keys and be leveraged across a number of different crypto and password protection usecases in the Hadoop ecosystem. This is why it is being done in Hadoop rather than Hive. We will want to also align it's use with HADOOP-9331 - since 9331 will be leveraged in here as well as for the cryptoFS, etc. Will provide a description of the DDL/metastore and column store changes that will be needed to support the column level encryption once I have it written up. > Add column level encryption to ORC files > ---------------------------------------- > > Key: HIVE-4227 > URL: https://issues.apache.org/jira/browse/HIVE-4227 > Project: Hive > Issue Type: New Feature > Components: File Formats > Reporter: Owen O'Malley > Labels: gsoc, gsoc2013 > > It would be useful to support column level encryption in ORC files. Since each column and its associated index is stored separately, encrypting a column separately isn't difficult. In terms of key distribution, it would make sense to use an external server like the one in HADOOP-9331. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira