Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 23EB997F3 for ; Fri, 20 Jul 2012 18:53:36 +0000 (UTC) Received: (qmail 91904 invoked by uid 500); 20 Jul 2012 18:53:35 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 91855 invoked by uid 500); 20 Jul 2012 18:53:35 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 91837 invoked by uid 99); 20 Jul 2012 18:53:35 -0000 Received: from issues-vm.apache.org (HELO issues-vm) (140.211.11.160) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Jul 2012 18:53:35 +0000 Received: from isssues-vm.apache.org (localhost [127.0.0.1]) by issues-vm (Postfix) with ESMTP id 7BF0014286B for ; Fri, 20 Jul 2012 18:53:35 +0000 (UTC) Date: Fri, 20 Jul 2012 18:53:35 +0000 (UTC) From: "Todd Lipcon (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <144828662.83283.1342810415510.JavaMail.jiratomcat@issues-vm> In-Reply-To: <1470719096.26021.1341879394554.JavaMail.jiratomcat@issues-vm> Subject: [jira] [Commented] (MAPREDUCE-4417) add support for encrypted shuffle MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419435#comment-13419435 ] Todd Lipcon commented on MAPREDUCE-4417: ---------------------------------------- - The {{AtomicBoolean running}} doesn't need to be an atomic boolean, since it's already volatile. You can just use a volatile boolean here. - in {{loadTrustManager}}, you need to get {{file.lastModified}} before you even open the {{FileInputStream}}. Otherwise if the file is replaced in between opening the stream and you getting the mtime, you'll read the old version of the file but think you read the new one (assuming an atomic rename-over-old-file replacement) Otherwise looks good to me. > add support for encrypted shuffle > --------------------------------- > > Key: MAPREDUCE-4417 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4417 > Project: Hadoop Map/Reduce > Issue Type: New Feature > Components: mrv2, security > Affects Versions: 2.0.0-alpha > Reporter: Alejandro Abdelnur > Assignee: Alejandro Abdelnur > Fix For: 2.1.0-alpha > > Attachments: MAPREDUCE-4417.patch, MAPREDUCE-4417.patch, MAPREDUCE-4417.patch, MAPREDUCE-4417.patch, MAPREDUCE-4417.patch, MAPREDUCE-4417.patch, MAPREDUCE-4417.patch, MAPREDUCE-4417.patch, MAPREDUCE-4417.patch, MAPREDUCE-4417.patch, MAPREDUCE-4417.patch, MAPREDUCE-4417.patch, MAPREDUCE-4417.patch, MAPREDUCE-4417.patch, MAPREDUCE-4417.patch > > > Currently Shuffle fetches go on the clear. While Kerberos provides comprehensive authentication for the cluster, it does not provide confidentiality. > When processing sensitive data confidentiality may be desired (at the expense of job performance and resources utilization for doing encryption). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira