Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AD0BF9D6B for ; Mon, 28 Nov 2011 10:40:13 +0000 (UTC) Received: (qmail 17858 invoked by uid 500); 28 Nov 2011 10:40:12 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 17774 invoked by uid 500); 28 Nov 2011 10:40:11 -0000 Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-user@hadoop.apache.org Delivered-To: mailing list hdfs-user@hadoop.apache.org Received: (qmail 17760 invoked by uid 99); 28 Nov 2011 10:40:11 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Nov 2011 10:40:11 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates 209.85.213.48 as permitted sender) Received: from [209.85.213.48] (HELO mail-yw0-f48.google.com) (209.85.213.48) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Nov 2011 10:40:05 +0000 Received: by ywp31 with SMTP id 31so6182858ywp.35 for ; Mon, 28 Nov 2011 02:39:44 -0800 (PST) Received: by 10.68.39.197 with SMTP id r5mr1413236pbk.16.1322476783974; Mon, 28 Nov 2011 02:39:43 -0800 (PST) MIME-Version: 1.0 Received: by 10.142.57.8 with HTTP; Mon, 28 Nov 2011 02:39:19 -0800 (PST) In-Reply-To: <7D9AF4B98807C54EBADEA75DF6D5ACB7E315C281@NDA-HCLC-EVS04.HCLC.CORP.HCL.IN> References: <7D9AF4B98807C54EBADEA75DF6D5ACB7E2BCB9B2@NDA-HCLC-EVS04.HCLC.CORP.HCL.IN> <7D9AF4B98807C54EBADEA75DF6D5ACB7E315C281@NDA-HCLC-EVS04.HCLC.CORP.HCL.IN> From: Harsh J Date: Mon, 28 Nov 2011 16:09:19 +0530 Message-ID: Subject: Re: Hadoop Security To: hdfs-user@hadoop.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Apache Hadoop 0.20.2 did not have security features in it. You'd need 0.20.203 at least, if not one of the current CDH3/0.20.205 (Both of which also carry 0.20-append along with 0.20-security). On Mon, Nov 28, 2011 at 3:56 PM, Stuti Awasthi wrote= : > Thanks Alexander for this info. > Currently I am using Apache Hadoop version 0.20.2 and not cloudera=E2=80= =99s Hadoop version. I read that Apache Hadoop 0.20.205 supports Security. = Any thoughts on that. > Since currently I am using Apache Hadoop and quite familiar with it so I = would like to use it some more before using CDH. > > > > From: Alexander C.H. Lorenz [mailto:wget.null@googlemail.com] > Sent: Monday, November 28, 2011 3:25 PM > To: hdfs-user@hadoop.apache.org > Subject: Re: Hadoop Security > > HI, > > 1. yes: > https://ccp.cloudera.com/display/CDHDOC/Configuring+Hadoop+Security+in+CD= H3 > http://hortonworks.com/the-role-of-delegation-tokens-in-apache-hadoop-sec= urity/ > > 2. yes > http://mapredit.blogspot.com/2011/10/secure-your-hadoop-cluster-part-i.ht= ml > > 3. at the moment hdfs has no encryption engine, so far I know. > > best, > =C2=A0Alex > > On Mon, Nov 28, 2011 at 10:44 AM, Stuti Awasthi wr= ote: > Hi , > > I wanted to know about the security in Hadoop. I have read few articles b= ut not very sure about this so I wanted to discuss this topic in forum. > As we know that Hadoop provide its security using Filesystem permissions = like chown, chmod etc. > > 1. Is Kerberos or any security algo is implemented in the code so that we= can authenticate or authorize Hadoop.? > 2. Can we use LDAP for authentication and Authorization in Hadoop > 3. Is any kind of encryption is handled in hadoop at the time of storing = the files in HDFS. > > Can anyone please provide me some good links to read on Hadoop Security > > Regards, > Stuti Awasthi > > ::DISCLAIMER:: > -------------------------------------------------------------------------= ---------------------------------------------- > > The contents of this e-mail and any attachment(s) are confidential and in= tended for the named recipient(s) only. > It shall not attach any liability on the originator or HCL or its affilia= tes. Any views or opinions presented in > this email are solely those of the author and may not necessarily reflect= the opinions of HCL or its affiliates. > Any form of reproduction, dissemination, copying, disclosure, modificatio= n, distribution and / or publication of > this message without the prior written consent of the author of this e-ma= il is strictly prohibited. If you have > received this email in error please delete it and notify the sender immed= iately. Before opening any mail and > attachments please check them for viruses and defect. > > -------------------------------------------------------------------------= ---------------------------------------------- > > > > > -- > Alexander Lorenz > http://mapredit.blogspot.com > > =EF=81=90=EF=82=A0Think of the environment: please don't print this email= unless you really need to. > > > --=20 Harsh J