Return-Path: X-Original-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DCE7811335 for ; Fri, 16 May 2014 18:14:06 +0000 (UTC) Received: (qmail 87766 invoked by uid 500); 16 May 2014 17:48:31 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 82252 invoked by uid 500); 16 May 2014 17:48:26 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 47362 invoked by uid 99); 16 May 2014 17:30:58 -0000 Received: from Unknown (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 May 2014 17:30:58 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of cnauroth@hortonworks.com designates 209.85.192.43 as permitted sender) Received: from [209.85.192.43] (HELO mail-qg0-f43.google.com) (209.85.192.43) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 May 2014 17:30:55 +0000 Received: by mail-qg0-f43.google.com with SMTP id 63so4689888qgz.2 for ; Fri, 16 May 2014 10:30:32 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=rl68O5NajNm9n44QvVL6uCLzPofvPIeX31Oj77xzrcU=; b=LmX3dHZmTEVV1tmG/vN/Q+4TxrumUpenIVcrmNz94/zHfE5t9na35X2c30z7o35GyB eBhQpSQaVaQYgsIDImg/aO4yIwUoVZeUxFeFS+zNgoqBAZPfYW3ZZjByercD7lkr7BFs cbNHgFf/5pOctMtOwn4Rje7M3dhAPcPQIWk+JonPzPu8lcS0Onld72IBbQIAik+FDuCS 0k1cL7vQZN6kKhip/pwS3s7L/qAu8389ngl+ohn+reuy4HEgqUngXn7kURS93L7Dv5Xn EFujGLmtTTuvtmib4Ik6ncNmyTMJ4vqIerUQ3XPFGjsKMhGYi+eOLtN67gdWrUMeuzhk MtJQ== X-Gm-Message-State: ALoCoQmgeOzFNeUYWOJGv4qIRGCbt+IQORr9zx7eE3ht+rX9aUah1OrW/X1OXPEO+QFVO3v6zIJTfmiaT+H0Tzk1GxW9MU0vzfMhSsDgfWKfk/BzpOwpFoI= MIME-Version: 1.0 X-Received: by 10.224.87.132 with SMTP id w4mr11932479qal.89.1400261432144; Fri, 16 May 2014 10:30:32 -0700 (PDT) Received: by 10.96.228.75 with HTTP; Fri, 16 May 2014 10:30:32 -0700 (PDT) In-Reply-To: References: <6A0439AD4731794E8EB53669FA76B11B0F3D11BE@BGSMSX102.gar.corp.intel.com> Date: Fri, 16 May 2014 10:30:32 -0700 Message-ID: Subject: Re: [Vote] Merge The HDFS XAttrs Feature Branch (HDFS-2006) to Trunk From: Chris Nauroth To: "hdfs-dev@hadoop.apache.org" Content-Type: multipart/alternative; boundary=001a1133dfb041926004f987c5b8 X-Virus-Checked: Checked by ClamAV on apache.org --001a1133dfb041926004f987c5b8 Content-Type: text/plain; charset=UTF-8 +1 for the merge. I've participated in ongoing design discussions and code reviews on individual patches. Yesterday, I completed a final review pass over the code in the feature branch, the design document, the end user documentation and the test plan. It looks ready to me. Thank you to everyone who made contributions on the feature branch. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, May 14, 2014 at 9:20 AM, Andrew Wang wrote: > +1 from me as well, I've participated in review and development of this > branch and think it's ready for merge. > > Thanks, > Andrew > > > On Wed, May 14, 2014 at 5:47 AM, Gangumalla, Uma > wrote: > > > Hello HDFS Devs, > > I would like to call for a vote to merge the HDFS Extended Attributes > > (XAttrs) feature from the HDFS-2006 branch to the trunk. > > XAttrs are already widely supported on many operating systems, > including > > Linux, Windows, and Mac OS. This will allow storing attributes for HDFS > > file/directory. > > XAttr consist of a name and a value and exist in one of 4 namespaces: > > user, trusted, security, and system. An XAttr name is prefixed with one > of > > these namespaces, so for example, "user.myxattr". > > Consistent with ongoing awareness of Namenode memory usage, the maximum > > number and size of XAttrs on a file/directory are limited by a > > configuration parameter. > > The design document contains more details and can be found here: > > > https://issues.apache.org/jira/secure/attachment/12644341/HDFS-XAttrs-Design-3.pdf > > Development of this feature has been tracked in JIRA HDFS-2006: > > https://issues.apache.org/jira/browse/HDFS-2006 > > All of the development work for the feature is contained in the > > "HDFS-2006" branch: > > https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2006 > > As last tasks, we are working to support XAttrs via libhdfs, webhdfs as > > well as other minor improvements. > > We intend to finish those enhancements before the vote completes and > > otherwise we could move them to top-level JIRAs as they can be tracked > > independently. User document is also ready for this feature. > > Here the doc attached in JIRA: > > > https://issues.apache.org/jira/secure/attachment/12644787/ExtendedAttributes.html > > The XAttrs feature is backwards-compatible and enabled by default. A > > cluster administrator can disable it. > > Testing: > > We've developed more than 70 new tests which cover the XAttrs get, set > > and remove APIs through DistributedFileSystem and WebHdfsFileSystem, the > > new XAttr CLI commands, HA, XAttr persistence in the fsimage and related. > > Additional testing plans are documented in: > > > https://issues.apache.org/jira/secure/attachment/12644342/Test-Plan-for-Extended-Attributes-1.pdf > > Thanks a lot to the contributors who have helped and participated in > the > > branch development. > > Code contributors are Yi Liu, Charles Lamb, Andrew Wang and Uma > > Maheswara Rao G. > > The design document incorporates feedback from many community members: > > Chris Nauroth, Andrew Purtell, Tianyou Li, Avik Dey, Charles Lamb, > > Alejandro, Andrew Wang, Tsz Wo Nicholas Sze and Uma Maheswara Rao G. > > Code reviewers on individual patches include Chris Nauroth, Alejandro, > > Andrew Wang, Charles Lamb, Tsz Wo Nicholas Sze and Uma Maheswara Rao G. > > > > Also thanks to Dhruba for bringing up this JIRA and thanks to others > who > > participated for discussions. > > This vote will run for a week and close on 5/21/2014 at 06:16 pm IST. > > > > Here is my +1 to start with. > > Regards, > > Uma > > (umamahesh@apache.org) > > > > > > > > > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. --001a1133dfb041926004f987c5b8--