Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7A40910F3D for ; Thu, 29 May 2014 03:00:07 +0000 (UTC) Received: (qmail 90637 invoked by uid 500); 29 May 2014 03:00:07 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 90576 invoked by uid 500); 29 May 2014 03:00:07 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 90567 invoked by uid 99); 29 May 2014 03:00:07 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 May 2014 03:00:07 +0000 Date: Thu, 29 May 2014 03:00:07 +0000 (UTC) From: "Yi Liu (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012003#comment-14012003 ] Yi Liu commented on MAPREDUCE-5898: ----------------------------------- Thanks Uma for your detailed review. {quote} file system rooot. ---> file system root. {quote} Right, I will update it. {quote} seems like we are generically handling Exception and saying xattrs not supported in fs. But the api call can fail due to many other reasons like permission issues. Does it possible to bring down to handle specific exception?ex: no such method etc. {quote} Actually we getXAttrs on *root dir*, and the failure could be one of following reasons: 1. File system is HDFS < 2.4, so getXAttrs RPC endpoint doesn't exist 2. File system is HDFS >= 2.4, but XAttrs are not enabled. 3. FileSystem subclass doesn't override the XAttr APIs, and throw {{UnsupportedOperationException}}. All the above failues indicates XAttrs not supported. Furthermore, it's a bit difficult to handle specific exception, since they all are IOException subtype, and different FileSystem implementation may throw different IOException subtype. {quote} we need to change from rbugpca -> rbugpcax? {quote} Right, I will update it. > distcp to support preserving HDFS extended attributes(XAttrs) > ------------------------------------------------------------- > > Key: MAPREDUCE-5898 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: distcp > Affects Versions: 3.0.0 > Reporter: Uma Maheswara Rao G > Assignee: Yi Liu > Attachments: MAPREDUCE-5898.patch > > > This JIRA to track the distcp support to handle the Xattrs with preserving options. > Add new command line argument to support that. -- This message was sent by Atlassian JIRA (v6.2#6252)