hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yi Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
Date Thu, 29 May 2014 03:00:07 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012003#comment-14012003

Yi Liu commented on MAPREDUCE-5898:

Thanks Uma for your detailed review.

file system rooot. ---> file system root.
Right, I will update it.

seems like we are generically handling Exception and saying xattrs not supported in fs. But
the api call can fail due to many other reasons like permission issues. Does it possible to
bring down to handle specific exception?ex: no such method etc.

Actually we getXAttrs on *root dir*, and the failure could be one of following reasons:
  1. File system is HDFS < 2.4, so getXAttrs RPC endpoint doesn't exist
  2. File system is HDFS >= 2.4, but XAttrs are not enabled.
  3. FileSystem subclass doesn't override the XAttr APIs, and throw {{UnsupportedOperationException}}.

All the above failues indicates XAttrs not supported.
Furthermore, it's a bit difficult to handle specific exception, since they all are IOException
subtype, and different FileSystem implementation may throw different IOException subtype.

we need to change from rbugpca -> rbugpcax?
Right, I will update it.

> distcp to support preserving HDFS extended attributes(XAttrs)
> -------------------------------------------------------------
>                 Key: MAPREDUCE-5898
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: distcp
>    Affects Versions: 3.0.0
>            Reporter: Uma Maheswara Rao G
>            Assignee: Yi Liu
>         Attachments: MAPREDUCE-5898.patch
> This JIRA to track the distcp support to handle the Xattrs with preserving options.
> Add new command line argument to support that.

This message was sent by Atlassian JIRA

View raw message