hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yi Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
Date Mon, 26 May 2014 14:51:02 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008896#comment-14008896

Yi Liu commented on MAPREDUCE-5898:

As we know, xattrs can be stored in 4 namespaces: user, trusted, security and system.

{{user}} and {{trusted}} namespaces xattr are available to user, but {{security}} and {{system}}
namespaces xattr are only for HDFS core.  
Initial thought is distcp supports preserving {{user}} and {{trusted}} namespaces xattr; for
{{security}} and {{system}} namespaces, they should be managed by target FS through pre-configuration.

For example, in HDFS transparent encryption, {{security}} namespace xattrs are used. To copy
encryption dir from src HDFS to target HDFS, user needs to create the encryption zone in target
HDFS firstly, then data written to the encryption dir of target HDFS will be encrypted automatically.

Agree with [~andrew.wang] to use new option flag "-px" of distcp for "preserve XAttrs".

> distcp to support preserving HDFS extended attributes(XAttrs)
> -------------------------------------------------------------
>                 Key: MAPREDUCE-5898
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: distcp
>    Affects Versions: 3.0.0
>            Reporter: Uma Maheswara Rao G
>            Assignee: Yi Liu
> This JIRA to track the distcp support to handle the Xattrs with preserving options.
> Add new command line argument to support that.

This message was sent by Atlassian JIRA

View raw message