hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6007) Create a new option for distcp -p which causes raw.* namespace extended attributes to not be preserved
Date Thu, 07 Aug 2014 21:43:13 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089890#comment-14089890
] 

Andrew Wang commented on MAPREDUCE-6007:
----------------------------------------

Okay, so I need to stop rushing this :) If you fix my above test by removing the "raw" path
components, you'll see that the target path isn't being qualified before being checked. Try
adding this near the top of SimpleCopyListing#validatePaths:

{code}
    # Qualify the target path before checking
    targetPath = targetFS.makeQualified(targetPath);
    final boolean targetIsReservedRaw =
        Path.getPathWithoutSchemeAndAuthority(targetPath).toString().
            startsWith(HDFS_RESERVED_RAW_DIRECTORY_NAME);
{code}

> Create a new option for distcp -p which causes raw.* namespace extended attributes to
not be preserved
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6007
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6007
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: distcp
>    Affects Versions: fs-encryption
>            Reporter: Charles Lamb
>            Assignee: Charles Lamb
>         Attachments: MAPREDUCE-6007.001.patch, MAPREDUCE-6007.002.patch, MAPREDUCE-6007.003.patch
>
>
> As part of the Data at Rest Encryption work (HDFS-6134), we need to create a new option
for distcp which causes raw.* namespace extended attributes to not be preserved. See the doc
in HDFS-6509 for details. The default for this option will be to preserve raw.* xattrs.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message