hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6007) Create a new option for distcp -p which causes raw.* namespace extended attributes to not be preserved
Date Thu, 07 Aug 2014 21:27:13 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089876#comment-14089876
] 

Andrew Wang commented on MAPREDUCE-6007:
----------------------------------------

Nice work, this is way simpler. I think we're pretty close.

* In the md.vm file, let's scratch the change to the table, I think the section is enough
by itself.
* Not sure we're fully qualifying relative paths correctly. I wrote a small test which I expected
to work. Could you confirm? I think we just need to qualify the src paths with the src FileSystem
first.

{code}
  @Test
  public void testWorkingDir() throws Exception {
    final Path wd = fs.getWorkingDirectory();
    try {
      fs.setWorkingDirectory(new Path("/.reserved/raw/"));
      doTestPreserveRawXAttrs("raw/src", "raw/dest", "-px", true, true, 
          DistCpConstants.SUCCESS);
    } finally {
      fs.setWorkingDirectory(wd);
    }
  }
{code}

> Create a new option for distcp -p which causes raw.* namespace extended attributes to
not be preserved
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6007
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6007
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: distcp
>    Affects Versions: fs-encryption
>            Reporter: Charles Lamb
>            Assignee: Charles Lamb
>         Attachments: MAPREDUCE-6007.001.patch, MAPREDUCE-6007.002.patch, MAPREDUCE-6007.003.patch
>
>
> As part of the Data at Rest Encryption work (HDFS-6134), we need to create a new option
for distcp which causes raw.* namespace extended attributes to not be preserved. See the doc
in HDFS-6509 for details. The default for this option will be to preserve raw.* xattrs.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message