hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-14707) AbstractContractDistCpTest to test attr preservation with -p, verify blobstores downgrade
Date Thu, 21 Dec 2017 14:09:13 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-14707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Steve Loughran updated HADOOP-14707:
    Attachment: HADOOP-14707-002.patch

Patch 002, significant mission creep as the hasCapabilities(string, path) option is the main
change, and its not wired up to the new test

> AbstractContractDistCpTest to test attr preservation with -p, verify blobstores downgrade
> -----------------------------------------------------------------------------------------
>                 Key: HADOOP-14707
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14707
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs, fs/azure, fs/s3, test, tools/distcp
>    Affects Versions: 2.9.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Minor
>         Attachments: HADOOP-14707-001.patch, HADOOP-14707-002.patch
> It *may* be that trying to use {{distcp -p}} with S3a triggers a stack trace 
> {code}
> java.lang.UnsupportedOperationException: S3AFileSystem doesn't support getXAttrs 
> at org.apache.hadoop.fs.FileSystem.getXAttrs(FileSystem.java:2559) 
> at org.apache.hadoop.tools.util.DistCpUtils.toCopyListingFileStatus(DistCpUtils.java:322)

> {code}
> Add a test to {{AbstractContractDistCpTest}} to verify that this is handled better. What
is "handle better" here? Either ignore the option or fail with "don't do that" text

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message