hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15003) Merge S3A committers into trunk: Yetus patch checker
Date Fri, 17 Nov 2017 15:45:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257135#comment-16257135
] 

Steve Loughran commented on HADOOP-15003:
-----------------------------------------

FWIW, this is a sign of what will be a problem: s3a magic committer being used when the FS
doesn't have it turned on.

I'd made it an option as I didn't want to add special behaviour in case anyone was using the
paths, and because you shouldn't be using it without s3guard enabled.

If it happens now, it'll happen in future.

Immediate changes
* special warning if you try to create a file with a magic path and the FS is not.
* section in troubleshooting committers

FWIW, I am running my test FS with magic enabled, as I need it for other tests...that'll be
why I never saw the problem but you did. I'll switch to a different bucket for tests here

> Merge S3A committers into trunk: Yetus patch checker
> ----------------------------------------------------
>
>                 Key: HADOOP-15003
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15003
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.0.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>         Attachments: HADOOP-13786-041.patch, HADOOP-13786-042.patch, HADOOP-13786-043.patch,
HADOOP-13786-044.patch, HADOOP-13786-045.patch, HADOOP-13786-046.patch, HADOOP-13786-047.patch,
HADOOP-13786-048.patch, HADOOP-13786-049.patch, HADOOP-13786-050.patch, HADOOP-15033-testfix-1.diff
>
>
> This is a Yetus only JIRA created to have Yetus review the HADOOP-13786/HADOOP-14971
patch as a .patch file, as the review PR [https://github.com/apache/hadoop/pull/282] is stopping
this happening in HADOOP-14971.
> Reviews should go into the PR/other task



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message