hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11262) Enable YARN to use S3A
Date Fri, 30 Jan 2015 17:43:35 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14298918#comment-14298918
] 

Chris Nauroth commented on HADOOP-11262:
----------------------------------------

bq. you shouldn't have to set the s3a.impl file; it should instead go into core-default.xml

I've been thinking that we really ought to have {{ServiceLoader}} support for {{AbstractFileSystem}},
so that S3A and others can register themselves in their jar manifest instead of the configuration
files, just like {{FileSystem}}.  I filed HADOOP-11527 for this.

No need to hold up the work happening here waiting for it though.  This is just FYI.

> Enable YARN to use S3A 
> -----------------------
>
>                 Key: HADOOP-11262
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11262
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/s3
>            Reporter: Thomas Demoor
>            Assignee: Thomas Demoor
>              Labels: amazon, s3
>         Attachments: HADOOP-11262-2.patch, HADOOP-11262-3.patch, HADOOP-11262-4.patch,
HADOOP-11262.patch
>
>
> Uses DelegateToFileSystem to expose S3A as an AbstractFileSystem.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message