Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-issues@hadoop.apache.org
Date: Fri, 30 Jan 2015 17:43:35 +0000 (UTC)
From: "Chris Nauroth (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Message-ID: <JIRA.12752445.1415029087000.216513.1422639815131@Atlassian.JIRA>
In-Reply-To: <JIRA.12752445.1415029087000@Atlassian.JIRA>
References: <JIRA.12752445.1415029087000@Atlassian.JIRA>
 <JIRA.12752445.1415029087280@arcas>
Subject: [jira] [Commented] (HADOOP-11262) Enable YARN to use S3A
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HADOOP-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14298918#comment-14298918 ] 

Chris Nauroth commented on HADOOP-11262:
----------------------------------------

bq. you shouldn't have to set the s3a.impl file; it should instead go into core-default.xml

I've been thinking that we really ought to have {{ServiceLoader}} support for {{AbstractFileSystem}}, so that S3A and others can register themselves in their jar manifest instead of the configuration files, just like {{FileSystem}}.  I filed HADOOP-11527 for this.

No need to hold up the work happening here waiting for it though.  This is just FYI.

> Enable YARN to use S3A 
> -----------------------
>
>                 Key: HADOOP-11262
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11262
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/s3
>            Reporter: Thomas Demoor
>            Assignee: Thomas Demoor
>              Labels: amazon, s3
>         Attachments: HADOOP-11262-2.patch, HADOOP-11262-3.patch, HADOOP-11262-4.patch, HADOOP-11262.patch
>
>
> Uses DelegateToFileSystem to expose S3A as an AbstractFileSystem.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)