hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12548) read s3 creds from a file
Date Tue, 03 Nov 2015 23:42:27 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988482#comment-14988482
] 

Chris Nauroth commented on HADOOP-12548:
----------------------------------------

Hi [~lmccay].  Thanks for jumping in!

The current codebase uses this class to encapsulate retrieving the S3 credentials:

https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3/S3Credentials.java

Here is where you can see the s3n file system using that class:

https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3native/Jets3tNativeFileSystemStore.java#L79-L80

The s3a file system does it a little differently, without going through the {{S3Credentials}}
class:

https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java#L160-L161

IMO, we don't need to worry about looking at the s3 file system, only s3n and s3a.  Maybe
Allen can confirm or deny that though as the requester.

> read s3 creds from a file
> -------------------------
>
>                 Key: HADOOP-12548
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12548
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs/s3
>            Reporter: Allen Wittenauer
>
> It would be good if we could read s3 creds from a file rather than via a java property.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message