hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-10494) Ensure Jets3tFileSystemStore respects URI path for block files
Date Mon, 14 Apr 2014 08:58:14 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-10494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Steve Loughran updated HADOOP-10494:

    Component/s:     (was: fs)

> Ensure Jets3tFileSystemStore respects URI path for block files
> --------------------------------------------------------------
>                 Key: HADOOP-10494
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10494
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/s3
>            Reporter: Mark J Greene
>            Priority: Trivial
>              Labels: easyfix
> The Jets3tFileSystemStore will currently store all block files in the root of an S3 bucket.
If you specify a path in your OutputFormat, those paths are created, and some of the supporting
meta files are stored there, but all block files will reside in the root of the bucket.
> We tracked this down to this method here, which does not use the provided URI from the
the job: https://github.com/apache/hadoop-common/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/s3/Jets3tFileSystemStore.java#L381

This message was sent by Atlassian JIRA

View raw message