hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7269) S3 Native should allow customizable file meta-data (headers)
Date Wed, 18 May 2011 18:22:47 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035545#comment-13035545
] 

Tom White commented on HADOOP-7269:
-----------------------------------

This looks good. Can you run Jets3tNativeS3FileSystemContractTest to check that it works against
real S3? You can set credentials in src/test/core-site.xml.

> S3 Native should allow customizable file meta-data (headers)
> ------------------------------------------------------------
>
>                 Key: HADOOP-7269
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7269
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/s3
>            Reporter: Nicholas Telford
>            Assignee: Nicholas Telford
>            Priority: Minor
>         Attachments: HADOOP-7269-S3-metadata-001.diff, HADOOP-7269-S3-metadata-002.diff,
HADOOP-7269-S3-metadata-003.diff
>
>
> The S3 Native FileSystem currently writes all files with a set of default headers:
>  * Content-Type: binary/octet-stream
>  * Content-Length: <computed from object size>
>  * Content-MD5: <computed from object data>
> This is a good start, however many applications would benefit from the ability to customize
(for example) the Content-Type and Expires headers for the file. Ideally the implementation
should be abstract enough to customize all of the available S3 headers and provide a facility
for other FileSystems to specify optional file metadata.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message