hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2115) Transparent compression in HDFS
Date Thu, 10 Nov 2011 17:08:53 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147825#comment-13147825

Suresh Srinivas commented on HDFS-2115:

Todd, given how this functionality shapes up, it could make lot of changes to HDFS. Please
post a design document, when the mechanism is in reasonable shape.
> Transparent compression in HDFS
> -------------------------------
>                 Key: HDFS-2115
>                 URL: https://issues.apache.org/jira/browse/HDFS-2115
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: data-node, hdfs client
>            Reporter: Todd Lipcon
> In practice, we find that a lot of users store text data in HDFS without using any compression
codec. Improving usability of compressible formats like Avro/RCFile helps with this, but we
could also help many users by providing an option to transparently compress data as it is

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message