hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom Panning (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-6323) Compress files in transit for fs -get and -put operations
Date Fri, 02 May 2014 02:16:18 GMT
Tom Panning created HDFS-6323:

             Summary: Compress files in transit for fs -get and -put operations
                 Key: HDFS-6323
                 URL: https://issues.apache.org/jira/browse/HDFS-6323
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: hdfs-client
            Reporter: Tom Panning
            Priority: Minor

For the {{hadoop fs -get}} and {{hadoop fs -put}} commands, it would be nice if there was
an option to compress the file(s) in transit. For some people, the Hadoop cluster is far away
(in terms of the network) or must be accessed through a VPN, and many files that are put on
or retrieved from the cluster are very large compared to the available bandwidth.

This message was sent by Atlassian JIRA

View raw message