hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-11083) ExportSnapshot should provide capability to limit bandwidth consumption
Date Sat, 26 Apr 2014 00:48:15 GMT
Ted Yu created HBASE-11083:
------------------------------

             Summary: ExportSnapshot should provide capability to limit bandwidth consumption
                 Key: HBASE-11083
                 URL: https://issues.apache.org/jira/browse/HBASE-11083
             Project: HBase
          Issue Type: Improvement
          Components: snapshots
            Reporter: Ted Yu


This capability was first brought up in this thread:
http://search-hadoop.com/m/DHED4Td8Xb1

The rewritten distcp already provides this capability.
See MAPREDUCE-2765

distcp implementation utilizes ThrottledInputStream which provides bandwidth throttling on
a specified InputStream.

As a first step, we can
* add an option to ExportSnapshot which expresses bandwidth per map in MB
* utilize ThrottledInputStream in ExportSnapshot#ExportMapper#copyFile().



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message