hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11083) ExportSnapshot should provide capability to limit bandwidth consumption
Date Wed, 21 May 2014 05:51:40 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14004385#comment-14004385
] 

Hudson commented on HBASE-11083:
--------------------------------

SUCCESS: Integrated in HBase-TRUNK #5135 (See [https://builds.apache.org/job/HBase-TRUNK/5135/])
HBASE-11090 Backport HBASE-11083 ExportSnapshot should provide capability to limit bandwidth
consumption (tedyu: rev 1595947)
* /hbase/trunk/hbase-common/src/main/java/org/apache/hadoop/hbase/io/hadoopbackport
* /hbase/trunk/hbase-common/src/main/java/org/apache/hadoop/hbase/io/hadoopbackport/ThrottledInputStream.java
* /hbase/trunk/hbase-server/pom.xml
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java


> ExportSnapshot should provide capability to limit bandwidth consumption
> -----------------------------------------------------------------------
>
>                 Key: HBASE-11083
>                 URL: https://issues.apache.org/jira/browse/HBASE-11083
>             Project: HBase
>          Issue Type: Improvement
>          Components: snapshots
>            Reporter: Ted Yu
>            Assignee: Ted Yu
>             Fix For: 0.99.0
>
>         Attachments: 11083-v2.txt
>
>
> This capability was first brought up in this thread:
> http://search-hadoop.com/m/DHED4Td8Xb1
> The rewritten distcp already provides this capability.
> See MAPREDUCE-2765
> distcp implementation utilizes ThrottledInputStream which provides bandwidth throttling
on a specified InputStream.
> As a first step, we can
> * add an option to ExportSnapshot which expresses bandwidth per map in MB
> * utilize ThrottledInputStream in ExportSnapshot#ExportMapper#copyFile().



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message