hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matteo Bertozzi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11083) ExportSnapshot should provide capability to limit bandwidth consumption
Date Sat, 26 Apr 2014 04:43:15 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981883#comment-13981883
] 

Matteo Bertozzi commented on HBASE-11083:
-----------------------------------------

assuming that the distcp/hadoop2 dependency is ok for the project
the patch looks good to me

> ExportSnapshot should provide capability to limit bandwidth consumption
> -----------------------------------------------------------------------
>
>                 Key: HBASE-11083
>                 URL: https://issues.apache.org/jira/browse/HBASE-11083
>             Project: HBase
>          Issue Type: Improvement
>          Components: snapshots
>            Reporter: Ted Yu
>            Assignee: Ted Yu
>         Attachments: 11083-v1.txt
>
>
> This capability was first brought up in this thread:
> http://search-hadoop.com/m/DHED4Td8Xb1
> The rewritten distcp already provides this capability.
> See MAPREDUCE-2765
> distcp implementation utilizes ThrottledInputStream which provides bandwidth throttling
on a specified InputStream.
> As a first step, we can
> * add an option to ExportSnapshot which expresses bandwidth per map in MB
> * utilize ThrottledInputStream in ExportSnapshot#ExportMapper#copyFile().



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message