Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Sat, 26 Apr 2014 14:35:15 +0000 (UTC)
From: "Ted Yu (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: <JIRA.12710695.1398473260616.186537.1398522915365@arcas>
In-Reply-To: <JIRA.12710695.1398473260616@arcas>
References: <JIRA.12710695.1398473260616@arcas>
Subject: [jira] [Updated] (HBASE-11083) ExportSnapshot should provide
 capability to limit bandwidth consumption
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HBASE-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ted Yu updated HBASE-11083:
---------------------------

    Attachment: 11083-v2.txt

Patch v2 adds optimization where ThrottledInputStream is only created when bandwidth parameter is non-default value.

> ExportSnapshot should provide capability to limit bandwidth consumption
> -----------------------------------------------------------------------
>
>                 Key: HBASE-11083
>                 URL: https://issues.apache.org/jira/browse/HBASE-11083
>             Project: HBase
>          Issue Type: Improvement
>          Components: snapshots
>            Reporter: Ted Yu
>            Assignee: Ted Yu
>         Attachments: 11083-v1.txt, 11083-v2.txt
>
>
> This capability was first brought up in this thread:
> http://search-hadoop.com/m/DHED4Td8Xb1
> The rewritten distcp already provides this capability.
> See MAPREDUCE-2765
> distcp implementation utilizes ThrottledInputStream which provides bandwidth throttling on a specified InputStream.
> As a first step, we can
> * add an option to ExportSnapshot which expresses bandwidth per map in MB
> * utilize ThrottledInputStream in ExportSnapshot#ExportMapper#copyFile().


--
This message was sent by Atlassian JIRA
(v6.2#6252)