hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-11090) Backport HBASE-11083 ExportSnapshot should provide capability to limit bandwidth consumption
Date Mon, 28 Apr 2014 16:12:17 GMT

     [ https://issues.apache.org/jira/browse/HBASE-11090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ted Yu updated HBASE-11090:
---------------------------

    Description: 
HBASE-11083 allows ExportSnapshot to limit bandwidth usage.
Here is *one* approach for backporting:

Create the following classes (class name is tentative):
hbase-hadoop1-compat/src/main/java/org/apache/hadoop/hbase/util/ThrottledInputStream.java
hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/util/ThrottledInputStream.java

each of which extends the corresponding ThrottledInputStream in hadoop-1 / hadoop-2

ExportSnapshot would reference util.ThrottledInputStream, depending on which compatibility
module gets bundled.

ThrottledInputStream.java in hadoop-1 branch was backported through MAPREDUCE-5081 which went
into 1.2.0 release.
We need to decide how hadoop releases earlier than 1.2.0 should be supported.

*Second* approach for backporting is to make a copy of ThrottledInputStream and include it
in hbase codebase.

  was:
HBASE-11083 allows ExportSnapshot to limit bandwidth usage.
Here is one approach for backporting:

Create the following classes (class name is tentative):
hbase-hadoop1-compat/src/main/java/org/apache/hadoop/hbase/util/ThrottledInputStream.java
hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/util/ThrottledInputStream.java

each of which extends the corresponding ThrottledInputStream in hadoop-1 / hadoop-2

ExportSnapshot would reference util.ThrottledInputStream, depending on which compatibility
module gets bundled.

ThrottledInputStream.java in hadoop-1 branch was backported through MAPREDUCE-5081 which went
into 1.2.0 release.
We need to decide how hadoop releases earlier than 1.2.0 should be supported.

Second approach for backporting is to make a copy of ThrottledInputStream and include it in
hbase codebase.


> Backport HBASE-11083 ExportSnapshot should provide capability to limit bandwidth consumption
> --------------------------------------------------------------------------------------------
>
>                 Key: HBASE-11090
>                 URL: https://issues.apache.org/jira/browse/HBASE-11090
>             Project: HBase
>          Issue Type: Task
>            Reporter: Ted Yu
>
> HBASE-11083 allows ExportSnapshot to limit bandwidth usage.
> Here is *one* approach for backporting:
> Create the following classes (class name is tentative):
> hbase-hadoop1-compat/src/main/java/org/apache/hadoop/hbase/util/ThrottledInputStream.java
> hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/util/ThrottledInputStream.java
> each of which extends the corresponding ThrottledInputStream in hadoop-1 / hadoop-2
> ExportSnapshot would reference util.ThrottledInputStream, depending on which compatibility
module gets bundled.
> ThrottledInputStream.java in hadoop-1 branch was backported through MAPREDUCE-5081 which
went into 1.2.0 release.
> We need to decide how hadoop releases earlier than 1.2.0 should be supported.
> *Second* approach for backporting is to make a copy of ThrottledInputStream and include
it in hbase codebase.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message