hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11090) Backport HBASE-11083 ExportSnapshot should provide capability to limit bandwidth consumption
Date Sat, 03 May 2014 00:27:19 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988476#comment-13988476
] 

Andrew Purtell commented on HBASE-11090:
----------------------------------------

We don't support Hadoop 1 on 0.98 but still must build against it, and we frob -1 and -2 maven
artifacts like 0.96. 

The patch looks fine Ted, although if moving ThrottledInputStream into our codebase, then
it should go in on trunk as well, right?

> Backport HBASE-11083 ExportSnapshot should provide capability to limit bandwidth consumption
> --------------------------------------------------------------------------------------------
>
>                 Key: HBASE-11090
>                 URL: https://issues.apache.org/jira/browse/HBASE-11090
>             Project: HBase
>          Issue Type: Task
>            Reporter: Ted Yu
>            Assignee: Ted Yu
>             Fix For: 0.98.3
>
>         Attachments: 11090-0.98-v1.txt
>
>
> HBASE-11083 allows ExportSnapshot to limit bandwidth usage.
> Here is *one* approach for backporting:
> Create the following classes (class name is tentative):
> hbase-hadoop1-compat/src/main/java/org/apache/hadoop/hbase/util/ThrottledInputStream.java
> hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/util/ThrottledInputStream.java
> each of which extends the corresponding ThrottledInputStream in hadoop-1 / hadoop-2
> ExportSnapshot would reference util.ThrottledInputStream, depending on which compatibility
module gets bundled.
> ThrottledInputStream.java in hadoop-1 branch was backported through MAPREDUCE-5081 which
went into 1.2.0 release.
> We need to decide how hadoop releases earlier than 1.2.0 should be supported.
> *Second* approach for backporting is to make a copy of ThrottledInputStream and include
it in hbase codebase.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message