hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Scott Kuehn <scott.ku...@opower.com>
Subject Re: Options for limiting bandwidth in ExportSnapshot
Date Sun, 27 Apr 2014 00:21:08 GMT
Ted -- thanks for the patch!  We're using hadoop 2.0.0-cdh4.5.0.


On Sat, Apr 26, 2014 at 9:34 AM, Ted Yu <yuzhihong@gmail.com> wrote:

> Scott:
> Can you tell me which hadoop release you're using ?
>
> Cheers
>
>
> On Fri, Apr 25, 2014 at 10:36 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
>> Here is the JIRA: HBASE-11083 ExportSnapshot should provide capability to
>> limit bandwidth consumption
>>
>> I uploaded a patch.
>>
>> Cheers
>>
>>
>> On Thu, Apr 24, 2014 at 9:22 AM, Matteo Bertozzi <theo.bertozzi@gmail.com
>> > wrote:
>>
>>> at the moment, you can only control the number of mappers (patches are
>>> welcome)
>>>
>>>
>>> Matteo
>>>
>>>
>>>
>>> On Thu, Apr 24, 2014 at 9:17 AM, Scott Kuehn <scott.kuehn@opower.com>
>>> wrote:
>>>
>>> > Any recommendations on how to limit the bandwidth consumption of an
>>> > ExportSnapshot job?  I'd like to control bandwidth consumption so
>>> important
>>> > network workloads, like shuffling and balancing, are reserved some
>>> > bandwidth while a lower-priority ExportSnapshot job is running.
>>> >
>>> > Note that distcp jobs provide the ability to limit bandwidth by
>>> exposing
>>> > the num-mappers and bandwidth options. I'm looking to achieve something
>>> > similar with ExportSnapshot.
>>> >
>>> > ExportSnapshot ref (bottom of page):
>>> > http://hbase.apache.org/book/ops.snapshots.html
>>> >
>>>
>>
>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message