hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Options for limiting bandwidth in ExportSnapshot
Date Sat, 26 Apr 2014 16:34:44 GMT
Scott:
Can you tell me which hadoop release you're using ?

Cheers


On Fri, Apr 25, 2014 at 10:36 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> Here is the JIRA: HBASE-11083 ExportSnapshot should provide capability to
> limit bandwidth consumption
>
> I uploaded a patch.
>
> Cheers
>
>
> On Thu, Apr 24, 2014 at 9:22 AM, Matteo Bertozzi <theo.bertozzi@gmail.com>wrote:
>
>> at the moment, you can only control the number of mappers (patches are
>> welcome)
>>
>>
>> Matteo
>>
>>
>>
>> On Thu, Apr 24, 2014 at 9:17 AM, Scott Kuehn <scott.kuehn@opower.com>
>> wrote:
>>
>> > Any recommendations on how to limit the bandwidth consumption of an
>> > ExportSnapshot job?  I'd like to control bandwidth consumption so
>> important
>> > network workloads, like shuffling and balancing, are reserved some
>> > bandwidth while a lower-priority ExportSnapshot job is running.
>> >
>> > Note that distcp jobs provide the ability to limit bandwidth by exposing
>> > the num-mappers and bandwidth options. I'm looking to achieve something
>> > similar with ExportSnapshot.
>> >
>> > ExportSnapshot ref (bottom of page):
>> > http://hbase.apache.org/book/ops.snapshots.html
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message