hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dave Latham <lat...@davelink.net>
Subject Re: How to monitor and control heavy network traffic for region server
Date Wed, 10 Jun 2015 18:00:53 GMT
I'm not aware of anything in version 0.96 that will limit the scan for
you - you may have to do it in your client yourself.  If you're
willing to upgrade, do check out the throttling available in HBase

On Wed, Jun 10, 2015 at 4:15 AM, 娄帅 <louis.hust.ml@gmail.com> wrote:
> any ideas?
> 2015-06-10 16:01 GMT+08:00 娄帅 <louis.hust.ml@gmail.com>:
>> Hi all,
>> We are using HBASE 0.96 with Hadoop 2.2.0, recently we found there are some
>> SCAN operations last for more than 1 hours, which lead to heavy network
>> traffic, because some data is not
>> stored at local data node and the region is very big, about 100G-500G。
>> With heavy network traffic, the region server then can not offer service
>> cause the NIC is full.
>> From DBA view point, I want to know if there is some operation for HBase
>> to limit the large scan or if there is some flow control for SCAN operation
>> and how can we monitor the long SCAN operation。

View raw message