hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vladimir Rodionov <vladrodio...@gmail.com>
Subject Re: Scan priority based on type of request origin
Date Thu, 28 May 2015 06:47:37 GMT
Scanner prioritization is not sufficient, there are a lot of other IO
activity (compaction, flushing, logging), which can severely affect
high priority scanners.

HBase IO scheduler anyone?

On Wed, May 27, 2015 at 11:26 PM, ashish singhi <ashish.singhi@huawei.com>
wrote:

> Hello folks.
>
> We had a customer scenario to support scan priority based on type of
> request origin. Consider the scenario , where in n number of scan requests
> are generated from different clients. Some of these requests are high
> priority as they are originated from high privileged users OR from data
> viewer Web UI etc. Such request should not wait and must finish execution
> at the earliest compare to other requests.
>
> We went through the code and found that HBase support for de-prioritizing
> long running scanner(HBASE-10993) and providing super user rpc requests
> higher priority comparing to other users(HBASE-13375). So this means apart
> from super user all other user request will be treated as same and with
> normal QOS.
>
> Let us know if there are any existing solutions already available which
> may be we are missing.
>
> If implementing this make sense , we can implement this in community.
>
> Regards,
> Ashish Singhi
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message