Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E5F0D188DD for ; Thu, 28 May 2015 06:47:44 +0000 (UTC) Received: (qmail 60603 invoked by uid 500); 28 May 2015 06:47:44 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 60497 invoked by uid 500); 28 May 2015 06:47:44 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 60482 invoked by uid 99); 28 May 2015 06:47:44 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 May 2015 06:47:44 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id B7596C0B79 for ; Thu, 28 May 2015 06:47:43 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.88 X-Spam-Level: ** X-Spam-Status: No, score=2.88 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id Xl-EaVgSL9D7 for ; Thu, 28 May 2015 06:47:37 +0000 (UTC) Received: from mail-qc0-f178.google.com (mail-qc0-f178.google.com [209.85.216.178]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 99AA043DA6 for ; Thu, 28 May 2015 06:47:37 +0000 (UTC) Received: by qchk10 with SMTP id k10so13793590qch.2 for ; Wed, 27 May 2015 23:47:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=bm/odg31gFGqe8kw1IY/ciCY6RqJ03HaW/OYqBYPcVA=; b=Ey4qiIcpU3mkwDjGoTw7AM0VmKKIFqz6p8V+NjNRzprXdCrLAxIurIlK6Yc5STRJOT kY8A1mrh68Q6fR10twVb+cQrIRNwKjV7Kba4pLZnx2WiTLa5dzKXsim3eTIRL9wx/QNx FFhdtL7Y6XRsGm+FGyyEfbdWcQ5SAz++vT5L3pwYw2ZIVfsa6p1jzbWmspydY+hxBmUj EcpFU9j1LP7Dnwfsdj7ukdxXHzOpMTVkvBMawX4Z4H1Y38wOBJtuBT/7axbI+hFg4VK8 aWUnpL+3Hit0uIY7OSVpL8ppXY5bLo5p8g0v+cgzCSD/3G03y421GFto2o/EuKGsvS/O iwUQ== MIME-Version: 1.0 X-Received: by 10.55.33.155 with SMTP id f27mr2313547qki.106.1432795657329; Wed, 27 May 2015 23:47:37 -0700 (PDT) Received: by 10.140.83.199 with HTTP; Wed, 27 May 2015 23:47:37 -0700 (PDT) In-Reply-To: <8E858C3A39F0D046B420FBA6F75448C0666D24ED@szxeml513-mbs.china.huawei.com> References: <8E858C3A39F0D046B420FBA6F75448C0666D24ED@szxeml513-mbs.china.huawei.com> Date: Wed, 27 May 2015 23:47:37 -0700 Message-ID: Subject: Re: Scan priority based on type of request origin From: Vladimir Rodionov To: "dev@hbase.apache.org" Content-Type: multipart/alternative; boundary=001a1144de5630e11205171ebc33 --001a1144de5630e11205171ebc33 Content-Type: text/plain; charset=UTF-8 Scanner prioritization is not sufficient, there are a lot of other IO activity (compaction, flushing, logging), which can severely affect high priority scanners. HBase IO scheduler anyone? On Wed, May 27, 2015 at 11:26 PM, ashish singhi wrote: > Hello folks. > > We had a customer scenario to support scan priority based on type of > request origin. Consider the scenario , where in n number of scan requests > are generated from different clients. Some of these requests are high > priority as they are originated from high privileged users OR from data > viewer Web UI etc. Such request should not wait and must finish execution > at the earliest compare to other requests. > > We went through the code and found that HBase support for de-prioritizing > long running scanner(HBASE-10993) and providing super user rpc requests > higher priority comparing to other users(HBASE-13375). So this means apart > from super user all other user request will be treated as same and with > normal QOS. > > Let us know if there are any existing solutions already available which > may be we are missing. > > If implementing this make sense , we can implement this in community. > > Regards, > Ashish Singhi > --001a1144de5630e11205171ebc33--