Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EB8EC1828F for ; Thu, 14 May 2015 01:06:02 +0000 (UTC) Received: (qmail 89798 invoked by uid 500); 14 May 2015 01:06:01 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 89735 invoked by uid 500); 14 May 2015 01:06:01 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 89589 invoked by uid 99); 14 May 2015 01:06:00 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 May 2015 01:06:00 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 517EC1A2B59 for ; Thu, 14 May 2015 01:06:00 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.901 X-Spam-Level: ** X-Spam-Status: No, score=2.901 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id nPbij4wHcDAW for ; Thu, 14 May 2015 01:05:47 +0000 (UTC) Received: from mail-wi0-f180.google.com (mail-wi0-f180.google.com [209.85.212.180]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id D02842808B for ; Thu, 14 May 2015 01:04:44 +0000 (UTC) Received: by wizk4 with SMTP id k4so220949806wiz.1 for ; Wed, 13 May 2015 18:04:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=XLxVdJ+Xc6X+COB29nASZuNJ+Emwws22foi45/PaE6U=; b=JyuaFMa73S3c9ILKSX7XAroZ3y0Yg7GV0vsxuzbDlv+OW3A7lQUpOts97NpZiB78Tk tCQzJjpxIdp8/P5bT4EIf4DjHq/K+WJzogSGM9vVwhGa1etp3kLtp4Sw8cHnldJZZ5Bv HWJDf21xnriFhgBPQnp/vMAikUvp70q8hwyM5Ojd8GIqnatRloVUDcAZZ2YY8UMRLfuD 3Qs+YJw1ODafhkzLtCOZNq4C5L5Yb7diECW1lOF6MYLMmioyUidf2WdcAG0/zjFCCwfO JZ7jK/RF1Xj53Cq129fTLHcgrQwYtv7TGMMgyTLeKozKx9rjzSBhxQ/e5wyvOU/ut4UW MBnQ== X-Received: by 10.180.75.197 with SMTP id e5mr18446273wiw.94.1431565484588; Wed, 13 May 2015 18:04:44 -0700 (PDT) MIME-Version: 1.0 Received: by 10.28.227.196 with HTTP; Wed, 13 May 2015 18:04:24 -0700 (PDT) In-Reply-To: References: <21843.61664.956285.397408@bfym.cloudera.com> From: Nick Dimiduk Date: Wed, 13 May 2015 18:04:24 -0700 Message-ID: Subject: Re: New post on hbase-1.1.0 throttling feature up on our Apache blog To: hbase-user Content-Type: multipart/alternative; boundary=f46d043be0ee2e85f605160050b3 --f46d043be0ee2e85f605160050b3 Content-Type: text/plain; charset=UTF-8 Sorry. Yeah, sure, I can ask over there. The throttle was set by user in these tests. You cannot directly > throttle a specific job, but do have the option to set the throttle > for a table or a namespace. That might be sufficient for you to > achieve your objective (unless those jobs are run by one user and > access the same table.) Maybe running as different users is the key, but this seems like a very important use-case to support -- folks doing aggregate analysis concurrently on an online table. On Wed, May 13, 2015 at 5:53 PM, Stack wrote: > Should we add in your comments on the blog Govind: i.e. the answers to > Nicks' questions? > St.Ack > > On Wed, May 13, 2015 at 5:48 PM, Govind Kamat wrote: > > > > This is a great demonstration of these new features, thanks for > > pointing it > > > out Stack. > > > > > > I'm curious: what percentile latencies are this reported? Does the > > > non-throttled user see significant latency improvements in the 95, > 99pct > > > when the competing, scanning users are throttled? MB/s and req/s are > > > managed at the region level? Region server level? Aggregate? > > > > The latencies reported in the post are average latencies. > > > > Yes, the non-throttled user sees an across-the-board improvement in > > the 95th and 99th percentiles, in addition to the improvement in > > average latency. The extent of improvement is significant as well but > > varies with the throttle pressure, just as in the case of the average > > latencies. > > > > The total throughput numbers (req/s) are aggregate numbers reported by > > the YCSB client. > > > > > These throttle points are by user? Is there a way for us to say "all > MR > > > jobs are lower priority than online queries"? > > > > > > > The throttle was set by user in these tests. You cannot directly > > throttle a specific job, but do have the option to set the throttle > > for a table or a namespace. That might be sufficient for you to > > achieve your objective (unless those jobs are run by one user and > > access the same table.) > > > > Govind > > > > > > > Thanks, > > > Nick > > > > > > On Tue, May 12, 2015 at 1:58 PM, Stack wrote: > > > > > > > .. by our Govind. > > > > > > > > See here: > > > > > > > https://blogs.apache.org/hbase/entry/the_hbase_request_throttling_feature > > > > > > > > St.Ack > > > > > > > --f46d043be0ee2e85f605160050b3--