Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DD9421755F for ; Mon, 11 May 2015 23:55:49 +0000 (UTC) Received: (qmail 61413 invoked by uid 500); 11 May 2015 23:55:49 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 61323 invoked by uid 500); 11 May 2015 23:55:49 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 61311 invoked by uid 99); 11 May 2015 23:55:49 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 May 2015 23:55:49 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 9AF53182223 for ; Mon, 11 May 2015 23:55:48 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.879 X-Spam-Level: ** X-Spam-Status: No, score=2.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id gnE3NqZYELmQ for ; Mon, 11 May 2015 23:55:46 +0000 (UTC) Received: from mail-ob0-f181.google.com (mail-ob0-f181.google.com [209.85.214.181]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 20DDF43E45 for ; Mon, 11 May 2015 23:55:46 +0000 (UTC) Received: by obcus9 with SMTP id us9so82806100obc.2 for ; Mon, 11 May 2015 16:55:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :content-type; bh=W77GutL0W3GyjrIttclRqWFBMmCYAknk19x5T14TC8o=; b=xKBPBszmf0jVzVhvsPlNHW7bL5vqAPxZXIs3lG1NBt2So1iGTCh2VJB1++31UNyB1H wHsbmuSn0GriQLED/vi8qvWhAu0aItaY5GBua/W9SZah5nkO/ZNBCswnOZ1dDyuETp10 AbcG02c277tjXTtqUpp+fB7ZgU8B8kiZwAgptuFSjymfTcTGfWtX06OKUdo/1OA3OkWj ropm0lWaF/WHOByDWTon435sQ85J032ZwqaDWohjEFfIOwNaTaeUHUv757YF7wvgj1V2 qs8NMUgXjUSGC7oCNLb/DaDaVe1iX05NvH9vooy2uLaUqClkH4bub+uKGW1ZpxWwFE6g IdCQ== X-Received: by 10.60.148.225 with SMTP id tv1mr9761372oeb.14.1431388500399; Mon, 11 May 2015 16:55:00 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Jesse Yates Date: Mon, 11 May 2015 23:54:59 +0000 Message-ID: Subject: Re: ThrottlingException should be handled by client? (was Re: [VOTE] First release candidate for HBase 1.1.0 (RC0) is available.) To: "dev@hbase.apache.org" Content-Type: multipart/alternative; boundary=047d7b3a7f7e1a1b7c0515d71b21 --047d7b3a7f7e1a1b7c0515d71b21 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable It seems like it should be handled by the user - it implies that the space for which the user has been allocated has been maxed out. There doesn't seem to be anything HBase (server or client) can do at this point to manage the failure, unless we also add support for 'out of space management'. On Mon, May 11, 2015 at 4:49 PM Matteo Bertozzi wrote: > handled by the client in what way? what is your suggestion? thread.sleep(= )? > the choice to raise the exception up to the client was to have them deal > with it in a app-specific way. > > > Matteo > > > On Mon, May 11, 2015 at 4:43 PM, Nick Dimiduk wrote= : > > > On Mon, May 11, 2015 at 12:16 PM, Enis S=C3=B6ztutar = wrote: > > > > > > > > > > - a resolution to the RegionScanner interface change, if deemed > > > necessary > > > > > > > > > > Sorry, I confused RegionScanner with ResultScanner. RegionScanner is > not > > a > > > Public class, only for co-processors. I think we do not need a fix > here. > > > > > > On a totally unrelated note, I was going over the ThrottlingException > for > > > HBASE-13661, and noticed that it extends DoNotRetryIOException. Looki= ng > > at > > > the unit tests as well, it means that if the throttle is exceeded, it > > > bubbles up to the client level as a RetriedExhaustedException, and th= e > > > application side has to do explicit handling because of this. I was > > > intuitively expecting the hbase-client level to handle the throttling > > > instead of raising this as an application-level exception. Is this th= e > > > expected behavior? The exception contains enough details on the > > throttling > > > that it seems it can do the wait, but seems strange to delegate that = to > > the > > > application instead of handling it at the retry layer. Did we chose > this > > > because of fast fail semantics? Sorry I missed the reviews. > > > > > > This semantics is important for the RC I think, since it is the first > > time > > > we are introducing it. Just wanted to confirm that it is an explicit > > > decision. > > > > > > > I'd like to raise the visibility of this question as its answer may > impact > > the timeliness of the next RC. From the ThrottlingException class > comment, > > I see > > > > * TODO: At some point this will be handled on the client side to preve= nt > > * operation to go on the server if the waitInterval is grater than the > one > > got > > * as result of this exception. > > > > Please advise. > > > > Thanks, > > Nick > > > > > - corrected docs and site build > > > > > > > > Since this RC has already been open for 12 days and that RC would > > contain > > > > an extremely limited set of changes above RC0, I would like to run = it > > > > through an abbreviated voting window -- say 48 hours. > > > > > > > > On Wed, Apr 29, 2015 at 10:35 PM, Nick Dimiduk > > > > wrote: > > > > > > > > > I'm happy to announce the first release candidate of HBase 1.1.0 > > > > > (HBase-1.1.0RC0) is available for download at > > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.1RC2/ > > > > > > > > > > Maven artifacts are also available in the staging repository > > > > > > > https://repository.apache.org/content/repositories/orgapachehbase-1076 > > > > > > > > > > Artifacts are signed with my code signing subkey > 0xAD9039071C3489BD, > > > > > available in the Apache keys directory > > > > > https://people.apache.org/keys/committer/ndimiduk.asc and in > > > > > http://people.apache.org/~ndimiduk/KEY > > > > > > > > > > There's also a signed tag for this release at > > > > > > > > > > > > > > > https://git-wip-us.apache.org/repos/asf?p=3Dhbase.git;a=3Dtag;h=3D2c102db= e56116ca342abd08e906d70d900048a55 > > > > > > > > > > HBase 1.1.0 is the first minor release in the HBase 1.x line, > > > continuing > > > > > on the theme of bringing a stable, reliable database to the Hadoo= p > > and > > > > > NoSQL communities. This release includes nearly 200 resolved issu= es > > > above > > > > > the 1.0.x series to date. Notable features include: > > > > > > > > > > - Async RPC client (HBASE-12684) > > > > > - Simple RPC throttling (HBASE-11598) > > > > > - Improved compaction controls (HBASE-8329, HBASE-12859) > > > > > - New extension interfaces for coprocessor users, better > supporting > > > > > projects like Phoenix (HBASE-12972, HBASE-12975) > > > > > - Per-column family flush (HBASE-10201) > > > > > - WAL on SSD (HBASE-12848) > > > > > - BlockCache in Memcached (HBASE-13170) > > > > > - Tons of region replica enhancements around META, WAL, and bulk > > > loading > > > > > (HBASE-11574, HBASE-11568, HBASE-11571, HBASE-11567) > > > > > > > > > > The full list of issues can be found at > > > > > > > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=3D123107= 53&version=3D12329043 > > > > > > > > > > Please try out this candidate and vote +/-1 by midnight Pacific > time > > on > > > > > 2015-05-06 as to whether we should release these bits as HBase > 1.1.0. > > > > > > > > > > Thanks, > > > > > Nick > > > > > > > > > > > > > > > --047d7b3a7f7e1a1b7c0515d71b21--