Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F12D110E87 for ; Fri, 14 Feb 2014 09:20:05 +0000 (UTC) Received: (qmail 71366 invoked by uid 500); 14 Feb 2014 09:20:02 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 71144 invoked by uid 500); 14 Feb 2014 09:20:01 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 71136 invoked by uid 99); 14 Feb 2014 09:20:01 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Feb 2014 09:20:01 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=FREEMAIL_REPLY,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of stoffe@gmail.com designates 209.85.220.47 as permitted sender) Received: from [209.85.220.47] (HELO mail-pa0-f47.google.com) (209.85.220.47) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Feb 2014 09:19:54 +0000 Received: by mail-pa0-f47.google.com with SMTP id kp14so12053047pab.20 for ; Fri, 14 Feb 2014 01:19:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=CY4UCDnk3Ta/5pF7ZJvwxG+/fyx+PywLut192+LGzrI=; b=yiPBTb72YfYabcozS8RzPq+Ydd4sAKCG3jKclQ0WDPwRzOLG7d3j2om8QKJ1J24Cbs CRj+6PXgxGw91ZuMOJNzP/W29gv/3q8qY+YctFSGIts3wf3XxLDPS6LR7hi1WjvkKI70 FCoLwWDzNO1DwPayISKfhbAZ3soK370agDczt2q3hqtExj3RXizepDAgXszKdjvtTRxy yZAuAxxM4ScA5G53ddDy8xGu8l4DsdwOWxNth/C8e98XoRgwasaeLCnFcskymeaxrfha 1YfP7N3kVavWQmJFeRF5NhYNspbFILm6hBdhyKBh3KiDfx4stiZ//eswzJMEUL9o7M1X fUvA== MIME-Version: 1.0 X-Received: by 10.68.163.197 with SMTP id yk5mr7732964pbb.57.1392369573563; Fri, 14 Feb 2014 01:19:33 -0800 (PST) Received: by 10.66.254.7 with HTTP; Fri, 14 Feb 2014 01:19:33 -0800 (PST) In-Reply-To: <1392330026.9121.YahooMailNeo@web140604.mail.bf1.yahoo.com> References: <1392330026.9121.YahooMailNeo@web140604.mail.bf1.yahoo.com> Date: Fri, 14 Feb 2014 10:19:33 +0100 Message-ID: Subject: Re: Standard vs Asynchbase client reconnect after HBase restart From: =?ISO-8859-1?Q?Kristoffer_Sj=F6gren?= To: user@hbase.apache.org, lars hofhansl Content-Type: multipart/alternative; boundary=047d7ba970d2d4162a04f25a4d0d X-Virus-Checked: Checked by ClamAV on apache.org --047d7ba970d2d4162a04f25a4d0d Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable No worries. Let me do some more tests and analyse the communication between zookeeper and HBase to make sure its not a localhost/port screwup from my side. Ill get back to you. On Thu, Feb 13, 2014 at 11:20 PM, lars hofhansl wrote: > Haven't found time, yet. :( > > > Are you bouncing just HBase or Zookeeper as well? I found the ZK client t= o > be frequently the main source delay for "reconnecting". > (note also that if run HBase in local mode it will manage ZK for you as > well, and the ZK port might change upon restart, which the client does no= t > handle well) > > > -- Lars > > > > ________________________________ > From: Kristoffer Sj=F6gren > To: user@hbase.apache.org > Sent: Wednesday, February 12, 2014 11:54 PM > Subject: Re: Standard vs Asynchbase client reconnect after HBase restart > > > @Ted We are using HBase 0.94.6 from CDH 4 to be exact. > > @Lars Thanks a lot! > > @Mike Just to be clear - the test is using HConnection [1] > and HBaseClient [2] which is what I refer to as the 'client'. With > 'recovered' I mean that the client has gone from 'unresponsive' to being > able query and insert data into HBase. > > 1. > > http://hbase.apache.org/0.94/apidocs/org/apache/hadoop/hbase/client/HConn= ection.html > 2. > http://tsunanet.net/~tsuna/asynchbase/api/org/hbase/async/HBaseClient.htm= l > > > > On Thu, Feb 13, 2014 at 1:11 AM, Michael Segel >wrote: > > > Silly question... > > What makes you think that what you are seeing isn't already as fast as > > possible? > > > > You are looking at an async client versus a synchronous client, right? > > > > Also... what do you mean when you say 'client recovers' ... > > How are you measuring that the client has recovered? > > > > Thx > > > > -Mike > > > > > > On Feb 12, 2014, at 2:41 AM, Kristoffer Sj=F6gren > wrote: > > > > > Hi > > > > > > I have some tests that check client behaviour during a controlled HBa= se > > > restart. Everything works as expected and the client is able to recov= er > > > after a while. > > > > > > However, after doing the same tests with the Asynchbase I noticed tha= t > > this > > > client recovers almost instantly after HBase comes back up - whereas > the > > > standard HConnection recovers much later (around 30 seconds). > > > > > > I played around with two properties without much time to recovery > > reduction. > > > > > > fail.fast.expired.active.master=3Dtrue > > > zookeeper.session.timeout=3D5000 > > > > > > Any tips on how to improve time to recovery? > > > > > > Cheers, > > > -Kristoffer > > > > The opinions expressed here are mine, while they may reflect a cognitiv= e > > thought, that is purely accidental. > > Use at your own risk. > > Michael Segel > > michael_segel (AT) hotmail.com > > > > > > > > > > > > > --047d7ba970d2d4162a04f25a4d0d--