Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: error (nike.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.co.in;
  h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding;
  b=fLxkkKZoRSi4u8lFBRF96z4IeScCwDvWpiMotocgsqO1Khe5IwyDrZzpHpY3bA9VCHe1EMdqL/pcDuuh1kzIJLvZsaqAwcedE8PEoFctZLKY6ybQuSEOPFgpn7gqhjAa7egMjedj/ipQwEHVJhcB4dmenPflojke2ynaxdg1qhQ=;
References: <1375800527.80621.YahooMailNeo@web190105.mail.sg3.yahoo.com>
	<CALte62xBmWpvtAc3MVtorr6h7Ngj8dr0UpN5NjNCL+iU7xLgxw@mail.gmail.com>
	<1375802331.75017.YahooMailNeo@web190101.mail.sg3.yahoo.com>
 <CALte62wTvuYNJrxgySNAhJn615YMS7+QCanbk6wG3Ab6iNCPzg@mail.gmail.com>
Message-ID: <1375803464.79956.YahooMailNeo@web190106.mail.sg3.yahoo.com>
Date: Tue, 6 Aug 2013 23:37:44 +0800 (SGT)
From: Dhaval Shah <prince_mithibai@yahoo.co.in>
Reply-To: Dhaval Shah <prince_mithibai@yahoo.co.in>
Subject: Re: NoRouteToHostException when zookeeper crashes
To: "user@hbase.apache.org" <user@hbase.apache.org>
In-Reply-To: 
 <CALte62wTvuYNJrxgySNAhJn615YMS7+QCanbk6wG3Ab6iNCPzg@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

I have 4/5 left in the quorum. So this is not a majority issue.=0A=0AAlso a=
lready running services keep running fine for many hours (so this is not an=
 issue with the new leader either). It seems like the HBase client code, wh=
en trying to lookup the zookeeper quorum to connect to, is not able to hand=
le the NoRouteToHostException and errors out there itself (does not try ret=
rying other zookeeper servers because of the unhandled exception).=0A=A0=0A=
Regards,=0ADhaval=0A=0A=0A----- Original Message -----=0AFrom: Ted Yu <yuzh=
ihong@gmail.com>=0ATo: user@hbase.apache.org; Dhaval Shah <prince_mithibai@=
yahoo.co.in>=0ACc: =0ASent: Tuesday, 6 August 2013 11:32 AM=0ASubject: Re: =
NoRouteToHostException when zookeeper crashes=0A=0Abq. one of my zookeeper =
server goes down=0A=0AHow many servers were left in the quorum ? Was the ne=
w leader elected=0Aproperly afterwards ?=0A=0AThanks=0A=0AOn Tue, Aug 6, 20=
13 at 8:18 AM, Dhaval Shah <prince_mithibai@yahoo.co.in>wrote:=0A=0A> HBase=
 - 0.92.1=0A> Zookeeper - 3.4.3=0A>=0A> Regards,=0A> Dhaval=0A>=0A>=0A> ---=
-- Original Message -----=0A> From: Ted Yu <yuzhihong@gmail.com>=0A> To: us=
er@hbase.apache.org; Dhaval Shah <prince_mithibai@yahoo.co.in>=0A> Cc:=0A> =
Sent: Tuesday, 6 August 2013 11:08 AM=0A> Subject: Re: NoRouteToHostExcepti=
on when zookeeper crashes=0A>=0A> What HBase / zookeeper versions are you u=
sing ?=0A>=0A> On Tue, Aug 6, 2013 at 7:48 AM, Dhaval Shah <prince_mithibai=
@yahoo.co.in=0A> >wrote:=0A>=0A> > I have a weird (and a pretty serious) is=
sue on my HBase cluster. Whenever=0A> > one of my zookeeper server goes dow=
n, already running services work fine=0A> > for a few hours but when I try =
to restart any service (be it region=0A> servers=0A> > or clients), they fa=
il with a NoRouteToHostException while trying to=0A> > connect to zookeeper=
 and I cannot restart any service successfully at=0A> all.=0A> > I do reali=
ze that No Route to host is coming from my network=0A> infrastructure=0A> >=
 (ping gives the same error) but why would 1 zookeeper server going down=0A=
> > bring down the entire HBase cluster. Why doesn't HBase ride over the=0A=
> > exception and try some other zookeeper server?=0A> >=0A> > Is this an i=
ssue other people face or its just me? We are running these=0A> on=0A> > DH=
CP (but the IPs don't change because we have long leases). Do you guys=0A> =
> think its a DHCP specific issue? Do you have pointers to avoid this issue=
=0A> > with DHCP or do I have to move to static IPs?=0A> >=0A> > Regards,=
=0A> > Dhaval=0A> >=0A>=0A>=0A