Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AF55A91F2 for ; Wed, 28 Mar 2012 17:43:20 +0000 (UTC) Received: (qmail 80774 invoked by uid 500); 28 Mar 2012 17:43:17 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 80716 invoked by uid 500); 28 Mar 2012 17:43:17 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 80706 invoked by uid 99); 28 Mar 2012 17:43:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Mar 2012 17:43:17 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of nkeywal@gmail.com designates 209.85.212.170 as permitted sender) Received: from [209.85.212.170] (HELO mail-wi0-f170.google.com) (209.85.212.170) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Mar 2012 17:43:12 +0000 Received: by wibhr17 with SMTP id hr17so6189386wib.5 for ; Wed, 28 Mar 2012 10:42:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=2MSPjyB0O/m1X0KbNaUspPEUuAeihITQReC9KM3LOsY=; b=HRwYIffVJi6gH5It1OSUimZg7q81oAycfYsLrL08afMLUe/zVp7uGxa1TEjFWl/c8p 9YlzzPdwT7nk6zQ5bouKMWpElvhywu8ygHLh2csMPblQNk3gdaV9Cml9zWfdeqcA3PZk gSbwZfob+9ZhXbd/RHnWtpnuR3DxkGY8uCyO6y+Ktq0+6nYBSMBtUJc4YO0D2gOUK8ye L3JGKYwHKPnM9vnck8k1JJvxZJMu6s5qaX9ddSMXwuWaX2t7Hbs6lYrSkwPMyul3n/rm aqpqltUVLi1QJe5d3/qUmC39EMTc9BSXCbC+IC3d9q4UajwokhJLUTGy7xetj6awyU7B J2kQ== MIME-Version: 1.0 Received: by 10.180.97.41 with SMTP id dx9mr187421wib.9.1332956570389; Wed, 28 Mar 2012 10:42:50 -0700 (PDT) Received: by 10.216.50.145 with HTTP; Wed, 28 Mar 2012 10:42:49 -0700 (PDT) In-Reply-To: <4F4E4F11-EBCE-4F3B-9576-14920F12992F@tubemogul.com> References: <4F4E4F11-EBCE-4F3B-9576-14920F12992F@tubemogul.com> Date: Wed, 28 Mar 2012 19:42:49 +0200 Message-ID: Subject: Re: Hbase RegionServer stalls on initialization From: N Keywal To: common-user@hadoop.apache.org Content-Type: multipart/related; boundary=f46d04430674e10e0504bc512289 X-Virus-Checked: Checked by ClamAV on apache.org --f46d04430674e10e0504bc512289 Content-Type: multipart/alternative; boundary=f46d04430674e10e0304bc512288 --f46d04430674e10e0304bc512288 Content-Type: text/plain; charset=ISO-8859-1 It must be waiting for the master. Have you launched the master? On Wed, Mar 28, 2012 at 7:40 PM, Nabib El-Rahman < nabib.elrahman@tubemogul.com> wrote: > Hi Guys, > > I'm starting up an region server and it stalls on initialization. I took > a thread dump and found it hanging on this spot: > > "regionserver60020" prio=10 tid=0x00007fa90c5c4000 nid=0x4b50 in Object.wait() [0x00007fa9101b4000] > java.lang.Thread.State: TIMED_WAITING (on object monitor) > at java.lang.Object.wait(Native Method) > - waiting on <0x00000000bc63b2b8> (a org.apache.hadoop.hbase.MasterAddressTracker) > at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:122) > - locked <0x00000000bc63b2b8> (a org.apache.hadoop.hbase.MasterAddressTracker) > at org.apache.hadoop.hbase.regionserver.HRegionServer.blockAndCheckIfStopped(HRegionServer.java:516) > at org.apache.hadoop.hbase.regionserver.HRegionServer.initializeZooKeeper(HRegionServer.java:493) > at org.apache.hadoop.hbase.regionserver.HRegionServer.initialize(HRegionServer.java:461) > at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:560) > at java.lang.Thread.run(Thread.java:662) > > > > Any Idea on who or what its being blocked on? > > *Nabib El-Rahman *| Senior Sofware Engineer > > *M:* 734.846.2529 > www.tubemogul.com | *twitter: @nabiber* > > > > > --f46d04430674e10e0304bc512288 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable It must be waiting for the master. Have you launched the master?

On Wed, Mar 28, 2012 at 7:40 PM, Nabib El-Rahman <nabib.e= lrahman@tubemogul.com> wrote:
Hi Guys,

I'm startin= g up an region server and it stalls on initialization. =A0I took a thread d= ump and found it hanging on this spot:

"regionserver60020" prio=3D10 tid=3D0x00007fa9=
0c5c4000 nid=3D0x4b50 in Object.wait() [0x00007fa9101b4000]


=A0=A0=A0java.lang.Thread.State: TIMED_WAITING (on objec=
t monitor)


=A0=A0=A0=A0=A0=A0=A0=A0at java.lang.Object.wait(Native =
Method)

=A0=A0=A0=A0=A0=A0=A0=A0- waiting on <0x00000000bc63b2b8> (a org.apac=
he.hadoop.hbase.MasterAddressTracker)

=A0=A0=A0=A0=A0=A0=A0=A0at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeT=
racker.blockUntilAvailable(ZooKeeperNodeTracker.java:122)

=A0=A0=A0=A0=A0=A0=A0=A0- locked <0x00000000bc63b2b8> (a org.apache.h=
adoop.hbase.MasterAddressTracker)

=A0=A0=A0=A0=A0=A0=A0=A0at org.apache.hadoop.hbase.regionserver.HRegionServ=
er.blockAndCheckIfStopped(HRegionServer.java:516)

=A0=A0=A0=A0=A0=A0=A0=A0at org.apache.hadoop.hbase.regionserver.HRegionServ=
er.initializeZooKeeper(HRegionServer.java:493)

=A0=A0=A0=A0=A0=A0=A0=A0at org.apache.hadoop.hbase.regionserver.HRegionServ=
er.initialize(HRegionServer.java:461)

=A0=A0=A0=A0=A0=A0=A0=A0at org.apache.hadoop.hbase.regionserver.HRegionServ=
er.run(HRegionServer.java:560)

=A0=A0=A0=A0=A0=A0=A0=A0at java.lang.Thread.run(Thread.java:662)


Any Idea on who or what its being= blocked on?

Nabib El-Rahman=A0|= =A0=A0Senior Sofware=A0Engineer

M:=A0<= /span>734.846.2529=
www.tubemogul.com=A0|=A0twitter:=A0@nabiber

=

=

--f46d04430674e10e0304bc512288-- --f46d04430674e10e0504bc512289--