Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-RocketYMMF:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding;
  b=TT47KOsnCd0vffw3qkkb3itcuqarQL6/3eOxfBvI6IdkRC+BsuEAsx/lmQh1Nl2zDkT6vmi5jH8YpVBYxsx3HtYoX+f5fvo/uK88sSvuwq8XjtB6L1pcv76oAfxFFuuCLs8XE/PY+xapbEgXXmkNq+AAW1EvZgMLWuKDiVtKxKc=;
References: 
 <52E301F960B30049ADEFBCCF1CCAEF5913A73FE6@OAEXCH4SERVER.oa.oclc.org>
Message-ID: <1366757851.45101.YahooMailNeo@web140603.mail.bf1.yahoo.com>
Date: Tue, 23 Apr 2013 15:57:31 -0700 (PDT)
From: lars hofhansl <larsh@apache.org>
Reply-To: lars hofhansl <larsh@apache.org>
Subject: Re: HBase Region Server Spinning on JMX requests
To: "user@hbase.apache.org" <user@hbase.apache.org>
In-Reply-To: 
 <52E301F960B30049ADEFBCCF1CCAEF5913A73FE6@OAEXCH4SERVER.oa.oclc.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

Hmm... That's not good. Would you mind filing a ticket here: https://issues=
.apache.org/jira/browse/HBASE ?=0A=0A-- Lars=0A=0A=0A______________________=
__________=0A From: "Buckley,Ron" <buckleyr@oclc.org>=0ATo: user@hbase.apac=
he.org =0ASent: Tuesday, April 23, 2013 6:57 AM=0ASubject: HBase Region Ser=
ver Spinning on JMX requests=0A =0A=0AThis is with HBase 0.94.4 & CDH 4.1.1=
=0A=0AThis morning one our region servers (we have 44) stopped responding t=
o=0Athe '/jmx' request. (It's working for regular activity.)=A0 Additionall=
y,=0Athe region server is now using all the CPU on the host, running all 8=
=0Acores at 100%.=0A=0AI've got several jstacks, they all look like this:=
=0Ahttp://pastebin.com/dGTmTEN7=0A=0AIf I do a wget of the /jmx url, it sta=
rts responding, but never=0Acompletes, always stopping at the same point:=
=0Ahttp://pastebin.com/qhNvxrQK=0A=0AHas anyone ever seen this before? If s=
o, Is there a way out of it?=0A(other than bouncing the region server).=0A=
=0ABTW: There's nothing relevant in the region server log and the garbage=
=0Acollector log is normal.=0A=0A=0A---------------------------------------=
-------------------------------=0ARon Buckley