Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of shrijeet@rocketfuelinc.com
 designates 74.125.245.96 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAHH9OkDW5TYJFRqpqkEy4w__Lzs6OZKXBj-RfyQb3r5zgRjBOQ@mail.gmail.com>
References: 
 <CAHH9OkDW5TYJFRqpqkEy4w__Lzs6OZKXBj-RfyQb3r5zgRjBOQ@mail.gmail.com>
Date: Wed, 14 Dec 2011 10:07:38 -0800
Message-ID: 
 <CAHH9OkA0tSJSGuHjwHv1Fmdpb1jn5gZxGvgSJSFNE=18nP52qQ@mail.gmail.com>
Subject: Re: Runtime exceptions during meta scan
From: Shrijeet Paliwal <shrijeet@rocketfuel.com>
To: dev@hbase.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

For what it is worth, the client was doing Full GC every 10th second
while this was happening.
We recently increased new gen size on few of the clients as a part of
an experiment and all those clients suffer this situation I describe
in the mail earlier.

On Thu, Dec 8, 2011 at 1:13 PM, Shrijeet Paliwal
<shrijeet@rocketfuel.com> wrote:
> Hi,
> Version: 0.90.3 + patches=A0back ported
>
> The other day our client started spitting these two runtime exceptions. N=
ot
> all clients connected to the cluster were under impact. Only 4 of them.
> While 3 of them were throwing NPE, one of them was
> throwing=A0ArrayIndexOutOfBoundsException. The errors are :
>
> 1.=A0http://pastie.org/2987926
> 2.=A0http://pastie.org/2987927
>
> Clients did not recover from this and I had to bump them.
>
> I wish to understand, since we are catching runtime exception in this blo=
ck
> of code - do we expect this kind of=A0behavior. Also with the given stack
> trace I can not tell which line caused NPE of AIOBE.
>
> Thanks.
>
> -Shrijeet
> PS: Line numbers in stack trace may not match with 0.90.3 branch because =
of
> extra patches we have.