Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of alex.baranov.v@gmail.com
 designates 209.85.215.41 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAA7+SiAjNsD-E=9DymnyZ9XMN5FCAzaSkBowZDUJdtDemPai0A@mail.gmail.com>
References: 
 <CAA7+SiBwfEtg81GuL+Qewe-ea-V7Q_8FbpawfkcOvphz9epARQ@mail.gmail.com>
	<0A76A7D9-14A4-41C8-BAC6-543570F395A0@gmail.com>
	<CAA7+SiAjNsD-E=9DymnyZ9XMN5FCAzaSkBowZDUJdtDemPai0A@mail.gmail.com>
Date: Sun, 12 Feb 2012 14:55:37 -0500
Message-ID: 
 <CAA7+SiATaABtx8xtjUSMdNC-ZVgJ=jF+Dz=uYykKL=kDsU2Dkw@mail.gmail.com>
Subject: Re: LeaseException despite high hbase.regionserver.lease.period
From: Alex Baranau <alex.baranov.v@gmail.com>
To: user@hbase.apache.org
Cc: "hbase-user@hadoop.apache.org" <hbase-user@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=e89a8f235311e5317704b8c9bebb

--e89a8f235311e5317704b8c9bebb
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hm, weird. Looks like now it goes well. What I did is once again restarted
several regionservers (noticed that some where holding regions which were
stuck in "in transition" state). And started back the job.

Btw, forgot to mention that caching on Scanner was set to only 64 and I the
estimate for records size is < 100KB. Anyhow, the weird thing was that the
limits were set to 10min and it started to fail even before 10 min has
passed (sometimes after 3-4 minutes).

Have to go and can't watch the job to the end, will write whether it
succeed or not. If face same problems again will try brutal variant: set
caching =3D 10 (or even 1), set batch =3D 10 (or even 1).

Alex

On Sun, Feb 12, 2012 at 1:49 PM, Alex Baranau <alex.baranov.v@gmail.com>wro=
te:

> Hi,
>
> 0.90.4-cdh3u2
>
> Alex
>
>
> On Sun, Feb 12, 2012 at 1:44 PM, <yuzhihong@gmail.com> wrote:
>
>> Which version of hbase are you using ?
>>
>> Thanks
>>
>>
>>
>> On Feb 12, 2012, at 10:41 AM, Alex Baranau <alex.baranov.v@gmail.com>
>> wrote:
>>
>> > Hello,
>> >
>> > I'm getting scanner lease exceptions during mapreduce job [1] after
>> running
>> > it for less than 7 minutes. Though I have set
>> > hbase.regionserver.lease.period to 600000 (i.e. 10 min) in hbase
>> > configuration on master and all regionservers and master (and restarte=
d
>> > all). Also set it in job's configuration.
>> >
>> > Is there anything else I could do to eliminate the exception?
>> >
>> > Thanks,
>> > Alex
>> >
>> > [1]
>> >
>> > org.apache.hadoop.hbase.regionserver.LeaseException:
>> > org.apache.hadoop.hbase.regionserver.LeaseException: lease
>> > =CA=BC3854333525977315054=CA=BC does not exist
>> >                  at
>> > org.apache.hadoop.hbase.regionserver.Leases.removeLease(Leases.java:23=
0)
>> >
>> >                  at
>> >
>> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.ja=
va:1862)
>> >
>> >                  at sun.reflect.GeneratedMethodAccessor6.invoke(Unknow=
n
>> > Source)
>> >
>> >                  at
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor=
Impl.java:25)
>> > Last
>> >                  at
>> > java.lang.reflect.Method.invoke(Method.java:597)
>> > 4KB
>> > al FAILED         at
>> > org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
>> > Last
>> >                  at
>> >
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:103=
9)
>> > 8KB
>> >
>> > All
>> >                  at
>> > sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
>> > Method)
>> >
>> >                  at
>> >
>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorA=
ccessorImpl.java:39)
>> >
>> >                  at
>> >
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingCons=
tructorAccessorImpl.java:27)
>> >
>> >                  at
>> > java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>> >
>> >                  at
>> > org.ap
>>
>
>

--e89a8f235311e5317704b8c9bebb--