Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of yuzhihong@gmail.com designates
 209.85.213.45 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CACA1tWLzQVRmsnphLcdfagBqDaRZzvZiZsrgU1a6HK751JXBiw@mail.gmail.com>
References: 
 <CACA1tWLzQVRmsnphLcdfagBqDaRZzvZiZsrgU1a6HK751JXBiw@mail.gmail.com>
Date: Fri, 5 Sep 2014 08:58:50 -0700
Message-ID: 
 <CALte62yN52afHmPb_qrgkAEHFgKhT-mOFbqnW459UDBpv_PMgg@mail.gmail.com>
Subject: Re: Help: RegionTooBusyException: failed to get a lock in 60000 ms
From: Ted Yu <yuzhihong@gmail.com>
To: "user@hbase.apache.org" <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=20cf303bfe2c92e9a00502538b7c

--20cf303bfe2c92e9a00502538b7c
Content-Type: text/plain; charset=UTF-8

See HBASE-10882 where Victor's workaround was to do major compaction before
the bulkload.

Cheers


On Fri, Sep 5, 2014 at 8:15 AM, Jianshi Huang <jianshi.huang@gmail.com>
wrote:

> I'm importing 2TB of generated HFiles to HBase and I constantly get the
> following errors:
>
> Caused by:
>
> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.RegionTooBusyException):
> org.apache.hadoop.hbase.RegionTooBusyException: failed to get a lock in
> 60000 ms.
>
> regionName=grapple_edges_v2,ff000000,1409817320781.6d2955c780b39523de733f3565642d96.,
> server=xxxxx.xxx.xxx,60020,1404854700728
>         at
> org.apache.hadoop.hbase.regionserver.HRegion.lock(HRegion.java:5851)
>         at
> org.apache.hadoop.hbase.regionserver.HRegion.lock(HRegion.java:5837)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegion.startBulkRegionOperation(HRegion.java:5795)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:3543)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:3525)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.bulkLoadHFile(HRegionServer.java:3277)
>         at
>
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:28863)
>         at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2008)
>         at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:92)
>         at
>
> org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:160)
>         at
>
> org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:38)
>         at
>
> org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:110)
>         at java.lang.Thread.run(Thread.java:724)
>
>         at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1498)
>         at
>
> org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1684)
>         at
>
> org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1737)
>         at
>
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.bulkLoadHFile(ClientProtos.java:29276)
>         at
>
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.bulkLoadHFile(ProtobufUtil.java:1548)
>         ... 11 more
>
>
> What makes the region too busy? Is there a way to improve it?
>
> Does that also mean some part of my data are not correctly imported?
>
>
> Thanks,
>
> --
> Jianshi Huang
>
> LinkedIn: jianshi
> Twitter: @jshuang
> Github & Blog: http://huangjs.github.com/
>

--20cf303bfe2c92e9a00502538b7c--