Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of brian.jeltema@digitalenvoy.net
 designates 128.136.82.69 as permitted sender)
From: Brian Jeltema <brian.jeltema@digitalenvoy.net>
Content-Type: multipart/alternative;
 boundary="Apple-Mail=_BAFD4FE0-894B-4D24-90DE-417B83721F50"
Subject: what can cause RegionTooBusyException?
Message-Id: <D62B10F9-D00A-483D-9295-01B7E8FF6C5C@digitalenvoy.net>
Date: Mon, 10 Nov 2014 14:10:32 -0500
To: user@hbase.apache.org
Mime-Version: 1.0 (Mac OS X Mail 7.2 \(1874\))

--Apple-Mail=_BAFD4FE0-894B-4D24-90DE-417B83721F50
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=windows-1252

I=92m running a map/reduce job against a table that is performing a =
large number of writes (probably updating every row).
The job is failing with the exception below. This is a solid failure; it =
dies at the same point in the application,
and at the same row in the table. So I doubt it=92s a conflict with =
compaction (and the UI shows no compaction in progress),
or that there is a load-related cause.

=91hbase hbck=92 does not report any inconsistencies. The =
=91waitForAllPreviousOpsAndReset=92 leads me to suspect that
there is operation in progress that is hung and blocking the update. I =
don=92t see anything suspicious in the HBase logs.
The data at the point of failure is not unusual, and is identical to =
many preceding rows.
Does anybody have any ideas of what I should look for to find the cause =
of this RegionTooBusyException?

This is Hadoop 2.4 and HBase 0.98.

14/11/10 13:46:13 INFO mapreduce.Job: Task Id : =
attempt_1415210751318_0010_m_000314_1, Status : FAILED
Error: =
org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: =
Failed 1744 actions: RegionTooBusyException: 1744 times,=20
 	at =
org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.makeException(Asyn=
cProcess.java:207)
 	at =
org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.access$1700(AsyncP=
rocess.java:187)
 	at =
org.apache.hadoop.hbase.client.AsyncProcess.waitForAllPreviousOpsAndReset(=
AsyncProcess.java:1568)
 	at =
org.apache.hadoop.hbase.client.HTable.backgroundFlushCommits(HTable.java:1=
023)
 	at org.apache.hadoop.hbase.client.HTable.doPut(HTable.java:995)
 	at org.apache.hadoop.hbase.client.HTable.put(HTable.java:953)

Brian=

--Apple-Mail=_BAFD4FE0-894B-4D24-90DE-417B83721F50--