hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: RetriesExhaustedException
Date Wed, 27 Jan 2010 20:14:51 GMT
2010/1/26  <y_823910@tsmc.com>:
>
> There are 3 zookeeper servers(4 core, 12G RAM), 10 Region servers (4 core,
> 12G RAM) in my cluster.

Regards the zk servers, thats a bit of overkill.  You might instead
run them beside regionservers only give them their own disk if you
can.  They need a bit of RAM and then they need to be able to write to
disk w/ minimal contention.


> 900 regions are in HBase now.
> I don't know why the RetriesExhaustedException raised.
> Any suggestions?
>
> org.apache.hadoop.hbase.client.RetriesExhaustedException:
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to contact
> region server Some server, retryOnlyOne=true, index=0, islastrow=true,
> tries=9, numtries=10, i=19, listsize=20,
> region=FRPF-MAINPD_ID,,1264583412962 for region
> FRPF-MAINPD_ID,,1264583412962, row 'XRD_AE32739-01.001036q5gak_kd3gxd', but
> failed after 10 attempts.
> Exceptions:
>

So, take the region name:

FRPF-MAINPD_ID,,1264583412962

...and grep the master log.  See what was going on around the above
time.  Was the region not deployed anywhere?  If so, why not?

Hopefully you have been running at DEBUG log level.  If so, you'll
have more detail in the logs and it'll be easier discerning why the
issue.

St.Ack

Mime
View raw message