hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joshua Napoli <jnap...@swipely.com>
Subject HBase hung, lost metadata for tables
Date Fri, 07 Oct 2011 18:58:27 GMT
I'm using HBase 0.90.4 and encountered a problem where:

   1. HBase became unable to processes requests. REST client requests
   time-out and HBase commands from HBase shell would hang.
   2. After restarting the cluster, almost all of my tables were missing
   (but the HDFS files remain).


While the cluster was hung, the REST logs were repeating (for the same
tables over and over):
"2011-10-05 10:09:54,801 DEBUG org.apache.hadoop.hbase.client.HBaseAdmin:
Sleeping= 32000ms, waiting for all regions to be disabled in ...".

The messages list tables that were meant for deletion. However, many other
tables (not listed for disable/delete in the logs) were lost.

What could cause the loss of table information? What is the proper sequence
for restarting a cluster that is no longer able to process HBase requests?


Thanks,
Josh

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message