hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "Hbase/Troubleshooting" by JeanDanielCryans
Date Mon, 21 Jul 2008 14:35:35 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The following page has been changed by JeanDanielCryans:

  === Resolution ===
   * Make sure the HBase root directory does not currently exist or has been initialized by
a previous run of HBase. Sure fire solution is to just use Hadoop dfs to delete the HBase
root and let HBase create and initialize the directory itself.
+ == Problem: Replay of hlog required, forcing regionserver restart ==
+  * Under a heavy write load, some regions servers will go down with the following exception:

+ {{{
+ WARN org.apache.hadoop.dfs.DFSClient: Exception while reading from blk_xxxxxxxxxxxxxxx of
/hbase/some_repository from IP_address:50010: java.io.IOException: Premeture EOF from inputStream
+ then later
+ ERROR org.apache.hadoop.hbase.regionserver.HRegionServer: Error opening scanner (fsOk: true)
+ java.io.IOException: HStoreScanner failed constructionat org.apache.hadoop.hbase.regionserver.StoreFileScanner.<init>(StoreFileScanner.java:69)
+        at org.apache.hadoop.hbase.regionserver.HStoreScanner.<init>(HStoreScanner.java:68)
+        at org.apache.hadoop.hbase.regionserver.HStore.getScanner(HStore.java:1896)
+        ...
+ Caused by: java.net.SocketTimeoutException: timed out waiting for rpc response
+        at org.apache.hadoop.ipc.Client.call(Client.java:559)
+        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:212)
+        at org.apache.hadoop.dfs.$Proxy1.getFileInfo(Unknown Source)
+ }}}
+ === Causes ===
+  * RPC timeouts may happen because of a IO contention which blocks processes during file
+ === Resolution ===
+  * Either reduce the load or add more memory/machines.

View raw message