hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhihong Yu (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-5478) TestMetaReaderEditor intermittently hangs in 0.92 branch
Date Sun, 26 Feb 2012 07:11:48 GMT

    [ https://issues.apache.org/jira/browse/HBASE-5478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216655#comment-13216655
] 

Zhihong Yu commented on HBASE-5478:
-----------------------------------

>From the log, we can see that testScanMetaForTable() wasn't able to create table:
{code}
2012-02-25 01:51:47,262 FATAL [Thread-258] regionserver.HRegionServer(1544): ABORTING region
server janus.apache.org,50277,1330134696463: Aborting for tests
java.lang.Exception: Trace info
	at org.apache.hadoop.hbase.MiniHBaseCluster.abortRegionServer(MiniHBaseCluster.java:237)
	at org.apache.hadoop.hbase.catalog.TestMetaReaderEditor.testRetrying(TestMetaReaderEditor.java:138)
...
2012-02-25 01:58:17,615 INFO  [reader] catalog.TestMetaReaderEditor$MetaTask(174): reader
failed
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=10, exceptions:
Sat Feb 25 01:51:47 UTC 2012, org.apache.hadoop.hbase.client.HTable$5@1ba92bb, org.apache.hadoop.hbase.regionserver.RegionServerStoppedException:
org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server janus.apache.org,50277,1330134696463
not running, aborting
	at org.apache.hadoop.hbase.regionserver.HRegionServer.checkOpen(HRegionServer.java:2867)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:1781)
	at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1326)

Sat Feb 25 01:52:27 UTC 2012, org.apache.hadoop.hbase.client.HTable$5@1ba92bb, org.apache.hadoop.hbase.client.RetriesExhaustedException:
Failed setting up proxy interface org.apache.hadoop.hbase.ipc.HRegionInterface to janus.apache.org/67.195.138.60:41354
after attempts=1
Sat Feb 25 01:53:07 UTC 2012, org.apache.hadoop.hbase.client.HTable$5@1ba92bb, org.apache.hadoop.hbase.client.RetriesExhaustedException:
Failed setting up proxy interface org.apache.hadoop.hbase.ipc.HRegionInterface to janus.apache.org/67.195.138.60:41354
after attempts=1
Sat Feb 25 01:53:47 UTC 2012, org.apache.hadoop.hbase.client.HTable$5@1ba92bb, org.apache.hadoop.hbase.client.RetriesExhaustedException:
Failed setting up proxy interface org.apache.hadoop.hbase.ipc.HRegionInterface to janus.apache.org/67.195.138.60:41354
after attempts=1
Sat Feb 25 01:54:28 UTC 2012, org.apache.hadoop.hbase.client.HTable$5@1ba92bb, org.apache.hadoop.hbase.client.RetriesExhaustedException:
Failed setting up proxy interface org.apache.hadoop.hbase.ipc.HRegionInterface to janus.apache.org/67.195.138.60:41354
after attempts=1
Sat Feb 25 01:55:09 UTC 2012, org.apache.hadoop.hbase.client.HTable$5@1ba92bb, org.apache.hadoop.hbase.client.RetriesExhaustedException:
Failed setting up proxy interface org.apache.hadoop.hbase.ipc.HRegionInterface to janus.apache.org/67.195.138.60:41354
after attempts=1
Sat Feb 25 01:55:52 UTC 2012, org.apache.hadoop.hbase.client.HTable$5@1ba92bb, org.apache.hadoop.hbase.client.RetriesExhaustedException:
Failed setting up proxy interface org.apache.hadoop.hbase.ipc.HRegionInterface to janus.apache.org/67.195.138.60:41354
after attempts=1
Sat Feb 25 01:56:35 UTC 2012, org.apache.hadoop.hbase.client.HTable$5@1ba92bb, org.apache.hadoop.hbase.client.RetriesExhaustedException:
Failed setting up proxy interface org.apache.hadoop.hbase.ipc.HRegionInterface to janus.apache.org/67.195.138.60:41354
after attempts=1
Sat Feb 25 01:57:22 UTC 2012, org.apache.hadoop.hbase.client.HTable$5@1ba92bb, org.apache.hadoop.hbase.client.RetriesExhaustedException:
Failed setting up proxy interface org.apache.hadoop.hbase.ipc.HRegionInterface to janus.apache.org/67.195.138.60:41354
after attempts=1
Sat Feb 25 01:58:17 UTC 2012, org.apache.hadoop.hbase.client.HTable$5@1ba92bb, org.apache.hadoop.hbase.client.RetriesExhaustedException:
Failed setting up proxy interface org.apache.hadoop.hbase.ipc.HRegionInterface to janus.apache.org/67.195.138.60:41354
after attempts=1

	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionServerWithRetries(HConnectionManager.java:1345)
	at org.apache.hadoop.hbase.client.HTable.get(HTable.java:657)
	at org.apache.hadoop.hbase.catalog.MetaReader.get(MetaReader.java:247)
	at org.apache.hadoop.hbase.catalog.MetaReader.getRegion(MetaReader.java:349)
	at org.apache.hadoop.hbase.catalog.TestMetaReaderEditor.testGetRegion(TestMetaReaderEditor.java:286)
	at org.apache.hadoop.hbase.catalog.TestMetaReaderEditor.access$100(TestMetaReaderEditor.java:52)
	at org.apache.hadoop.hbase.catalog.TestMetaReaderEditor$2.metaTask(TestMetaReaderEditor.java:113)
	at org.apache.hadoop.hbase.catalog.TestMetaReaderEditor$MetaTask.run(TestMetaReaderEditor.java:168)
2012-02-25 01:58:20,873 DEBUG [MASTER_SERVER_OPERATIONS-janus.apache.org,50154,1330134696278-0]
zookeeper.ZKUtil(1117): hconnection-0x135b234bf520005 Retrieved 36 byte(s) of data from znode
/hbase/root-region-server and set watcher; janus.apache.org,41354,133013...

2012-02-25 01:58:20,873 DEBUG [MASTER_SERVER_OPERATIONS-janus.apache.org,50154,1330134696278-0]
client.HConnectionManager$HConnectionImplementation(804): Lookedup root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@19a68ee;
serverName=janus.apache.org,41354,1330134696435

2012-02-25 01:58:21,670 WARN  [main] client.HBaseAdmin(364): Creating testScanMetaForTable
took too long
java.net.SocketTimeoutException: Call to janus.apache.org/67.195.138.60:50154 failed on socket
timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for
channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/67.195.138.60:49542
remote=janus.apache.org/67.195.138.60:50154]
	at org.apache.hadoop.hbase.ipc.HBaseClient.wrapException(HBaseClient.java:930)
	at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:903)
	at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
	at $Proxy21.createTable(Unknown Source)
	at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:453)
	at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:362)
	at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:300)
	at org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:689)
	at org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:669)
	at org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:657)
	at org.apache.hadoop.hbase.catalog.TestMetaReaderEditor.testScanMetaForTable(TestMetaReaderEditor.java:254)
{code}
The abortion was due to this call in testRetrying():
{code}
      UTIL.getMiniHBaseCluster().abortRegionServer(index);
{code}
                
> TestMetaReaderEditor intermittently hangs in 0.92 branch
> --------------------------------------------------------
>
>                 Key: HBASE-5478
>                 URL: https://issues.apache.org/jira/browse/HBASE-5478
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.92.1
>            Reporter: Zhihong Yu
>
> From 0.92 build #304:
> {code}
> Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor
> Running org.apache.hadoop.hbase.catalog.TestCatalogTrackerOnCluster
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 149.104 sec
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message