hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-3128) On assign, if ConnectException, reassign another server
Date Tue, 19 Oct 2010 21:41:28 GMT

     [ https://issues.apache.org/jira/browse/HBASE-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

stack updated HBASE-3128:
-------------------------

    Description: 
{code}

2010-10-19 13:29:56,116 DEBUG [Thread-216-EventThread] master.AssignmentManager(321): Handling
transition=M_ZK_REGION_OFFLINE, server=172.24.152.112:51845, region=1028785192/.META.
2010-10-19 13:29:56,116 ERROR [Master:0;172.24.152.112:51845] master.ServerManager(573): Error
connecting to region server
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed setting up proxy interface
org.apache.hadoop.hbase.ipc.HRegionInterface to /172.24.152.112:51850 after attempts=1
	at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:351)
	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:936)
	at org.apache.hadoop.hbase.master.ServerManager.getServerConnection(ServerManager.java:568)
	at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:511)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:726)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:640)
	at org.apache.hadoop.hbase.master.AssignmentManager.assignMeta(AssignmentManager.java:935)
	at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:430)
	at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:377)
	at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:266)
	at java.lang.Thread.run(Thread.java:637)
Caused by: java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
	at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
	at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404)
	at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.setupIOstreams(HBaseClient.java:310)
	at org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:860)
	at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:728)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:255)
	at $Proxy10.getProtocolVersion(Unknown Source)
	at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:412)
	at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:388)
	at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:435)
	at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:345)
	... 10 more
2010-10-19 13:29:56,116 WARN  [Master:0;172.24.152.112:51845] master.AssignmentManager(730):
Failed assignment of .META.,,1.1028785192 to serverName=172.24.152.112,51850,1287520189982,
load=(requests=0, regions=0, usedHeap=60, maxHeap=123)
java.lang.RuntimeException: Fatal error connection to RS
	at org.apache.hadoop.hbase.master.ServerManager.getServerConnection(ServerManager.java:574)
	at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:511)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:726)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:640)
	at org.apache.hadoop.hbase.master.AssignmentManager.assignMeta(AssignmentManager.java:935)
	at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:430)
	at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:377)
	at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:266)
	at java.lang.Thread.run(Thread.java:637)
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed setting up proxy
interface org.apache.hadoop.hbase.ipc.HRegionInterface to /172.24.152.112:51850 after attempts=1
	at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:351)
	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:936)
	at org.apache.hadoop.hbase.master.ServerManager.getServerConnection(ServerManager.java:568)
	... 8 more
Caused by: java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
	at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
	at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404)
	at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.setupIOstreams(HBaseClient.java:310)
	at org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:860)
	at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:728)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:255)
	at $Proxy10.getProtocolVersion(Unknown Source)
	at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:412)
	at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:388)
	at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:435)
	at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:345)
	... 10 more

{code}

  was:
{code}

2010-10-19 13:29:56,115 DEBUG [Master:0;172.24.152.112:51845] master.AssignmentManager(801):
No previous transition plan for .META.,,1.1028785192 so generated a random one; hri=.META.,,1.1028785192,
src=, dest=172.24.152.112,51850,1287520189982; 3 (online=3, exclude=null) available servers
2010-10-19 13:29:56,115 DEBUG [Master:0;172.24.152.112:51845] master.AssignmentManager(723):
Assigning region .META.,,1.1028785192 to 172.24.152.112,51850,1287520189982
2010-10-19 13:29:56,115 DEBUG [Master:0;172.24.152.112:51845] master.ServerManager(567): New
connection to 172.24.152.112,51850,1287520189982
2010-10-19 13:29:56,115 DEBUG [Thread-216-EventThread] zookeeper.ZKUtil(1012): master:51845-0x12bc62e746c0014
Retrieved 43 byte(s) of data from znode /hbase/unassigned/1028785192 and set watcher; 


> On assign, if ConnectException, reassign another server
> -------------------------------------------------------
>
>                 Key: HBASE-3128
>                 URL: https://issues.apache.org/jira/browse/HBASE-3128
>             Project: HBase
>          Issue Type: Bug
>            Reporter: stack
>             Fix For: 0.90.0
>
>
> {code}
> 2010-10-19 13:29:56,116 DEBUG [Thread-216-EventThread] master.AssignmentManager(321):
Handling transition=M_ZK_REGION_OFFLINE, server=172.24.152.112:51845, region=1028785192/.META.
> 2010-10-19 13:29:56,116 ERROR [Master:0;172.24.152.112:51845] master.ServerManager(573):
Error connecting to region server
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed setting up proxy interface
org.apache.hadoop.hbase.ipc.HRegionInterface to /172.24.152.112:51850 after attempts=1
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:351)
> 	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:936)
> 	at org.apache.hadoop.hbase.master.ServerManager.getServerConnection(ServerManager.java:568)
> 	at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:511)
> 	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:726)
> 	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:640)
> 	at org.apache.hadoop.hbase.master.AssignmentManager.assignMeta(AssignmentManager.java:935)
> 	at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:430)
> 	at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:377)
> 	at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:266)
> 	at java.lang.Thread.run(Thread.java:637)
> Caused by: java.net.ConnectException: Connection refused
> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
> 	at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
> 	at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404)
> 	at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.setupIOstreams(HBaseClient.java:310)
> 	at org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:860)
> 	at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:728)
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:255)
> 	at $Proxy10.getProtocolVersion(Unknown Source)
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:412)
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:388)
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:435)
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:345)
> 	... 10 more
> 2010-10-19 13:29:56,116 WARN  [Master:0;172.24.152.112:51845] master.AssignmentManager(730):
Failed assignment of .META.,,1.1028785192 to serverName=172.24.152.112,51850,1287520189982,
load=(requests=0, regions=0, usedHeap=60, maxHeap=123)
> java.lang.RuntimeException: Fatal error connection to RS
> 	at org.apache.hadoop.hbase.master.ServerManager.getServerConnection(ServerManager.java:574)
> 	at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:511)
> 	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:726)
> 	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:640)
> 	at org.apache.hadoop.hbase.master.AssignmentManager.assignMeta(AssignmentManager.java:935)
> 	at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:430)
> 	at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:377)
> 	at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:266)
> 	at java.lang.Thread.run(Thread.java:637)
> Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed setting up
proxy interface org.apache.hadoop.hbase.ipc.HRegionInterface to /172.24.152.112:51850 after
attempts=1
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:351)
> 	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:936)
> 	at org.apache.hadoop.hbase.master.ServerManager.getServerConnection(ServerManager.java:568)
> 	... 8 more
> Caused by: java.net.ConnectException: Connection refused
> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
> 	at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
> 	at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404)
> 	at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.setupIOstreams(HBaseClient.java:310)
> 	at org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:860)
> 	at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:728)
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:255)
> 	at $Proxy10.getProtocolVersion(Unknown Source)
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:412)
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:388)
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:435)
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:345)
> 	... 10 more
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message