hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James Teng <tenglinx...@outlook.com>
Subject HBase Error -- Can not scan table anymore.
Date Fri, 27 Mar 2015 03:47:35 GMT
hi,i have deployed hbase on my laptop as pseduo-distributed mode, however suddenly encountered
an error and can not scan a hbase table anymore?could anyone show me any comments on this?thanks
in advance.
uknow.
2015-03-27 11:35:00,152 WARN  [CatalogJanitor-10.128.120.35:16020] master.CatalogJanitor:
Failed scan of catalog tableorg.apache.hadoop.hbase.client.RetriesExhaustedException: Failed
after attempts=351, exceptions:Fri Mar 27 11:35:00 CST 2015, null, java.net.SocketTimeoutException:
callTimeout=60000, callDuration=68068: row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740,
hostname=10.128.120.35,16201,1427426329960, seqNum=0
	at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:264)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:199)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:56)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200)
at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:287)	at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:267)
at org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:139)
at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:134)	at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:823)
at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:187)	at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:89)
at org.apache.hadoop.hbase.master.CatalogJanitor.getMergedRegionsAndSplitParents(CatalogJanitor.java:169)
at org.apache.hadoop.hbase.master.CatalogJanitor.getMergedRegionsAndSplitParents(CatalogJanitor.java:121)
at org.apache.hadoop.hbase.master.CatalogJanitor.scan(CatalogJanitor.java:222)	at org.apache.hadoop.hbase.master.CatalogJanitor.chore(CatalogJanitor.java:103)
at org.apache.hadoop.hbase.Chore.run(Chore.java:80)	at java.lang.Thread.run(Thread.java:745)Caused
by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68068: row '' on table
'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=10.128.120.35,16201,1427426329960,
seqNum=0	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:159)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:294)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:275)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)	... 1 moreCaused
by: java.net.ConnectException: Connection refused	at sun.nio.ch.SocketChannelImpl.checkConnect(Native
Method)	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)	at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529)	at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493)
at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.setupConnection(RpcClientImpl.java:403)
at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.setupIOstreams(RpcClientImpl.java:709)
at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.writeRequest(RpcClientImpl.java:880)
at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.tracedWriteRequest(RpcClientImpl.java:849)
at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1173)	at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:216)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:300)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:31751)
at org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:332)	at
org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:187)	at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:62)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126)
... 6 more2015-03-27 11:35:00,834 INFO  [main-EventThread] coordination.SplitLogManagerCoordination:
task /hbase/splitWAL/RESCAN0000000728 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27
11:35:01,844 INFO  [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000729
entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:02,833 INFO  [10.128.120.35,16020,1427426328553.splitLogManagerTimeoutMonitor]
master.SplitLogManager: total tasks = 3 unassigned = 3 tasks={/hbase/splitWAL/WALs%2F10.128.120.35%2C16201%2C1427426329960-splitting%2F10.128.120.35%252C16201%252C1427426329960..meta.1427426351949.meta=last_update
= -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits
= 0 batch = installed = 3 done = 0 error = 0, /hbase/splitWAL/WALs%2F10.128.120.35%2C16201%2C1427426329960-splitting%2F10.128.120.35%252C16201%252C1427426329960..meta.1427426385371.meta=last_update
= -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits
= 0 batch = installed = 3 done = 0 error = 0, /hbase/splitWAL/WALs%2F10.128.120.35%2C16201%2C1427426329960-splitting%2F10.128.120.35%252C16201%252C1427426329960..meta.1427426352298.meta=last_update
= -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits
= 0 batch = installed = 3 done = 0 error = 0}2015-03-27 11:35:02,836 INFO  [main-EventThread]
coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000730 entered state:
DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:03,843 INFO  [main-EventThread] coordination.SplitLogManagerCoordination:
task /hbase/splitWAL/RESCAN0000000731 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27
11:35:04,845 INFO  [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000732
entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:05,845 INFO  [main-EventThread]
coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000733 entered state:
DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:06,846 INFO  [main-EventThread] coordination.SplitLogManagerCoordination:
task /hbase/splitWAL/RESCAN0000000734 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27
11:35:07,837 INFO  [10.128.120.35,16020,1427426328553.splitLogManagerTimeoutMonitor] master.SplitLogManager:
total tasks = 3 unassigned = 3 tasks={/hbase/splitWAL/WALs%2F10.128.120.35%2C16201%2C1427426329960-splitting%2F10.128.120.35%252C16201%252C1427426329960..meta.1427426351949.meta=last_update
= -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits
= 0 batch = installed = 3 done = 0 error = 0, /hbase/splitWAL/WALs%2F10.128.120.35%2C16201%2C1427426329960-splitting%2F10.128.120.35%252C16201%252C1427426329960..meta.1427426385371.meta=last_update
= -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits
= 0 batch = installed = 3 done = 0 error = 0, /hbase/splitWAL/WALs%2F10.128.120.35%2C16201%2C1427426329960-splitting%2F10.128.120.35%252C16201%252C1427426329960..meta.1427426352298.meta=last_update
= -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits
= 0 batch = installed = 3 done = 0 error = 0}2015-03-27 11:35:07,848 INFO  [main-EventThread]
coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000735 entered state:
DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:08,847 INFO  [main-EventThread] coordination.SplitLogManagerCoordination:
task /hbase/splitWAL/RESCAN0000000736 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27
11:35:09,840 INFO  [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000737
entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:10,841 INFO  [main-EventThread]
coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000738 entered state:
DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:11,849 INFO  [main-EventThread] coordination.SplitLogManagerCoordination:
task /hbase/splitWAL/RESCAN0000000739 entered state: DONE 10.128.120.35,16020,1427426328553
		 	   		  
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message