hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sriram <vsrira...@gmail.com>
Subject Skip unresponsive regions in scan
Date Thu, 03 Apr 2014 23:24:00 GMT
Hi,

Is it possible to skip unresponsive regions in hbase table export import? I
am trying to migrate my table from hbase 0.90.5 to hbase 0.94.6. For that I
am using hbase export tool. As it internally spins up a Map reduce program
for this, it fails when few regions are not responding back. 

Is it possible to save the partial data and skip the unresponsive regions
and do the import of the partial data? I have tried giving timestamp range
as well. Still facing same problem.

I am getting exceptions as mentioned in
https://issues.apache.org/jira/browse/HBASE-5322 

Thanks,
Sriram

Exception Trace:
----------------
org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to contact
region server 
machine :60020 for region
table,6a9c37173adefa7f,1374790424571.c4713d144d1fa6bdfc937b570ebc14e2., row
'6a9c37173adefa7f', but failed after 10 attempts.
Exceptions:
java.io.IOException: java.io.IOException: Could not seek
StoreFileScanner[HFileScanner for reader
reader=hdfs://machine/hbase/table/c4713d144d1fa6bdfc937b570ebc14e2/column/4884593935967971789,
compression=lzo, inMemory=false,
firstKey=6a9c37173adefa7f/qa:INDEX_TIME/1325912843301/Put,
lastKey=6a9d1c2ef3b5dc3e/qa:QA_COUNT/1381345482919/Put, avgKeyLen=36,
avgValueLen=291, entries=12052, length=2516134, cur=null]
	at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:104)
	at org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:77)
	at org.apache.hadoop.hbase.regionserver.Store.getScanner(Store.java:1398)
	at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.(HRegion.java:2388)
	at
org.apache.hadoop.hbase.regionserver.HRegion.instantiateInternalScanner(HRegion.java:1136)
	at
org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1128)
	at
org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1112)
	at
org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1811)
	at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
	at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
	at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
Caused by: java.io.IOException: Premeture EOF from inputStream
	at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:104)
	at
org.apache.hadoop.hbase.io.hfile.HFile$Reader.decompress(HFile.java:1094)
	at org.apache.hadoop.hbase.io.hfile.HFile$Reader.readBlock(HFile.java:1036)
	at
org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.seekTo(HFile.java:1433)
	at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:139)
	at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:96)
	... 12 more

java.io.IOException: java.io.IOException: Could not seek
StoreFileScanner[HFileScanner for reader
reader=hdfs://machine/hbase/table/c4713d144d1fa6bdfc937b570ebc14e2/column/4884593935967971789,
compression=lzo, inMemory=false,
firstKey=6a9c37173adefa7f/qa:INDEX_TIME/1325912843301/Put,
lastKey=6a9d1c2ef3b5dc3e/qa:QA_COUNT/1381345482919/Put, avgKeyLen=36,
avgValueLen=291, entries=12052, length=2516134, cur=null]
	at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:104)
	at org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:77)
	at org.apache.hadoop.hbase.regionserver.Store.getScanner(Store.java:1398)
	at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.(HRegion.java:2388)
	at
org.apache.hadoop.hbase.regionserver.HRegion.instantiateInternalScanner(HRegion.java:1136)
	at
org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1128)
	at
org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1112)
	at
org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1811)
	at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
	at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
	at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
Caused by: java.io.IOException: Premeture EOF from inputStream
	at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:104)
	at
org.apache.hadoop.hbase.io.hfile.HFile$Reader.decompress(HFile.java:1094)
	at org.apache.hadoop.hbase.io.hfile.HFile$Reader.readBlock(HFile.java:1036)
	at
org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.seekTo(HFile.java:1433)
	at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:139)
	at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:96)
	... 12 more



--
View this message in context: http://apache-hbase.679495.n3.nabble.com/Skip-unresponsive-regions-in-scan-tp4057843.html
Sent from the HBase User mailing list archive at Nabble.com.

Mime
View raw message