hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Henry JunYoung KIM <henry.jy...@gmail.com>
Subject cannot create a table having a snappy compression algorithm in mac os x.
Date Wed, 05 Sep 2012 11:35:25 GMT
Hi, hbase users.

I have a problem to create a table with a snappy algorithm in Mac OS X (lion).

I am sure that there is a snappy jar file in $HBASE_HOME/lib, but, it couldn't create it without
errors.

environment : 
	hbase vesion : 0.92.1
	distribution mode : pseudo-distributed (1 master, 1 region-server)

region server log : 
	2012-09-05 20:28:11,882 ERROR org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler:
Failed open of region=STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.
	java.io.IOException: Compression algorithm 'snappy' previously failed test.
		at org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:78)
		at org.apache.hadoop.hbase.regionserver.HRegion.checkCompressionCodecs(HRegion.java:3237)
		at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:3226)
		at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:3176)
		at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:331)
		at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:107)
		at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:169)
		at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
		at java.lang.Thread.run(Thread.java:680)

master log : 
2012-09-05 20:31:18,569 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Found an existing
plan for STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. destination server
is 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,569 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Using pre-existing
plan for region STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.; plan=hri=STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.,
src=, dest=192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,569 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Assigning
region STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. to 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,569 DEBUG org.apache.hadoop.hbase.master.ServerManager: New connection
to 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,570 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_OPENING,
server=192.168.162.80,60020,1346843417187, region=1fa032ecf18ef9d194cc619f0205f783
2012-09-05 20:31:18,571 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_FAILED_OPEN,
server=192.168.162.80,60020,1346843417187, region=1fa032ecf18ef9d194cc619f0205f783
2012-09-05 20:31:18,571 DEBUG org.apache.hadoop.hbase.master.handler.ClosedRegionHandler:
Handling CLOSED event for 1fa032ecf18ef9d194cc619f0205f783
2012-09-05 20:31:18,571 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Forcing OFFLINE;
was=STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. state=CLOSED, ts=1346844678571,
server=192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,571 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:60000-0x139961fb9f00000
Creating (or updating) unassigned node for 1fa032ecf18ef9d194cc619f0205f783 with OFFLINE state
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=M_ZK_REGION_OFFLINE,
server=192.168.162.80,60000,1346843415199, region=1fa032ecf18ef9d194cc619f0205f783
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Found an existing
plan for STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. destination server
is 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Using pre-existing
plan for region STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.; plan=hri=STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.,
src=, dest=192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Assigning
region STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. to 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.ServerManager: New connection
to 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,575 ERROR org.apache.hadoop.hbase.master.AssignmentManager: Failed assignment
in: 192.168.162.80,60020,1346843417187 due to org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException:
Received:OPEN for the region:STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.
,which we are already trying to OPEN.
org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException: org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException:
Received:OPEN for the region:STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.
,which we are already trying to OPEN.
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
	at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
	at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1624)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1329)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1304)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1299)
	at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:102)
	at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:169)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
	at java.lang.Thread.run(Thread.java:680)
Caused by: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException:
Received:OPEN for the region:STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.
,which we are already trying to OPEN.
	at org.apache.hadoop.hbase.regionserver.HRegionServer.checkIfRegionInTransition(HRegionServer.java:2479)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServer.java:2437)
	at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1326)

	at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:918)
	at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
	at $Proxy10.openRegion(Unknown Source)
	at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:435)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1592)
	... 8 more


Would you share your experiences with this situation ?
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message