hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean MacDonald <s...@opendns.com>
Subject Re: Snapshot Export Problem
Date Mon, 22 Apr 2013 23:47:08 GMT
It looks like you can't export a snapshot to a running cluster or it will start cleaning up
files from the archive after a period of time. I have turned off HBase on the destination
cluster and the export is working as expected now.

Sean  


On Monday, 22 April, 2013 at 9:22 AM, Sean MacDonald wrote:

> Hello, 
> 
> I am using HBase 0.94.6 on CDH 4.2 and trying to export a snapshot to another cluster
(also CDH 4.2), but this is failing repeatedly. The table I am trying to export is approximately
4TB in size and has 10GB regions. Each of the map jobs runs for about 6 minutes and appears
to be running properly, but then fails with a message like the following:
> 
> 2013-04-22 16:12:50,699 WARN org.apache.hadoop.hdfs.DFSClient: DataStreamer Exception
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException):
No lease on /hbase/.archive/queries/533fcbb7858ef34b103a4f8804fa8719/d/651e974dafb64eefb9c49032aec4a35b
File does not exist. Holder DFSClient_NONMAPREDUCE_-192704511_1 does not have any open files.
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:2396)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:2387)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:2183)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:481)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:297)
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtoc
ol
> $2.callBlockingMethod(ClientNamenodeProtocolProtos.java:44080) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1695)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1691) at java.security.AccessController.doPrivileged(Native
Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1689)
> 
> I was able to see the file that the LeaseExpiredException mentions on the destination
cluster before the exception happened (it is gone afterwards).
> 
> Any help that could be provided in resolving this would be greatly appreciated.
> 
> Thanks and have a great day,
> 
> Sean 



Mime
View raw message