hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vbogdanovsky <vbogdanov...@griddynamics.com>
Subject Frequent fail of bulkload
Date Thu, 04 Apr 2013 07:56:04 GMT
I have hfiles after MR-job and when I import them to my table I often 
get Exceptions like this:
============================================
hadoop jar /usr/lib/hbase/hbase-0.92.1-cdh4.1.1-security.jar 
completebulkload result/hfiles_dir mytable
============================================
java.io.FileNotFoundException: File does not exist: 
/user/myname/result/hfiles_dir/t/a87347681d904c639f613e21938e0669
     at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsUpdateTimes(FSNamesystem.java:1239)
     at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1192)
     at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1165)
     at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1147)
     at 
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:383)
     at 
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:170)
     at 
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:44064)
     at 
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)
     at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:898)
     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1693)
     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1689)
     at java.security.AccessController.doPrivileged(Native Method)
     at javax.security.auth.Subject.doAs(Subject.java:396)
     at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1687)

Why is it happend?
Sometimes the same hfiles import normal and sometimes with this errors.
What should I do for elimination of this problem?
Thanks.

Mime
View raw message