hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nick Dimiduk (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-9639) SecureBulkLoad dispatches file load requests to all Regions
Date Mon, 23 Sep 2013 16:10:03 GMT

    [ https://issues.apache.org/jira/browse/HBASE-9639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13774676#comment-13774676
] 

Nick Dimiduk commented on HBASE-9639:
-------------------------------------

It looks like a comparator is broken for byte\[0\]. With a little extra logging, you see this
come out of {{HTable#getStartKeysInRange}}:

{noformat}
2013-09-21 00:40:24,850 DEBUG [LoadIncrementalHFiles-9] client.HTable: For key range ['','']
got regions [, \x08\x00\x00\x00\x00\x00\x00\x00, \x10\x00\x00\x00\x00\x00\x00\x00, \x18\x00\x00\x00\x00\x00\x00\x00,
 \x00\x00\x00\x00\x00\x00\x00, (\x00\x00\x00\x00\x00\x00\x00, 0\x00\x00\x00\x00\x00\x00\x00,
8\x00\x00\x00\x00\x00\x00\x00, @\x00\x00\x00\x00\x00\x00\x00, H\x00\x00\x00\x00\x00\x00\x00,
P\x00\x00\x00\x00\x00\x00\x00, X\x00\x00\x00\x00\x00\x00\x00, `\x00\x00\x00\x00\x00\x00\x00,
h\x00\x00\x00\x00\x00\x00\x00, p\x00\x00\x00\x00\x00\x00\x00, x\x00\x00\x00\x00\x00\x00\x00]
{noformat}

This results in the SecureBulkLoadClient sending {{secureBulkLoadHFiles}} to all region servers
in the table.
                
> SecureBulkLoad dispatches file load requests to all Regions
> -----------------------------------------------------------
>
>                 Key: HBASE-9639
>                 URL: https://issues.apache.org/jira/browse/HBASE-9639
>             Project: HBase
>          Issue Type: Bug
>          Components: Coprocessors
>    Affects Versions: 0.95.2
>         Environment: Hadoop2, Kerberos 
>            Reporter: Nick Dimiduk
>
> When running a bulk load on a secure environment and loading data into the first region
of a table, the request to load the HFile set is dispatched to all Regions for the table.
This is reproduced consistently by running IntegrationTestBulkLoad on a secure cluster. The
load fails with an exception that looks like:
> {noformat}
> 2013-08-30 07:37:22,993 INFO  [main] mapreduce.LoadIncrementalHFiles: Split occured while
grouping HFiles, retry attempt 1 with 3 files remaining to group or split
> 2013-08-30 07:37:22,999 ERROR [main] mapreduce.LoadIncrementalHFiles: IOException during
splitting
> java.util.concurrent.ExecutionException: java.io.FileNotFoundException: File does not
exist: /user/hbase/test-data/c45ddfe9-ee30-4d32-8042-928db12b1cee/IntegrationTestBulkLoad-0/L/bf41ea13997b4e228d05e67ba7b1b686
> at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:61)
> at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:51)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsUpdateTimes(FSNamesystem.java:1489)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1438)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1418)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1392)
> at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:438)
> at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:269)
> at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:59566)
> at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2048)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2044)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1477)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2042)
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.groupOrSplitPhase(LoadIncrementalHFiles.java:403)
> at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:284)
> at org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad.runLinkedListMRJob(IntegrationTestBulkLoad.java:200)
> at org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad.testBulkLoad(IntegrationTestBulkLoad.java:133)
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message