hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-10549) When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
Date Fri, 14 Mar 2014 23:14:44 GMT

    [ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13935808#comment-13935808

stack commented on HBASE-10549:

@rajeshbabu and [~Auraro]

This patch has a test that fails up on our build box.  See here:



Can you take a look please?  If you can't do it soon, just say and I'll back this out.  Thanks.

> When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
> --------------------------------------------------------------------------
>                 Key: HBASE-10549
>                 URL: https://issues.apache.org/jira/browse/HBASE-10549
>             Project: HBase
>          Issue Type: Bug
>          Components: HFile
>    Affects Versions: 0.98.0, 0.94.11,
>            Reporter: yuanxinen
>            Assignee: yuanxinen
>             Fix For: 0.96.2, 0.98.1, 0.99.0, 0.94.18
>         Attachments: HBASE-10549-0.94, HBASE-10549-trunk-2014-03-13.patch, HBASE-10549-trunk.patch
> First,I explan my test steps.
> 1.importtsv
> 2.split the region
> 3.delete the region info from .META.(make a hole)
> 4.LoadIncrementalHFiles (this step will hung up in an infinite loop)
> I check the log,there are two issues
> 1.it create _tmp folder in an infinite loop.
> hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom
> 2.when slpliting the hfile,it put the first line data(1211) into two files(top and bottom)
> Input File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0
> Input File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0
> and then I check the code.
> So I think before spliting the hfile,we should check the consistency of startkey and
endkey,if something wrong,we should throw the exception,and stop LoadIncrementalHFiles.

This message was sent by Atlassian JIRA

View raw message