hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-3285) Hlog recovery takes too much time
Date Sat, 05 Mar 2011 06:28:45 GMT

     [ https://issues.apache.org/jira/browse/HBASE-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

stack updated HBASE-3285:

    Attachment: hdfs-1520,1555,1554-for-cdh3b2.txt

Patch for cdh3b2 adding recent additions from branch-0.20-append (hdfs-1520,1555,1554) used
testing recover hlog works up on cdh too.  Running tests, I see a bunch fail -- TestPread,
TestFileCreation, TestDatanodeBlockScanner.  Will try w/o this patch to see if I get same
failure set.

> Hlog recovery takes too much time
> ---------------------------------
>                 Key: HBASE-3285
>                 URL: https://issues.apache.org/jira/browse/HBASE-3285
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Hairong Kuang
>            Assignee: Hairong Kuang
>         Attachments: 3285-v2.txt, hbaseRecoverHLog.patch, hdfs-1520,1555,1554-for-cdh3b2.txt
> Currently HBase uses append to trigger the close of HLog during Hlog split. Append is
a very expensive operation, which involves not only NameNode operations but creating a writing
pipeline. If one of datanodes on the pipeline has a problem, this recovery may takes minutes.
I'd like implement a lightweight NameNode operation to trigger lease recovery and make HBase
to use this instead.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message