hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-3285) Hlog recovery takes too much time
Date Sat, 05 Mar 2011 07:52:46 GMT

     [ https://issues.apache.org/jira/browse/HBASE-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

stack updated HBASE-3285:
-------------------------

    Attachment: 3285-v3.txt

Fix a noisey log message in case where recoverlease method is missing.

Tested on cluster w/o the api and seems to work fine.

Will apply this patch to branch and trunk unless objection.  It can make use of the fs.recoverLease
API if present purportedly skirting issues seen where we can get into a loop stuck trying
to grab lease when trying to open a file for append.

> Hlog recovery takes too much time
> ---------------------------------
>
>                 Key: HBASE-3285
>                 URL: https://issues.apache.org/jira/browse/HBASE-3285
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Hairong Kuang
>            Assignee: Hairong Kuang
>         Attachments: 3285-v2.txt, 3285-v3.txt, hbaseRecoverHLog.patch, hdfs-1520,1555,1554-for-cdh3b2.txt
>
>
> Currently HBase uses append to trigger the close of HLog during Hlog split. Append is
a very expensive operation, which involves not only NameNode operations but creating a writing
pipeline. If one of datanodes on the pipeline has a problem, this recovery may takes minutes.
I'd like implement a lightweight NameNode operation to trigger lease recovery and make HBase
to use this instead.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message