hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Ranganathan (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-3329) HLog splitting after RS/cluster death should directly create HFiles
Date Fri, 10 Dec 2010 22:25:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12970325#action_12970325
] 

Karthik Ranganathan commented on HBASE-3329:
--------------------------------------------

@Ryan - didnt get that... At a higher level, I was thinking that the current steps are:
1. Open and read hlogs
2. Split them and create edits per region files
3. RS that opens the regions reads the split edits files and then dumps them into hfiles

I was thinking we could change this sequence to something like:
1. Open hlogs
2. Create hfiles for the regions

And that would give us a big gain in not writing and reading the HLogs once each.

> HLog splitting after RS/cluster death should directly create HFiles
> -------------------------------------------------------------------
>
>                 Key: HBASE-3329
>                 URL: https://issues.apache.org/jira/browse/HBASE-3329
>             Project: HBase
>          Issue Type: Bug
>          Components: regionserver
>            Reporter: Karthik Ranganathan
>
> After a RS dies or the cluster goes down and we are recovering, we first split HLogs
into the logs for the regions. Then the region servers that host the regions replay the logs
and open the regions.
> This can be made more efficient by directly creating HFiles from the HLogs (instead of
producing a split HLogs file).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message