hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Billy Pearson (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-728) Supporting for HLog appends
Date Tue, 08 Jul 2008 06:36:38 GMT

    [ https://issues.apache.org/jira/browse/HBASE-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611469#action_12611469
] 

Billy Pearson commented on HBASE-728:
-------------------------------------

The Major item needing appends in HBase is HLog so we can handle crashed regional servers
with out data loss. Currently we could lose up to 30K updates if a server fails.

I was thanking we should maybe thank of something like mysql does with innodb database
innodb_flush_log_at_trx_commit

Options:
1 = HLog buffer is flushed to disk with each update.
2 = HLog buffer is flushed to disk once per second or every x secs.
3 = HLog buffer is flushed to disk when reached x size.

Clearly option 1 would be slower per update as we would have to append to the file with each
change but that would allow us an option to have zero data loss and options 2-3 would give
users option to chose how much data lose would be acceptable for a performance increase.

> Supporting for HLog appends
> ---------------------------
>
>                 Key: HBASE-728
>                 URL: https://issues.apache.org/jira/browse/HBASE-728
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>    Affects Versions: 0.3.0
>            Reporter: Billy Pearson
>            Priority: Trivial
>
> I thank we should open a ticket to track what needs changed to support appends when the
coding is done on HADOOP-1700.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message