zookeeper-bookkeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ivan Kelly <iv...@apache.org>
Subject Re: Is there any way to set a string name for a ledger and how to do checkpoint ?
Date Wed, 30 May 2012 11:13:36 GMT
Hi Stone,

Currently the bookkeeper API only provides the primatives, and
developers need to add their own glue code on top of this. 

It may be worth your while to take a look at the WAL implementation we
did for HDFS[1]. This has "named" ledgers, and allow supports the
checkpointing. 

A "editlog" is a sequence of ledgers, which the journal manager
maintains in zookeeper. When a checkpoint is made, the current ledger
is closed, and a new one is created. HDFS maintains it's own
transaction ids so that it can removed old ledgers which are no longer
needed after checkpointing. 

We have been thinking about pulling out this abstract to make it
easier for general use, but not much progress has been made on this
yet. 

Regards
Ivan


[1] https://github.com/apache/hadoop-common/tree/trunk/hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal


Mime
View raw message