hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Flavio Junqueira <...@yahoo-inc.com>
Subject Re: Omid: Transactional Support for HBase
Date Sat, 05 Nov 2011 07:53:37 GMT

On Nov 5, 2011, at 5:37 AM, lars hofhansl wrote:

> One thing I was wondering: Why bookkeeper? Why not store the WAL  
> itself in HBase? That way
> you might not even need a separate server.

Lars, The key reasons are performance and scalability. We also would  
like to have region servers at some point using BookKeeper for WAL for  
our applications, even though the figure doesn't show it. In that  
case, we have a common platform for WAL. We have a jira open about it,  
but we haven't made progress in a while due to other priorities and  
some issues with the WAL interface, but we have been planning on  
getting back to it.

Btw, I'm assuming you know about the project: http://zookeeper.apache.org/bookkeeper/


> ----- Original Message -----
> From: Daniel Gómez Ferro <danielgf@yahoo-inc.com>
> To: "dev@hbase.apache.org" <dev@hbase.apache.org>; "user@hbase.apache.org 
> " <user@hbase.apache.org>
> Cc: Maysam Yabandeh <maysam@yahoo-inc.com>; Flavio Junqueira <fpj@yahoo-inc.com

> >; Benjamin Reed <breed@yahoo-inc.com>; Ivan Kelly <ivank@yahoo-inc.com 
> >
> Sent: Friday, November 4, 2011 4:24 AM
> Subject: Omid: Transactional Support for HBase
> (I apologize for resending but I forgot to add the user list.)
> Hi all,
> It is my pleasure to announce the open source release of Omid, a  
> project whose goal is to add lock-free transactional support on top  
> of HBase. The current release includes CrSO, a client-replicated  
> status oracle that detects the write-write conflicts to provide  
> Snapshot Isolation. CrSO has the following appealing properties:
> 1) It does not need any modification into the HBase code nor the  
> table scheme.
> 2) The overhead on HBase DataNodes is negligible (only after an abort)
> 3) It scales up to 50,000 write transactions per second (TPS) and a  
> thousand of client connections.
> We have setup a github project: https://github.com/dgomezferro/omid
> More information is available at the wiki: https://github.com/dgomezferro/omid/wiki
> If you are interested, installation and running instructions are  
> available on the README: https://github.com/dgomezferro/omid/blob/master/README.md
> Please do not hesitate to contact us in the case of any question.
> Best Regards,
> Daniel Gómez Ferro


research scientist

direct +34 93-183-8828

avinguda diagonal 177, 8th floor, barcelona, 08018, es
phone (408) 349 3300    fax (408) 349 3301

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message