hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lars hofhansl <la...@apache.org>
Subject Re: Haeinsa: linear scalable multi-row transaction library for HBase
Date Thu, 10 Oct 2013 17:59:58 GMT
Thanks Andrew.

This sounds very interesting!
Will definitely have a look.

-- Lars
________________________________
From: Myungbo Kim <mbkim@vcnc.co.kr>
To: user@hbase.apache.org 
Cc: Jung-Haeng Lee <james@vcnc.co.kr>; YoungMok Kim <brad@vcnc.co.kr> 
Sent: Wednesday, October 9, 2013 10:55 PM
Subject: Haeinsa: linear scalable multi-row transaction library for HBase


Hello everyone in the mailing list.

I want to introduce an open-source library Haeinsa which supports multi-row, multi-table transaction
on HBase.
Haeinsa is client-only library that support serializability and linear scalability. 
Here is the github repository and presentation that describes mechanism of it.

github : https://github.com/VCNC/haeinsa
presentation : https://speakerdeck.com/vcnc/haeinsa-overview

It was inspired by Google's percolator, but implementation detail is different.
It use two-phase commit protocol and optimistic concurrency control to implement, and Haeinsa
now processes more than 300M+ transactions per day in single cluster without any consistency
problem for more than 2 month.  
I know that there has been lots of libraries and papers for HBase transaction, but within
my knowledge, this is the only open-source library which support serializability and linear
scalability. 
There is no theoretical limit of transaction throughput.
It was tested against cluster on AWS until 40,000 transaction/sec. (Still testing on bigger
cluster) 
If you find it interesting, please leave me comment. 

Thanks,
Andrew Kim 

Mime
View raw message