Return-Path: X-Original-To: apmail-bookkeeper-user-archive@www.apache.org Delivered-To: apmail-bookkeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2A90D188C7 for ; Tue, 26 Jan 2016 07:09:58 +0000 (UTC) Received: (qmail 61177 invoked by uid 500); 26 Jan 2016 07:09:58 -0000 Delivered-To: apmail-bookkeeper-user-archive@bookkeeper.apache.org Received: (qmail 61130 invoked by uid 500); 26 Jan 2016 07:09:58 -0000 Mailing-List: contact user-help@bookkeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@bookkeeper.apache.org Delivered-To: mailing list user@bookkeeper.apache.org Received: (qmail 61120 invoked by uid 99); 26 Jan 2016 07:09:57 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 26 Jan 2016 07:09:57 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 83A2A180427 for ; Tue, 26 Jan 2016 07:09:57 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.879 X-Spam-Level: ** X-Spam-Status: No, score=2.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id QsLi_R8lFEb3 for ; Tue, 26 Jan 2016 07:09:56 +0000 (UTC) Received: from mail-lf0-f42.google.com (mail-lf0-f42.google.com [209.85.215.42]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id C5D5420974 for ; Tue, 26 Jan 2016 07:09:55 +0000 (UTC) Received: by mail-lf0-f42.google.com with SMTP id m198so99245226lfm.0 for ; Mon, 25 Jan 2016 23:09:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :content-type; bh=eig9FeLCvX75gn1xLr75U90jW72daKi0QwB3Z52EQbc=; b=i1xLYWdv9JGNcm6LwP5htRgBvNFVZ5cqS6Lm0LRWyxzujtBXP0QH0fcxFER19GDFus dJFZSgEcJBdmcCRGA4owH5pacNcYBz+EoQIDepaUq0f17cMethQ4xr3Rh+ulnP59QZ1B OTgv7SeKFo5Ev+WWqA+vRcIzpsAwmyL69DADxGA4iq/9GhafC05XWNJWH1W1y8WUt7PQ YZjjytUcDRzyRkkVnV2wef+6zlwGZSDuXIG3Q3gHANgHGWnRaKVYpAiYloegfxGsiJjT zMAZPYQ1BZSpk+ui4FKrYnfWiOkpsfAPzQHWHfVVUUFmYSn1nlX63ri7Q5izj2bqmBT3 SUmg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:content-type; bh=eig9FeLCvX75gn1xLr75U90jW72daKi0QwB3Z52EQbc=; b=J4ZTGUu/4WmV0me/PoBW3Snjgaic4nGlaXe6DkoFdpgjI3G3rwCdrD7FSvxkO4MtxU oULUA+LU5gxtSVfW3rOlGwNUrfgIXMRwsnTTLlaMs6VxBErkiljcPT71fsdJAg8ROTXN CUyKBJpDBqU9dopKPMpWshrhP+goMnd1jkh9GThW/o1VdYyFflCiIj/DUwa9lh1CmMVO xncAjKKJ33Tzob+7/PRmtwfxSUcNevr+8iDTUoQckFVZnXyAlcdRRTeBmZITbAOdVCf+ 384hr5WiQ9nrzwxhhnh5Xiren2vRRSUC9TKLQNTJNzKNV1GslGclrOfVE9pkDp1In3mO 4i2g== X-Gm-Message-State: AG10YOSrgN/bjaLVvseZOFnTp6sPfQMp5gnwicyZcb4R3QfFi2Biq+KJkqOFjUORrLrx7QFbqHVgc8YyBZ4yjA== X-Received: by 10.25.20.218 with SMTP id 87mr7950456lfu.148.1453792187704; Mon, 25 Jan 2016 23:09:47 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Enrico Olivelli Date: Tue, 26 Jan 2016 07:09:35 +0000 Message-ID: Subject: Re: Distributed key valute store using bookkeeper To: user@bookkeeper.apache.org Content-Type: multipart/alternative; boundary=001a113fc2f4eceabb052a375edd --001a113fc2f4eceabb052a375edd Content-Type: text/plain; charset=UTF-8 Thank you. I was looking something like HBase but more simple and embeddable in a JVM. My use case is the following: I have a service actually implemented as a group of JVM which in turn use a shared traditional Sql database like Mysql. I do not want an external storage engine but I would like that data can be managed by the service jvms themselves which can be added to the cluster dynamically. One advantage in having an embedded storage is that a single machine installation can be setup by only installing the JVM program. Actually we use H2 for this scenario but it cannot be used in production. Even for this single instance case we need at least a Mysql db which is really a burden for installers and for maintenance. The second advantage is to have a storage that can be expanded very simply by adding service machines to the cluster. My typical cluster size is no more that 10 machines due to the nature of the service. We are already using bookkeeper as core low level service for our business and I hoped that something was already available. Thanks -- Enrico Il giorno Lun 25 Gen 2016 21:20 Sijie Guo ha scritto: > Twitter Manhattan is using distributedlog (built upon bookkeeper) for > strong consistent operations. > > > https://blog.twitter.com/2014/manhattan-our-real-time-multi-tenant-distributed-database-for-twitter-scale > > https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service > > I think Yahoo has similar usage. > > Other than that, I am not aware about any open sourced production-quality > key/value store that built upon bookkeeper. > > - Sijie > > > > On Mon, Jan 25, 2016 at 11:54 AM, Enrico Olivelli > wrote: > >> Hi, do you know any production quality key value store built upon >> bookkeeper? >> >> -- Enrico >> > > --001a113fc2f4eceabb052a375edd Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Thank you. I was looking something like HBase but more simple and embeddabl= e in a JVM.=C2=A0
My use case is the following:
I have a serv= ice actually implemented as a group of JVM which in turn use a shared tradi= tional Sql database like Mysql.
=C2=A0I do not want an external s= torage engine but I would like that data can be managed by the service jvms= themselves which can =C2=A0be added to the cluster dynamically.
= One advantage in having an embedded storage is that a single machine instal= lation can be setup by only installing the JVM program. Actually we use H2 = for this scenario but it cannot be used in production. Even for this single= instance case we need at least a Mysql db which is really a burden for ins= tallers and for maintenance.=C2=A0
The second advantage is to hav= e a storage that can be expanded very simply by adding service machines to = the cluster.
My typical cluster size is no more that 10 machines = due to the nature of the service.

We are already u= sing bookkeeper as core low level service for our business and I hoped that= something was already available.

Thanks
-- Enrico


Il giorno Lun 25 Gen 2016 21:20=C2=A0Sijie Guo <sijie@apache.org> ha scritto:
Other than that, I am not aware= about any open sourced production-quality key/value store that built upon = bookkeeper.

- Sijie
=



On Mon, Jan 25, 2016 at 11:54 AM, Enrico Olivelli <eoliv= elli@gmail.com> wrote:
Hi, = do you know any =C2=A0production quality key value store built upon bookkee= per?

-- Enrico

--001a113fc2f4eceabb052a375edd--