Return-Path: X-Original-To: apmail-zookeeper-user-archive@www.apache.org Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 88B36805F for ; Thu, 1 Sep 2011 21:24:05 +0000 (UTC) Received: (qmail 51103 invoked by uid 500); 1 Sep 2011 21:24:05 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 51041 invoked by uid 500); 1 Sep 2011 21:24:04 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 51033 invoked by uid 99); 1 Sep 2011 21:24:04 -0000 Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Sep 2011 21:24:04 +0000 Received: from localhost (HELO mail-ew0-f42.google.com) (127.0.0.1) (smtp-auth username breed, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Sep 2011 21:24:04 +0000 Received: by ewy2 with SMTP id 2so1554268ewy.15 for ; Thu, 01 Sep 2011 14:24:02 -0700 (PDT) MIME-Version: 1.0 Received: by 10.213.21.194 with SMTP id k2mr170536ebb.53.1314912242094; Thu, 01 Sep 2011 14:24:02 -0700 (PDT) Received: by 10.213.32.142 with HTTP; Thu, 1 Sep 2011 14:24:02 -0700 (PDT) In-Reply-To: References: Date: Thu, 1 Sep 2011 14:24:02 -0700 Message-ID: Subject: Re: Recovery log on /dev/shm? From: Benjamin Reed To: user@zookeeper.apache.org Content-Type: text/plain; charset=ISO-8859-1 have you benchmarked the difference between using the ram disk and turning off sync with forceSync=no? i would think that the performance will be similar. you will need to use the code in trunk because https://issues.apache.org/jira/browse/ZOOKEEPER-1087 isn't in any of the releases yet. thanx ben On Thu, Sep 1, 2011 at 1:31 PM, Ashwin Jayaprakash wrote: > This is a follow up to a question I posted in July 2010 - about whether the > recovery log could be redirected to /dev/null or some such low latency drive > [http://markmail.org/thread/3edpfmvn2fhyg5wv]. > > I just found out that Linux distros with 2.6 kernel have a built-in shared > memory file system that runs purely in memory - /dev/shm. Since this > provides recovery across JVM restarts (but not OS restarts) wouldn't this be > sufficient to run the ZK nodes off this drive? Replicas are on other > machines anyway so FT/HA is already there. It's just that disk latency can > be eliminated completely. > > [Apologies if you guys are already aware of /dev/shm] > > I ran some simple Java IO tests (not full ZK) on this drive and I wanted to > share my results. Might be of some use to apps that require low latency: > http://javaforu.blogspot.com/2011/09/ram-disk-is-already-in-linux-and-nobody.html > > Ashwin. >