Return-Path: Delivered-To: apmail-incubator-couchdb-dev-archive@locus.apache.org Received: (qmail 4035 invoked from network); 3 Jul 2008 08:13:50 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 3 Jul 2008 08:13:50 -0000 Received: (qmail 69589 invoked by uid 500); 3 Jul 2008 08:13:51 -0000 Delivered-To: apmail-incubator-couchdb-dev-archive@incubator.apache.org Received: (qmail 69416 invoked by uid 500); 3 Jul 2008 08:13:50 -0000 Mailing-List: contact couchdb-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: couchdb-dev@incubator.apache.org Delivered-To: mailing list couchdb-dev@incubator.apache.org Received: (qmail 69405 invoked by uid 99); 3 Jul 2008 08:13:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Jul 2008 01:13:50 -0700 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: 83.97.50.139 is neither permitted nor denied by domain of jan@apache.org) Received: from [83.97.50.139] (HELO jan.prima.de) (83.97.50.139) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Jul 2008 08:12:59 +0000 Received: from [10.0.2.3] (e179134136.adsl.alicedsl.de [::ffff:85.179.134.136]) (AUTH: LOGIN jan, SSL: TLSv1/SSLv3,128bits,AES128-SHA) by jan.prima.de with esmtp; Thu, 03 Jul 2008 08:07:16 +0000 Message-Id: From: Jan Lehnardt To: couchdb-dev@incubator.apache.org In-Reply-To: <8E98828E-CAEF-49A2-9647-600BAD328ED4@gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed; delsp=yes Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Apple Message framework v919.2) Subject: Re: Custom file driver for OS X and Windows Re: CouchDB 0.9 and 1.0 Date: Thu, 3 Jul 2008 10:07:15 +0200 References: <7D76E702-4BB8-42FD-8704-9E8BA70F95BC@apache.org> <8E98828E-CAEF-49A2-9647-600BAD328ED4@gmail.com> X-Mailer: Apple Mail (2.919.2) X-Virus-Checked: Checked by ClamAV on apache.org On Jul 2, 2008, at 19:01, Damien Katz wrote: > So erlang still has some file driver troubles. The old issue of a =20 > 2gig limit is long gone, however two other issues remain: > > Erlangs built-in file api for disk sync/flush doesn't work on all =20 > platforms. The main two that I know where it doesn't work are =20 > windows (at least it didn't when a looked over a year ago) and OS X =20= > (perhaps other BSDs?). On OS X, the fix seems to be as simple as =20 > passing the F_FULLFSYNC flag to fcntl. Without this disk sync, there =20= > is no way CouchDB can safely store data. This means we either need =20 > the Erlang folks to fix their drivers, or create our own file driver =20= > for the problem platforms. Blech. > > Windows has the same fsync problem, plus it also doesn't pass the =20 > flags to sallow the renaming of our own open files, needed during =20 > file compaction. Again there can be fixed in core Erlang, or our own =20= > drivers. I have forwarded this to the Erlang folks to get their insight on this =20= issue. I feel the only sensible way to fix this is to fix the file driver. -- On a related note: At the Erlang eXchange last week I talked to Klacke Wikstr=F6m (the author of (d)ets, mnesia, the IO system and a lot of = more parts of core Erlang) and he mentioned a product of his where they bypass the Erlang file driver for speed reasons completely. I don't think this is relevant for us now, but we might want to keep in mind that want to do the same eventually. Cheers Jan -- > > > On Jul 2, 2008, at 3:08 AM, Jan Lehnardt wrote: > >> Hello everybody, >> this thread is meant to collect missing work items (features and >> bugs) for for our 1.0 release and a discussion about how to split >> them up between 0.9 and 1.0. >> >> Take it away: Damien. >> >> Cheers >> Jan >> -- > >