Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 66894 invoked from network); 25 Sep 2010 11:29:15 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 25 Sep 2010 11:29:15 -0000 Received: (qmail 43976 invoked by uid 500); 25 Sep 2010 11:29:14 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 43626 invoked by uid 500); 25 Sep 2010 11:29:11 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 43613 invoked by uid 99); 25 Sep 2010 11:29:09 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Sep 2010 11:29:09 +0000 X-ASF-Spam-Status: No, hits=4.7 required=10.0 tests=FREEMAIL_FROM,FREEMAIL_REPLY,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of cliffywills@aol.com designates 205.188.105.143 as permitted sender) Received: from [205.188.105.143] (HELO imr-da01.mx.aol.com) (205.188.105.143) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Sep 2010 11:29:01 +0000 Received: from mtaout-mb03.r1000.mx.aol.com (mtaout-mb03.r1000.mx.aol.com [172.29.41.67]) by imr-da01.mx.aol.com (8.14.1/8.14.1) with ESMTP id o8PBSaRK020098 for ; Sat, 25 Sep 2010 07:28:36 -0400 Received: from [10.0.0.10] (unknown [92.1.146.206]) by mtaout-mb03.r1000.mx.aol.com (MUA/Third Party Client Interface) with ESMTPA id A8C81E000094 for ; Sat, 25 Sep 2010 07:28:35 -0400 (EDT) Message-ID: <4C9DDCE2.3050307@aol.com> Date: Sat, 25 Sep 2010 12:28:34 +0100 From: Cliff Williams User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.11pre) Gecko/20100922 Shredder/3.1.5pre MIME-Version: 1.0 To: user@couchdb.apache.org Subject: Re: Couchdb crashes on Windows References: In-Reply-To: Content-Type: multipart/alternative; boundary="------------060809070409080706070700" x-aol-global-disposition: G X-AOL-SCOLL-SCORE: 1:2:460557728:93952408 X-AOL-SCOLL-URL_COUNT: 1 x-aol-sid: 3039ac1d29434c9ddce339e2 X-AOL-IP: 92.1.146.206 X-Virus-Checked: Checked by ClamAV on apache.org --------------060809070409080706070700 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Peter, Good afternoon just a hunch on my part, but do you have quotas set up for the user that you are running Couch under?. best regards cliff On 25/09/10 12:00, Peter Somers wrote: > I was able to copy a 5GB file to the same folder as the .couch files resides > without any problems. > This rules out file system limitations or any other system settings. > > This is what I found in the windows event log: > -<#> -<#> > > 1000 > 2 > 100 > 0x80000000000000 > > 43469 > Application > xxxxxxxx > > > -<#> > *erl.exe* > 0.0.0.0 > 4c25a0e8 > *beam.smp.dll* > 0.0.0.0 > 4c259ee0 > 40000015 > 0001062a > 4ac > 01cb5bcdbb76622e > C:\Program Files (x86)\Apache Software > Foundation\CouchDB\erts-5.8\bin\erl.exe > C:\PROGRA~2\APACHE~1\CouchDB\erts-5.8\bin\beam.smp.dll > 3a3a07c6-c7c1-11df-a821-c9b233f5989f > > > > > 2010/9/25 Nils Breunese > >> I only use Mac OS X and Linux myself, and haven't encountered this 4 GB >> file size limitation. I guess this is either a problem with your build or >> something Windows specific, I don't know. >> >> Maybe other Windows users can report whether they can successfully grow >> their databases larger than 4 GB? >> >> Nils. >> ________________________________________ >> Van: Peter Somers [petsomers@gmail.com] >> Verzonden: zaterdag 25 september 2010 12:07 >> Aan: user@couchdb.apache.org >> Onderwerp: Re: Couchdb crashes on Windows >> >> Hi Nils, >> >> It is NTFS. >> >> Thanks, >> Peter >> . >> >> 2010/9/25 Nils Breunese >> >>> On what filesystem are the .couch files stored? FAT32 has a 4 GB (-1 >> byte) >>> file limit: >>> >>> "You cannot create a file larger than (2^32)-1 bytes (this is one byte >> less >>> than 4 GB) on a FAT32 partition." >>> http://support.microsoft.com/kb/314463/EN-US/ >>> >>> Nils. >>> ________________________________________ >>> Van: Peter Somers [petsomers@gmail.com] >>> Verzonden: zaterdag 25 september 2010 11:30 >>> Aan: user@couchdb.apache.org >>> Onderwerp: Couchdb crashes on Windows >>> >>> Hi all, >>> >>> We have been using couchdb on Windows without any problems for a while >> now >>> in dev an test phases. >>> Couchdb version 1.0.1, Windows 7 64bit. >>> Database files where always around 2 GB. >>> Our project enters productions phase, so I tried to load actual >> production >>> data in. >>> Couchdb always crashes when the database file is exactly 4GB (around >>> 250,000 >>> different documents)! >>> >>> >>> This is is couchdb's response after 4 GB of data: >>> >>> Status code:500 >>> >>> {"error":"{{badmatch,{error,enomem}}, >>> >>> [{couch_file,read_raw_iolist_int,3}, >>> >>> {couch_file,handle_call,3}, >>> >>> {gen_server,handle_msg,5}, >>> >>> >>> >>> >> {proc_lib,init_p_do_apply,3}]}","reason":"{gen_server,call,[<0.19884.5>,{pread_iolist,4294426050},infinity]}"} >>> >>> After restart, couchdb keeps crashing as long as the 4 GB db file is >> there. >>> Coucdb logfile: >>> [Fri, 24 Sep 2010 13:11:43 GMT] [error] [<0.139.0>] ** Generic server >>> <0.139.0> terminating >>> ** Last message in was {pread_iolist,4294422001} >>> ** When Server state == >>> {file,{file_descriptor,prim_file,{#Port<0.3710>,692}}, >>> 0,4294968642} >>> ** Reason for termination == >>> ** >> {{badmatch,{ok,<<247,255,106,106,104,2,98,0,8,56,168,104,3,109,0,0,0,33, >> 91,34,70,111,114,119,97,114,100,101,114,34,44,34,56,56, >>> ... >>> ... >>> >>> >>> I noticed the 4 GB limit per document in the config file, but this is per >>> document, not for the entire DB? >>> Increasing this doesn't help at all. >>> >>> Deleting the file and trying to load other data in it had exactly the >> same >>> result after 4GB of data. >>> If I compact the database during the load process, more data can go in, >> but >>> 4GB still is the maximum .couch file size. >>> >>> Any ideas? >>> >>> Regards, >>> Peter >>> ------------------------------------------------------------------------ >>> VPRO >>> phone: +31(0)356712911 >>> e-mail: info@vpro.nl >>> web: www.vpro.nl >>> ------------------------------------------------------------------------ >>> --------------060809070409080706070700--