incubator-couchdb-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Cliff Williams <cliffywi...@aol.com>
Subject Re: Couchdb crashes on Windows
Date Sat, 25 Sep 2010 11:28:34 GMT
  Peter,

Good afternoon

just a hunch on my part, but do you have quotas set up for the user that 
you are running Couch under?.

best regards

cliff

On 25/09/10 12:00, Peter Somers wrote:
> I was able to copy a 5GB file to the same folder as the .couch files resides
> without any problems.
> This rules out file system limitations or any other system settings.
>
> This is what I found in the windows event log:
> -<#>  <Event xmlns="*http://schemas.microsoft.com/win/2004/08/events/event*"
>   -<#>  <System>
>     <Provider Name="*Application Error*" />
>     <EventID Qualifiers="*0*">1000</EventID>
>     <Level>2</Level>
>     <Task>100</Task>
>     <Keywords>0x80000000000000</Keywords>
>     <TimeCreated SystemTime="*2010-09-24T09:50:57.000000000Z*" />
>     <EventRecordID>43469</EventRecordID>
>     <Channel>Application</Channel>
>     <Computer>xxxxxxxx</Computer>
>     <Security />
>    </System>
>   -<#>  <EventData>
>     <Data>*erl.exe*</Data>
>     <Data>0.0.0.0</Data>
>     <Data>4c25a0e8</Data>
>     <Data>*beam.smp.dll*</Data>
>     <Data>0.0.0.0</Data>
>     <Data>4c259ee0</Data>
>     <Data>40000015</Data>
>     <Data>0001062a</Data>
>     <Data>4ac</Data>
>     <Data>01cb5bcdbb76622e</Data>
>     <Data>C:\Program Files (x86)\Apache Software
> Foundation\CouchDB\erts-5.8\bin\erl.exe</Data>
>     <Data>C:\PROGRA~2\APACHE~1\CouchDB\erts-5.8\bin\beam.smp.dll</Data>
>     <Data>3a3a07c6-c7c1-11df-a821-c9b233f5989f</Data>
>    </EventData>
>    </Event>
>
>
> 2010/9/25 Nils Breunese<N.Breunese@vpro.nl>
>
>> I only use Mac OS X and Linux myself, and haven't encountered this 4 GB
>> file size limitation. I guess this is either a problem with your build or
>> something Windows specific, I don't know.
>>
>> Maybe other Windows users can report whether they can successfully grow
>> their databases larger than 4 GB?
>>
>> Nils.
>> ________________________________________
>> Van: Peter Somers [petsomers@gmail.com]
>> Verzonden: zaterdag 25 september 2010 12:07
>> Aan: user@couchdb.apache.org
>> Onderwerp: Re: Couchdb crashes on Windows
>>
>> Hi Nils,
>>
>> It is NTFS.
>>
>> Thanks,
>> Peter
>> .
>>
>> 2010/9/25 Nils Breunese<N.Breunese@vpro.nl>
>>
>>> On what filesystem are the .couch files stored? FAT32 has a 4 GB (-1
>> byte)
>>> file limit:
>>>
>>> "You cannot create a file larger than (2^32)-1 bytes (this is one byte
>> less
>>> than 4 GB) on a FAT32 partition."
>>> http://support.microsoft.com/kb/314463/EN-US/
>>>
>>> Nils.
>>> ________________________________________
>>> Van: Peter Somers [petsomers@gmail.com]
>>> Verzonden: zaterdag 25 september 2010 11:30
>>> Aan: user@couchdb.apache.org
>>> Onderwerp: Couchdb crashes on Windows
>>>
>>> Hi all,
>>>
>>> We have been using couchdb on Windows without any problems for a while
>> now
>>> in dev an test phases.
>>> Couchdb version 1.0.1, Windows 7 64bit.
>>> Database files where always around 2 GB.
>>> Our project enters productions phase, so I tried to load actual
>> production
>>> data in.
>>> Couchdb always crashes when the database file is exactly 4GB (around
>>> 250,000
>>> different documents)!
>>>
>>>
>>> This is is couchdb's response after 4 GB of data:
>>>
>>> Status code:500
>>>
>>> {"error":"{{badmatch,{error,enomem}},
>>>
>>> [{couch_file,read_raw_iolist_int,3},
>>>
>>> {couch_file,handle_call,3},
>>>
>>>   {gen_server,handle_msg,5},
>>>
>>>
>>>
>>>
>> {proc_lib,init_p_do_apply,3}]}","reason":"{gen_server,call,[<0.19884.5>,{pread_iolist,4294426050},infinity]}"}
>>>
>>> After restart, couchdb keeps crashing as long as the 4 GB db file is
>> there.
>>> Coucdb logfile:
>>> [Fri, 24 Sep 2010 13:11:43 GMT] [error] [<0.139.0>] ** Generic server
>>> <0.139.0>  terminating
>>> ** Last message in was {pread_iolist,4294422001}
>>> ** When Server state ==
>>> {file,{file_descriptor,prim_file,{#Port<0.3710>,692}},
>>>                               0,4294968642}
>>> ** Reason for termination ==
>>> **
>> {{badmatch,{ok,<<247,255,106,106,104,2,98,0,8,56,168,104,3,109,0,0,0,33,
>>   91,34,70,111,114,119,97,114,100,101,114,34,44,34,56,56,
>>>    ...
>>>    ...
>>>
>>>
>>> I noticed the 4 GB limit per document in the config file, but this is per
>>> document, not for the entire DB?
>>> Increasing this doesn't help at all.
>>>
>>> Deleting the file and trying to load other data in it had exactly the
>> same
>>> result after 4GB of data.
>>> If I compact the database during the load process, more data can go in,
>> but
>>> 4GB still is the maximum .couch file size.
>>>
>>> Any ideas?
>>>
>>> Regards,
>>> Peter
>>> ------------------------------------------------------------------------
>>>   VPRO
>>>   phone:  +31(0)356712911
>>>   e-mail: info@vpro.nl
>>>   web:    www.vpro.nl
>>> ------------------------------------------------------------------------
>>>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message