couchdb-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Juhani Ränkimies <juh...@juranki.com>
Subject Re: Recap: Couchdb crashes on Windows
Date Mon, 27 Sep 2010 17:12:38 GMT
I too, was able to reproduce the problem on couchdb 1.0.1, windows 7 (32bit) .

However, with 0.11.0 (+windows_file_fix_2.patch for compaction and db
deletion, http://github.com/juranki/couchdb/downloads) database size
does grow past 4GB (now 7.5GB and growing).

-juhani

On Mon, Sep 27, 2010 at 2:27 PM, Peter Somers <petsomers@gmail.com> wrote:
> Thanks Cliff,
>
> At least it is reproducible.
> I hope you can come up with a solution. I don't know Erlang at all.
>
> If it is a limitation in Erlang, we are screwed. If it is a bug in Couchdb,
> there is hope :-)
>
> Best regards,
>
> Peter
>
>
>
> 2010/9/27 Cliff Williams <cliffywills@aol.com>
>
>>  Peter,
>>
>> I had some time last night so I set up a fresh XP install with the windows
>> binary from couchone. (I am interested in this since I am looking to set up
>> couch on a number of windows machines.)
>>
>> I set up 5 clients to populate a test database with 2MB documents
>> .......... somewhat regretfully I can reproduce your issue without any
>> problems ie at exactly 4GB on a single database, couch falls over. In my
>> case couch will restart but any attempt to access the 4GB database will
>> knock it over again.
>>
>> Hopefully I will get some time this evening to dig deeper and write some
>> Erlang to find out a bit more.
>>
>> sorry that its not good news.
>>
>> best regards
>>
>> cliff
>>
>>
>> On 27/09/10 09:11, Peter Somers wrote:
>>
>>> Hi all,
>>>
>>> Just to summarize my previous thread, hoping that someone does know the
>>> answer to my problem.
>>> I want to thank everyone that already tried to help me.
>>>
>>> We have been using couchdb on Windows without any problems for a while now
>>> in dev an test phases.
>>> Couchdb version 1.0.1, Windows 7 64bit.
>>> Database files where always around 2 GB.
>>> Our project enters productions phase, so I tried to load actual production
>>> data in.
>>> Couchdb always crashes when the database file is exactly 4GB (around
>>> 250,000
>>> different documents)!
>>>
>>>
>>> This is is couchdb's response after 4 GB of data:
>>>
>>> Status code:500
>>>
>>> {"error":"{{badmatch,{error,enomem}},
>>>
>>> [{couch_file,read_raw_iolist_int,3},
>>>
>>> {couch_file,handle_call,3},
>>>
>>>   {gen_server,handle_msg,5},
>>>
>>>
>>>
>>> {proc_lib,init_p_do_apply,3}]}","reason":"{gen_server,call,[<0.19884.5>,{pread_iolist,4294426050},infinity]}"}
>>>
>>> [Sat, 25 Sep 2010 16:59:17 GMT] [error] [<0.227.0>] ** Generic server
>>> <0.227.0>  terminating
>>> ** Last message in was {pread_iolist,4294943206}
>>> ** When Server state ==
>>> {file,{file_descriptor,prim_file,{#Port<0.3730>,680}},
>>>                               0,4295016651}
>>> ** Reason for termination ==
>>> ** file_corruption
>>>
>>> After restart, couchdb keeps crashing as long as the 4 GB db file is
>>> there.
>>>
>>> Possible solutions from the mailing list
>>> -Use NTFS instead of FAT32: I was already using NTFS
>>> -Check file quota settings: quotas management was disabled
>>> I tried to copy a 5 GB file into the DB folder without any problems
>>> -Run couchdb with the erlang console instead of as service: the same error
>>> occurs
>>> -It could be an Erlang on Windows problem: I hope it is not, they would
>>> not
>>> support Couchdb on Windows if this was the case?
>>>
>>> Windows event log:
>>> This is what I found in the windows event log:
>>>  -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_>  <Event
xmlns="*
>>> http://schemas.microsoft.com/win/2004/08/events/event*">
>>>  -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_>  <System>
>>>
>>>    <Provider Name="*Application Error*" />
>>>    <EventID Qualifiers="*0*">1000</EventID>
>>>    <Level>2</Level>
>>>    <Task>100</Task>
>>>    <Keywords>0x80000000000000</Keywords>
>>>    <TimeCreated SystemTime="*2010-09-24T09:50:57.000000000Z*" />
>>>    <EventRecordID>43469</EventRecordID>
>>>    <Channel>Application</Channel>
>>>    <Computer>xxxxxxxx</Computer>
>>>    <Security />
>>>   </System>
>>>  -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_>  <EventData>
>>>
>>>    <Data>*erl.exe*</Data>
>>>    <Data>0.0.0.0</Data>
>>>    <Data>4c25a0e8</Data>
>>>    <Data>*beam.smp.dll*</Data>
>>>    <Data>0.0.0.0</Data>
>>>    <Data>4c259ee0</Data>
>>>    <Data>40000015</Data>
>>>    <Data>0001062a</Data>
>>>    <Data>4ac</Data>
>>>    <Data>01cb5bcdbb76622e</Data>
>>>    <Data>C:\Program Files (x86)\Apache Software
>>> Foundation\CouchDB\erts-5.8\bin\erl.exe</Data>
>>>    <Data>C:\PROGRA~2\APACHE~1\CouchDB\erts-5.8\bin\beam.smp.dll</Data>
>>>    <Data>3a3a07c6-c7c1-11df-a821-c9b233f5989f</Data>
>>>   </EventData>
>>>   </Event>
>>>
>>>
>>> crashdump excerpt:
>>>
>>> https://docs.google.com/Doc?docid=0Ac5wgE-Tye0oZGQ2cjU1Z2tfMThkNjl3Yzdnag&hl=nl&authkey=CJfN2pQJ
>>>
>>>
>>> couchlog excerpt:
>>>
>>> https://docs.google.com/document/edit?id=1K_cWU4bwDSPa0UYxF8mOiAwC7-zhTHhWsigUNZHuQdM&hl=nl&authkey=CPCV9vYC
>>>
>>> To speed up my tests (to get faster to the 4 GB), I tried to upload big
>>> attachments (800MB) with futon.
>>> Couchdb always crashes during the upload. This may not be related to this
>>> problem.
>>>
>>> Thanks,
>>>
>>> Peter
>>>
>>>
>



-- 
Juhani Ränkimies
+358 40 762 4323

Mime
View raw message