incubator-couchdb-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nils Breunese <N.Breun...@vpro.nl>
Subject RE: Recap: Couchdb crashes on Windows
Date Mon, 27 Sep 2010 11:41:15 GMT
Could be just some build configuration for Erlang on Windows. I don't have any experience with
building Erland, especially not on Windows, but it could be just some 32-bit limitation in
the Erlang build that is being used. CouchDB is certainly able to handle files larger than
4 GB, at least on Unix-like platforms.

Nils.
________________________________________
Van: Peter Somers [petsomers@gmail.com]
Verzonden: maandag 27 september 2010 13:27
Aan: user@couchdb.apache.org
Onderwerp: Re: Recap: Couchdb crashes on Windows

Thanks Cliff,

At least it is reproducible.
I hope you can come up with a solution. I don't know Erlang at all.

If it is a limitation in Erlang, we are screwed. If it is a bug in Couchdb,
there is hope :-)

Best regards,

Peter



2010/9/27 Cliff Williams <cliffywills@aol.com>

>  Peter,
>
> I had some time last night so I set up a fresh XP install with the windows
> binary from couchone. (I am interested in this since I am looking to set up
> couch on a number of windows machines.)
>
> I set up 5 clients to populate a test database with 2MB documents
> .......... somewhat regretfully I can reproduce your issue without any
> problems ie at exactly 4GB on a single database, couch falls over. In my
> case couch will restart but any attempt to access the 4GB database will
> knock it over again.
>
> Hopefully I will get some time this evening to dig deeper and write some
> Erlang to find out a bit more.
>
> sorry that its not good news.
>
> best regards
>
> cliff
>
>
> On 27/09/10 09:11, Peter Somers wrote:
>
>> Hi all,
>>
>> Just to summarize my previous thread, hoping that someone does know the
>> answer to my problem.
>> I want to thank everyone that already tried to help me.
>>
>> We have been using couchdb on Windows without any problems for a while now
>> in dev an test phases.
>> Couchdb version 1.0.1, Windows 7 64bit.
>> Database files where always around 2 GB.
>> Our project enters productions phase, so I tried to load actual production
>> data in.
>> Couchdb always crashes when the database file is exactly 4GB (around
>> 250,000
>> different documents)!
>>
>>
>> This is is couchdb's response after 4 GB of data:
>>
>> Status code:500
>>
>> {"error":"{{badmatch,{error,enomem}},
>>
>> [{couch_file,read_raw_iolist_int,3},
>>
>> {couch_file,handle_call,3},
>>
>>   {gen_server,handle_msg,5},
>>
>>
>>
>> {proc_lib,init_p_do_apply,3}]}","reason":"{gen_server,call,[<0.19884.5>,{pread_iolist,4294426050},infinity]}"}
>>
>> [Sat, 25 Sep 2010 16:59:17 GMT] [error] [<0.227.0>] ** Generic server
>> <0.227.0>  terminating
>> ** Last message in was {pread_iolist,4294943206}
>> ** When Server state ==
>> {file,{file_descriptor,prim_file,{#Port<0.3730>,680}},
>>                               0,4295016651}
>> ** Reason for termination ==
>> ** file_corruption
>>
>> After restart, couchdb keeps crashing as long as the 4 GB db file is
>> there.
>>
>> Possible solutions from the mailing list
>> -Use NTFS instead of FAT32: I was already using NTFS
>> -Check file quota settings: quotas management was disabled
>> I tried to copy a 5 GB file into the DB folder without any problems
>> -Run couchdb with the erlang console instead of as service: the same error
>> occurs
>> -It could be an Erlang on Windows problem: I hope it is not, they would
>> not
>> support Couchdb on Windows if this was the case?
>>
>> Windows event log:
>> This is what I found in the windows event log:
>>  -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_>  <Event xmlns="*
>> http://schemas.microsoft.com/win/2004/08/events/event*">
>>  -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_>  <System>
>>
>>    <Provider Name="*Application Error*" />
>>    <EventID Qualifiers="*0*">1000</EventID>
>>    <Level>2</Level>
>>    <Task>100</Task>
>>    <Keywords>0x80000000000000</Keywords>
>>    <TimeCreated SystemTime="*2010-09-24T09:50:57.000000000Z*" />
>>    <EventRecordID>43469</EventRecordID>
>>    <Channel>Application</Channel>
>>    <Computer>xxxxxxxx</Computer>
>>    <Security />
>>   </System>
>>  -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_>  <EventData>
>>
>>    <Data>*erl.exe*</Data>
>>    <Data>0.0.0.0</Data>
>>    <Data>4c25a0e8</Data>
>>    <Data>*beam.smp.dll*</Data>
>>    <Data>0.0.0.0</Data>
>>    <Data>4c259ee0</Data>
>>    <Data>40000015</Data>
>>    <Data>0001062a</Data>
>>    <Data>4ac</Data>
>>    <Data>01cb5bcdbb76622e</Data>
>>    <Data>C:\Program Files (x86)\Apache Software
>> Foundation\CouchDB\erts-5.8\bin\erl.exe</Data>
>>    <Data>C:\PROGRA~2\APACHE~1\CouchDB\erts-5.8\bin\beam.smp.dll</Data>
>>    <Data>3a3a07c6-c7c1-11df-a821-c9b233f5989f</Data>
>>   </EventData>
>>   </Event>
>>
>>
>> crashdump excerpt:
>>
>> https://docs.google.com/Doc?docid=0Ac5wgE-Tye0oZGQ2cjU1Z2tfMThkNjl3Yzdnag&hl=nl&authkey=CJfN2pQJ
>>
>>
>> couchlog excerpt:
>>
>> https://docs.google.com/document/edit?id=1K_cWU4bwDSPa0UYxF8mOiAwC7-zhTHhWsigUNZHuQdM&hl=nl&authkey=CPCV9vYC
>>
>> To speed up my tests (to get faster to the 4 GB), I tried to upload big
>> attachments (800MB) with futon.
>> Couchdb always crashes during the upload. This may not be related to this
>> problem.
>>
>> Thanks,
>>
>> Peter
>>
>>
------------------------------------------------------------------------
 VPRO
 phone:  +31(0)356712911
 e-mail: info@vpro.nl
 web:    www.vpro.nl
------------------------------------------------------------------------

Mime
View raw message