incubator-couchdb-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Anderson <jch...@apache.org>
Subject Re: Recap: Couchdb crashes on Windows
Date Tue, 28 Sep 2010 00:36:49 GMT
It would definitely be worth putting this information (especially
about the regression from 0.11) into Jira:

https://issues.apache.org/jira/browse/COUCHDB

The committers don't use much Windows, although we'd love to support
it completely. If someone were to step up to the plate and make
Windows a 1st-class citizen of the CouchDB world, thats the sort of
thing that'd qualify you for consideration as a committer. (I can't
speak for the group, but I do think this is an overlooked yet crucial
aspect of getting CouchDB popular).

Chris


On Mon, Sep 27, 2010 at 2:06 PM, Peter Somers <petsomers@gmail.com> wrote:
> I'll be using 0.11.0 for the time being.
> Thanks!
>
> Hopefully a solution is on the way for the latest version of couchdb.
>
>
>
> 2010/9/27 Juhani Ränkimies <juhani@juranki.com>
>
>> I too, was able to reproduce the problem on couchdb 1.0.1, windows 7
>> (32bit) .
>>
>> However, with 0.11.0 (+windows_file_fix_2.patch for compaction and db
>> deletion, http://github.com/juranki/couchdb/downloads) database size
>> does grow past 4GB (now 7.5GB and growing).
>>
>> -juhani
>>
>> On Mon, Sep 27, 2010 at 2:27 PM, Peter Somers <petsomers@gmail.com> wrote:
>> > Thanks Cliff,
>> >
>> > At least it is reproducible.
>> > I hope you can come up with a solution. I don't know Erlang at all.
>> >
>> > If it is a limitation in Erlang, we are screwed. If it is a bug in
>> Couchdb,
>> > there is hope :-)
>> >
>> > Best regards,
>> >
>> > Peter
>> >
>> >
>> >
>> > 2010/9/27 Cliff Williams <cliffywills@aol.com>
>> >
>> >>  Peter,
>> >>
>> >> I had some time last night so I set up a fresh XP install with the
>> windows
>> >> binary from couchone. (I am interested in this since I am looking to set
>> up
>> >> couch on a number of windows machines.)
>> >>
>> >> I set up 5 clients to populate a test database with 2MB documents
>> >> .......... somewhat regretfully I can reproduce your issue without any
>> >> problems ie at exactly 4GB on a single database, couch falls over. In my
>> >> case couch will restart but any attempt to access the 4GB database will
>> >> knock it over again.
>> >>
>> >> Hopefully I will get some time this evening to dig deeper and write some
>> >> Erlang to find out a bit more.
>> >>
>> >> sorry that its not good news.
>> >>
>> >> best regards
>> >>
>> >> cliff
>> >>
>> >>
>> >> On 27/09/10 09:11, Peter Somers wrote:
>> >>
>> >>> Hi all,
>> >>>
>> >>> Just to summarize my previous thread, hoping that someone does know
the
>> >>> answer to my problem.
>> >>> I want to thank everyone that already tried to help me.
>> >>>
>> >>> We have been using couchdb on Windows without any problems for a while
>> now
>> >>> in dev an test phases.
>> >>> Couchdb version 1.0.1, Windows 7 64bit.
>> >>> Database files where always around 2 GB.
>> >>> Our project enters productions phase, so I tried to load actual
>> production
>> >>> data in.
>> >>> Couchdb always crashes when the database file is exactly 4GB (around
>> >>> 250,000
>> >>> different documents)!
>> >>>
>> >>>
>> >>> This is is couchdb's response after 4 GB of data:
>> >>>
>> >>> Status code:500
>> >>>
>> >>> {"error":"{{badmatch,{error,enomem}},
>> >>>
>> >>> [{couch_file,read_raw_iolist_int,3},
>> >>>
>> >>> {couch_file,handle_call,3},
>> >>>
>> >>>   {gen_server,handle_msg,5},
>> >>>
>> >>>
>> >>>
>> >>>
>> {proc_lib,init_p_do_apply,3}]}","reason":"{gen_server,call,[<0.19884.5>,{pread_iolist,4294426050},infinity]}"}
>> >>>
>> >>> [Sat, 25 Sep 2010 16:59:17 GMT] [error] [<0.227.0>] ** Generic
server
>> >>> <0.227.0>  terminating
>> >>> ** Last message in was {pread_iolist,4294943206}
>> >>> ** When Server state ==
>> >>> {file,{file_descriptor,prim_file,{#Port<0.3730>,680}},
>> >>>                               0,4295016651}
>> >>> ** Reason for termination ==
>> >>> ** file_corruption
>> >>>
>> >>> After restart, couchdb keeps crashing as long as the 4 GB db file is
>> >>> there.
>> >>>
>> >>> Possible solutions from the mailing list
>> >>> -Use NTFS instead of FAT32: I was already using NTFS
>> >>> -Check file quota settings: quotas management was disabled
>> >>> I tried to copy a 5 GB file into the DB folder without any problems
>> >>> -Run couchdb with the erlang console instead of as service: the same
>> error
>> >>> occurs
>> >>> -It could be an Erlang on Windows problem: I hope it is not, they would
>> >>> not
>> >>> support Couchdb on Windows if this was the case?
>> >>>
>> >>> Windows event log:
>> >>> This is what I found in the windows event log:
>> >>>  -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_>
 <Event xmlns="*
>> >>> http://schemas.microsoft.com/win/2004/08/events/event*">
>> >>>  -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_>
 <System>
>> >>>
>> >>>    <Provider Name="*Application Error*" />
>> >>>    <EventID Qualifiers="*0*">1000</EventID>
>> >>>    <Level>2</Level>
>> >>>    <Task>100</Task>
>> >>>    <Keywords>0x80000000000000</Keywords>
>> >>>    <TimeCreated SystemTime="*2010-09-24T09:50:57.000000000Z*" />
>> >>>    <EventRecordID>43469</EventRecordID>
>> >>>    <Channel>Application</Channel>
>> >>>    <Computer>xxxxxxxx</Computer>
>> >>>    <Security />
>> >>>   </System>
>> >>>  -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_>
 <EventData>
>> >>>
>> >>>    <Data>*erl.exe*</Data>
>> >>>    <Data>0.0.0.0</Data>
>> >>>    <Data>4c25a0e8</Data>
>> >>>    <Data>*beam.smp.dll*</Data>
>> >>>    <Data>0.0.0.0</Data>
>> >>>    <Data>4c259ee0</Data>
>> >>>    <Data>40000015</Data>
>> >>>    <Data>0001062a</Data>
>> >>>    <Data>4ac</Data>
>> >>>    <Data>01cb5bcdbb76622e</Data>
>> >>>    <Data>C:\Program Files (x86)\Apache Software
>> >>> Foundation\CouchDB\erts-5.8\bin\erl.exe</Data>
>> >>>    <Data>C:\PROGRA~2\APACHE~1\CouchDB\erts-5.8\bin\beam.smp.dll</Data>
>> >>>    <Data>3a3a07c6-c7c1-11df-a821-c9b233f5989f</Data>
>> >>>   </EventData>
>> >>>   </Event>
>> >>>
>> >>>
>> >>> crashdump excerpt:
>> >>>
>> >>>
>> https://docs.google.com/Doc?docid=0Ac5wgE-Tye0oZGQ2cjU1Z2tfMThkNjl3Yzdnag&hl=nl&authkey=CJfN2pQJ
>> >>>
>> >>>
>> >>> couchlog excerpt:
>> >>>
>> >>>
>> https://docs.google.com/document/edit?id=1K_cWU4bwDSPa0UYxF8mOiAwC7-zhTHhWsigUNZHuQdM&hl=nl&authkey=CPCV9vYC
>> >>>
>> >>> To speed up my tests (to get faster to the 4 GB), I tried to upload
big
>> >>> attachments (800MB) with futon.
>> >>> Couchdb always crashes during the upload. This may not be related to
>> this
>> >>> problem.
>> >>>
>> >>> Thanks,
>> >>>
>> >>> Peter
>> >>>
>> >>>
>> >
>>
>>
>>
>> --
>> Juhani Ränkimies
>> +358 40 762 4323
>>
>



-- 
Chris Anderson
http://jchrisa.net
http://couch.io

Mime
View raw message