incubator-couchdb-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Peter Somers <petsom...@gmail.com>
Subject Re: Recap: Couchdb crashes on Windows
Date Tue, 28 Sep 2010 14:41:00 GMT
https://issues.apache.org/jira/browse/COUCHDB-897

I hope it's enough, it's my first registration


2010/9/28 Chris Anderson <jchris@apache.org>

> It would definitely be worth putting this information (especially
> about the regression from 0.11) into Jira:
>
> https://issues.apache.org/jira/browse/COUCHDB
>
> The committers don't use much Windows, although we'd love to support
> it completely. If someone were to step up to the plate and make
> Windows a 1st-class citizen of the CouchDB world, thats the sort of
> thing that'd qualify you for consideration as a committer. (I can't
> speak for the group, but I do think this is an overlooked yet crucial
> aspect of getting CouchDB popular).
>
> Chris
>
>
> On Mon, Sep 27, 2010 at 2:06 PM, Peter Somers <petsomers@gmail.com> wrote:
> > I'll be using 0.11.0 for the time being.
> > Thanks!
> >
> > Hopefully a solution is on the way for the latest version of couchdb.
> >
> >
> >
> > 2010/9/27 Juhani Ränkimies <juhani@juranki.com>
> >
> >> I too, was able to reproduce the problem on couchdb 1.0.1, windows 7
> >> (32bit) .
> >>
> >> However, with 0.11.0 (+windows_file_fix_2.patch for compaction and db
> >> deletion, http://github.com/juranki/couchdb/downloads) database size
> >> does grow past 4GB (now 7.5GB and growing).
> >>
> >> -juhani
> >>
> >> On Mon, Sep 27, 2010 at 2:27 PM, Peter Somers <petsomers@gmail.com>
> wrote:
> >> > Thanks Cliff,
> >> >
> >> > At least it is reproducible.
> >> > I hope you can come up with a solution. I don't know Erlang at all.
> >> >
> >> > If it is a limitation in Erlang, we are screwed. If it is a bug in
> >> Couchdb,
> >> > there is hope :-)
> >> >
> >> > Best regards,
> >> >
> >> > Peter
> >> >
> >> >
> >> >
> >> > 2010/9/27 Cliff Williams <cliffywills@aol.com>
> >> >
> >> >>  Peter,
> >> >>
> >> >> I had some time last night so I set up a fresh XP install with the
> >> windows
> >> >> binary from couchone. (I am interested in this since I am looking to
> set
> >> up
> >> >> couch on a number of windows machines.)
> >> >>
> >> >> I set up 5 clients to populate a test database with 2MB documents
> >> >> .......... somewhat regretfully I can reproduce your issue without
> any
> >> >> problems ie at exactly 4GB on a single database, couch falls over.
In
> my
> >> >> case couch will restart but any attempt to access the 4GB database
> will
> >> >> knock it over again.
> >> >>
> >> >> Hopefully I will get some time this evening to dig deeper and write
> some
> >> >> Erlang to find out a bit more.
> >> >>
> >> >> sorry that its not good news.
> >> >>
> >> >> best regards
> >> >>
> >> >> cliff
> >> >>
> >> >>
> >> >> On 27/09/10 09:11, Peter Somers wrote:
> >> >>
> >> >>> Hi all,
> >> >>>
> >> >>> Just to summarize my previous thread, hoping that someone does
know
> the
> >> >>> answer to my problem.
> >> >>> I want to thank everyone that already tried to help me.
> >> >>>
> >> >>> We have been using couchdb on Windows without any problems for
a
> while
> >> now
> >> >>> in dev an test phases.
> >> >>> Couchdb version 1.0.1, Windows 7 64bit.
> >> >>> Database files where always around 2 GB.
> >> >>> Our project enters productions phase, so I tried to load actual
> >> production
> >> >>> data in.
> >> >>> Couchdb always crashes when the database file is exactly 4GB (around
> >> >>> 250,000
> >> >>> different documents)!
> >> >>>
> >> >>>
> >> >>> This is is couchdb's response after 4 GB of data:
> >> >>>
> >> >>> Status code:500
> >> >>>
> >> >>> {"error":"{{badmatch,{error,enomem}},
> >> >>>
> >> >>> [{couch_file,read_raw_iolist_int,3},
> >> >>>
> >> >>> {couch_file,handle_call,3},
> >> >>>
> >> >>>   {gen_server,handle_msg,5},
> >> >>>
> >> >>>
> >> >>>
> >> >>>
> >>
> {proc_lib,init_p_do_apply,3}]}","reason":"{gen_server,call,[<0.19884.5>,{pread_iolist,4294426050},infinity]}"}
> >> >>>
> >> >>> [Sat, 25 Sep 2010 16:59:17 GMT] [error] [<0.227.0>] ** Generic
> server
> >> >>> <0.227.0>  terminating
> >> >>> ** Last message in was {pread_iolist,4294943206}
> >> >>> ** When Server state ==
> >> >>> {file,{file_descriptor,prim_file,{#Port<0.3730>,680}},
> >> >>>                               0,4295016651}
> >> >>> ** Reason for termination ==
> >> >>> ** file_corruption
> >> >>>
> >> >>> After restart, couchdb keeps crashing as long as the 4 GB db file
is
> >> >>> there.
> >> >>>
> >> >>> Possible solutions from the mailing list
> >> >>> -Use NTFS instead of FAT32: I was already using NTFS
> >> >>> -Check file quota settings: quotas management was disabled
> >> >>> I tried to copy a 5 GB file into the DB folder without any problems
> >> >>> -Run couchdb with the erlang console instead of as service: the
same
> >> error
> >> >>> occurs
> >> >>> -It could be an Erlang on Windows problem: I hope it is not, they
> would
> >> >>> not
> >> >>> support Couchdb on Windows if this was the case?
> >> >>>
> >> >>> Windows event log:
> >> >>> This is what I found in the windows event log:
> >> >>>  -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_>
 <Event
> xmlns="*
> >> >>> http://schemas.microsoft.com/win/2004/08/events/event*">
> >> >>>  -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_>
 <System>
> >> >>>
> >> >>>    <Provider Name="*Application Error*" />
> >> >>>    <EventID Qualifiers="*0*">1000</EventID>
> >> >>>    <Level>2</Level>
> >> >>>    <Task>100</Task>
> >> >>>    <Keywords>0x80000000000000</Keywords>
> >> >>>    <TimeCreated SystemTime="*2010-09-24T09:50:57.000000000Z*"
/>
> >> >>>    <EventRecordID>43469</EventRecordID>
> >> >>>    <Channel>Application</Channel>
> >> >>>    <Computer>xxxxxxxx</Computer>
> >> >>>    <Security />
> >> >>>   </System>
> >> >>>  -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_>
 <EventData>
> >> >>>
> >> >>>    <Data>*erl.exe*</Data>
> >> >>>    <Data>0.0.0.0</Data>
> >> >>>    <Data>4c25a0e8</Data>
> >> >>>    <Data>*beam.smp.dll*</Data>
> >> >>>    <Data>0.0.0.0</Data>
> >> >>>    <Data>4c259ee0</Data>
> >> >>>    <Data>40000015</Data>
> >> >>>    <Data>0001062a</Data>
> >> >>>    <Data>4ac</Data>
> >> >>>    <Data>01cb5bcdbb76622e</Data>
> >> >>>    <Data>C:\Program Files (x86)\Apache Software
> >> >>> Foundation\CouchDB\erts-5.8\bin\erl.exe</Data>
> >> >>>
>  <Data>C:\PROGRA~2\APACHE~1\CouchDB\erts-5.8\bin\beam.smp.dll</Data>
> >> >>>    <Data>3a3a07c6-c7c1-11df-a821-c9b233f5989f</Data>
> >> >>>   </EventData>
> >> >>>   </Event>
> >> >>>
> >> >>>
> >> >>> crashdump excerpt:
> >> >>>
> >> >>>
> >>
> https://docs.google.com/Doc?docid=0Ac5wgE-Tye0oZGQ2cjU1Z2tfMThkNjl3Yzdnag&hl=nl&authkey=CJfN2pQJ
> >> >>>
> >> >>>
> >> >>> couchlog excerpt:
> >> >>>
> >> >>>
> >>
> https://docs.google.com/document/edit?id=1K_cWU4bwDSPa0UYxF8mOiAwC7-zhTHhWsigUNZHuQdM&hl=nl&authkey=CPCV9vYC
> >> >>>
> >> >>> To speed up my tests (to get faster to the 4 GB), I tried to upload
> big
> >> >>> attachments (800MB) with futon.
> >> >>> Couchdb always crashes during the upload. This may not be related
to
> >> this
> >> >>> problem.
> >> >>>
> >> >>> Thanks,
> >> >>>
> >> >>> Peter
> >> >>>
> >> >>>
> >> >
> >>
> >>
> >>
> >> --
> >> Juhani Ränkimies
> >> +358 40 762 4323
> >>
> >
>
>
>
> --
> Chris Anderson
> http://jchrisa.net
> http://couch.io
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message