couchdb-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Peter Somers <petsom...@gmail.com>
Subject Re: Couchdb crashes on Windows
Date Sat, 25 Sep 2010 11:00:55 GMT
I was able to copy a 5GB file to the same folder as the .couch files resides
without any problems.
This rules out file system limitations or any other system settings.

This is what I found in the windows event log:
- <#> <Event xmlns="*http://schemas.microsoft.com/win/2004/08/events/event*"
>
 - <#> <System>
   <Provider Name="*Application Error*" />
   <EventID Qualifiers="*0*">1000</EventID>
   <Level>2</Level>
   <Task>100</Task>
   <Keywords>0x80000000000000</Keywords>
   <TimeCreated SystemTime="*2010-09-24T09:50:57.000000000Z*" />
   <EventRecordID>43469</EventRecordID>
   <Channel>Application</Channel>
   <Computer>xxxxxxxx</Computer>
   <Security />
  </System>
 - <#> <EventData>
   <Data>*erl.exe*</Data>
   <Data>0.0.0.0</Data>
   <Data>4c25a0e8</Data>
   <Data>*beam.smp.dll*</Data>
   <Data>0.0.0.0</Data>
   <Data>4c259ee0</Data>
   <Data>40000015</Data>
   <Data>0001062a</Data>
   <Data>4ac</Data>
   <Data>01cb5bcdbb76622e</Data>
   <Data>C:\Program Files (x86)\Apache Software
Foundation\CouchDB\erts-5.8\bin\erl.exe</Data>
   <Data>C:\PROGRA~2\APACHE~1\CouchDB\erts-5.8\bin\beam.smp.dll</Data>
   <Data>3a3a07c6-c7c1-11df-a821-c9b233f5989f</Data>
  </EventData>
  </Event>


2010/9/25 Nils Breunese <N.Breunese@vpro.nl>

> I only use Mac OS X and Linux myself, and haven't encountered this 4 GB
> file size limitation. I guess this is either a problem with your build or
> something Windows specific, I don't know.
>
> Maybe other Windows users can report whether they can successfully grow
> their databases larger than 4 GB?
>
> Nils.
> ________________________________________
> Van: Peter Somers [petsomers@gmail.com]
> Verzonden: zaterdag 25 september 2010 12:07
> Aan: user@couchdb.apache.org
> Onderwerp: Re: Couchdb crashes on Windows
>
> Hi Nils,
>
> It is NTFS.
>
> Thanks,
> Peter
> .
>
> 2010/9/25 Nils Breunese <N.Breunese@vpro.nl>
>
> > On what filesystem are the .couch files stored? FAT32 has a 4 GB (-1
> byte)
> > file limit:
> >
> > "You cannot create a file larger than (2^32)-1 bytes (this is one byte
> less
> > than 4 GB) on a FAT32 partition."
> > http://support.microsoft.com/kb/314463/EN-US/
> >
> > Nils.
> > ________________________________________
> > Van: Peter Somers [petsomers@gmail.com]
> > Verzonden: zaterdag 25 september 2010 11:30
> > Aan: user@couchdb.apache.org
> > Onderwerp: Couchdb crashes on Windows
> >
> > Hi all,
> >
> > We have been using couchdb on Windows without any problems for a while
> now
> > in dev an test phases.
> > Couchdb version 1.0.1, Windows 7 64bit.
> > Database files where always around 2 GB.
> > Our project enters productions phase, so I tried to load actual
> production
> > data in.
> > Couchdb always crashes when the database file is exactly 4GB (around
> > 250,000
> > different documents)!
> >
> >
> > This is is couchdb's response after 4 GB of data:
> >
> > Status code:500
> >
> > {"error":"{{badmatch,{error,enomem}},
> >
> > [{couch_file,read_raw_iolist_int,3},
> >
> > {couch_file,handle_call,3},
> >
> >  {gen_server,handle_msg,5},
> >
> >
> >
> >
> {proc_lib,init_p_do_apply,3}]}","reason":"{gen_server,call,[<0.19884.5>,{pread_iolist,4294426050},infinity]}"}
> >
> >
> > After restart, couchdb keeps crashing as long as the 4 GB db file is
> there.
> >
> > Coucdb logfile:
> > [Fri, 24 Sep 2010 13:11:43 GMT] [error] [<0.139.0>] ** Generic server
> > <0.139.0> terminating
> > ** Last message in was {pread_iolist,4294422001}
> > ** When Server state ==
> > {file,{file_descriptor,prim_file,{#Port<0.3710>,692}},
> >                              0,4294968642}
> > ** Reason for termination ==
> > **
> {{badmatch,{ok,<<247,255,106,106,104,2,98,0,8,56,168,104,3,109,0,0,0,33,
> >
>  91,34,70,111,114,119,97,114,100,101,114,34,44,34,56,56,
> >   ...
> >   ...
> >
> >
> > I noticed the 4 GB limit per document in the config file, but this is per
> > document, not for the entire DB?
> > Increasing this doesn't help at all.
> >
> > Deleting the file and trying to load other data in it had exactly the
> same
> > result after 4GB of data.
> > If I compact the database during the load process, more data can go in,
> but
> > 4GB still is the maximum .couch file size.
> >
> > Any ideas?
> >
> > Regards,
> > Peter
> > ------------------------------------------------------------------------
> >  VPRO
> >  phone:  +31(0)356712911
> >  e-mail: info@vpro.nl
> >  web:    www.vpro.nl
> > ------------------------------------------------------------------------
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message