incubator-couchdb-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nils Breunese <N.Breun...@vpro.nl>
Subject RE: Couchdb crashes on Windows
Date Sat, 25 Sep 2010 10:00:11 GMT
On what filesystem are the .couch files stored? FAT32 has a 4 GB (-1 byte) file limit:

"You cannot create a file larger than (2^32)-1 bytes (this is one byte less than 4 GB) on
a FAT32 partition."
http://support.microsoft.com/kb/314463/EN-US/

Nils.
________________________________________
Van: Peter Somers [petsomers@gmail.com]
Verzonden: zaterdag 25 september 2010 11:30
Aan: user@couchdb.apache.org
Onderwerp: Couchdb crashes on Windows

Hi all,

We have been using couchdb on Windows without any problems for a while now
in dev an test phases.
Couchdb version 1.0.1, Windows 7 64bit.
Database files where always around 2 GB.
Our project enters productions phase, so I tried to load actual production
data in.
Couchdb always crashes when the database file is exactly 4GB (around 250,000
different documents)!


This is is couchdb's response after 4 GB of data:

Status code:500

{"error":"{{badmatch,{error,enomem}},

[{couch_file,read_raw_iolist_int,3},

{couch_file,handle_call,3},

  {gen_server,handle_msg,5},


{proc_lib,init_p_do_apply,3}]}","reason":"{gen_server,call,[<0.19884.5>,{pread_iolist,4294426050},infinity]}"}


After restart, couchdb keeps crashing as long as the 4 GB db file is there.

Coucdb logfile:
[Fri, 24 Sep 2010 13:11:43 GMT] [error] [<0.139.0>] ** Generic server
<0.139.0> terminating
** Last message in was {pread_iolist,4294422001}
** When Server state ==
{file,{file_descriptor,prim_file,{#Port<0.3710>,692}},
                              0,4294968642}
** Reason for termination ==
** {{badmatch,{ok,<<247,255,106,106,104,2,98,0,8,56,168,104,3,109,0,0,0,33,
                    91,34,70,111,114,119,97,114,100,101,114,34,44,34,56,56,
   ...
   ...


I noticed the 4 GB limit per document in the config file, but this is per
document, not for the entire DB?
Increasing this doesn't help at all.

Deleting the file and trying to load other data in it had exactly the same
result after 4GB of data.
If I compact the database during the load process, more data can go in, but
4GB still is the maximum .couch file size.

Any ideas?

Regards,
Peter
------------------------------------------------------------------------
 VPRO
 phone:  +31(0)356712911
 e-mail: info@vpro.nl
 web:    www.vpro.nl
------------------------------------------------------------------------

Mime
View raw message