Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (nike.apache.org: local policy)
From: Nils Breunese <N.Breunese@vpro.nl>
To: "user@couchdb.apache.org" <user@couchdb.apache.org>
Date: Sat, 25 Sep 2010 12:19:20 +0200
Subject: RE: Couchdb crashes on Windows
Thread-Topic: Couchdb crashes on Windows
Thread-Index: ActcmYR6aNccd1gwSaWYdUf5+KBJNwAAZmQF
Message-ID: 
 <A9DC438D6CAFFF4BBB29958144440881012018E26B10@VS-EX-01.intra.vpro.nl>
References: <AANLkTi=fy3phwQo1+bis9E=z+1HJR5wTBTK2-skOQ1Z8@mail.gmail.com>
	<A9DC438D6CAFFF4BBB29958144440881012018E26B0F@VS-EX-01.intra.vpro.nl>,<AANLkTinxDxJJAN7qh86Aw2P=vpeOzYB=u4bJgQmg-sHR@mail.gmail.com>
In-Reply-To: <AANLkTinxDxJJAN7qh86Aw2P=vpeOzYB=u4bJgQmg-sHR@mail.gmail.com>
Accept-Language: nl-NL
Content-Language: nl-NL
acceptlanguage: nl-NL
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

I only use Mac OS X and Linux myself, and haven't encountered this 4 GB fil=
e size limitation. I guess this is either a problem with your build or some=
thing Windows specific, I don't know.

Maybe other Windows users can report whether they can successfully grow the=
ir databases larger than 4 GB?

Nils.
________________________________________
Van: Peter Somers [petsomers@gmail.com]
Verzonden: zaterdag 25 september 2010 12:07
Aan: user@couchdb.apache.org
Onderwerp: Re: Couchdb crashes on Windows

Hi Nils,

It is NTFS.

Thanks,
Peter
.

2010/9/25 Nils Breunese <N.Breunese@vpro.nl>

> On what filesystem are the .couch files stored? FAT32 has a 4 GB (-1 byte=
)
> file limit:
>
> "You cannot create a file larger than (2^32)-1 bytes (this is one byte le=
ss
> than 4 GB) on a FAT32 partition."
> http://support.microsoft.com/kb/314463/EN-US/
>
> Nils.
> ________________________________________
> Van: Peter Somers [petsomers@gmail.com]
> Verzonden: zaterdag 25 september 2010 11:30
> Aan: user@couchdb.apache.org
> Onderwerp: Couchdb crashes on Windows
>
> Hi all,
>
> We have been using couchdb on Windows without any problems for a while no=
w
> in dev an test phases.
> Couchdb version 1.0.1, Windows 7 64bit.
> Database files where always around 2 GB.
> Our project enters productions phase, so I tried to load actual productio=
n
> data in.
> Couchdb always crashes when the database file is exactly 4GB (around
> 250,000
> different documents)!
>
>
> This is is couchdb's response after 4 GB of data:
>
> Status code:500
>
> {"error":"{{badmatch,{error,enomem}},
>
> [{couch_file,read_raw_iolist_int,3},
>
> {couch_file,handle_call,3},
>
>  {gen_server,handle_msg,5},
>
>
>
> {proc_lib,init_p_do_apply,3}]}","reason":"{gen_server,call,[<0.19884.5>,{=
pread_iolist,4294426050},infinity]}"}
>
>
> After restart, couchdb keeps crashing as long as the 4 GB db file is ther=
e.
>
> Coucdb logfile:
> [Fri, 24 Sep 2010 13:11:43 GMT] [error] [<0.139.0>] ** Generic server
> <0.139.0> terminating
> ** Last message in was {pread_iolist,4294422001}
> ** When Server state =3D=3D
> {file,{file_descriptor,prim_file,{#Port<0.3710>,692}},
>                              0,4294968642}
> ** Reason for termination =3D=3D
> ** {{badmatch,{ok,<<247,255,106,106,104,2,98,0,8,56,168,104,3,109,0,0,0,3=
3,
>                    91,34,70,111,114,119,97,114,100,101,114,34,44,34,56,56=
,
>   ...
>   ...
>
>
> I noticed the 4 GB limit per document in the config file, but this is per
> document, not for the entire DB?
> Increasing this doesn't help at all.
>
> Deleting the file and trying to load other data in it had exactly the sam=
e
> result after 4GB of data.
> If I compact the database during the load process, more data can go in, b=
ut
> 4GB still is the maximum .couch file size.
>
> Any ideas?
>
> Regards,
> Peter
> ------------------------------------------------------------------------
>  VPRO
>  phone:  +31(0)356712911
>  e-mail: info@vpro.nl
>  web:    www.vpro.nl
> ------------------------------------------------------------------------
>