couchdb-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christopher Lenz (JIRA)" <>
Subject [jira] Updated: (COUCHDB-25) Javascript view on big dataset crashes couchjs?
Date Mon, 24 Mar 2008 22:45:27 GMT


Christopher Lenz updated COUCHDB-25:

    Attachment: issue25.diff

The problem is caused by a hard-coded branch limit in our SpiderMonkey wrapper, which was
added to combat potential memory leaks. As this issue shows, that was a bad idea, as it breaks
creating view indices over large datasets. Doh.

The attached patch removes the branch limit, and also fixes a memory leak in the decoding
of strings in the readline() function. Seems to work nicely here.

> Javascript view on big dataset crashes couchjs?
> -----------------------------------------------
>                 Key: COUCHDB-25
>                 URL:
>             Project: CouchDB
>          Issue Type: Bug
>          Components: JavaScript View Server
>            Reporter: Noah Slater
>            Assignee: Christopher Lenz
>            Priority: Minor
>         Attachments: issue25.diff
> What steps will reproduce the problem?
> Not entirely sure. I have been doing some testing with CouchDB, essentially
> downloading messages from twitter for a few days and dumping them in a
> database. I would attach the DB file, but it's like 120MB big. Then when I
> run a simple view on it, even the simple:
> function(doc) {
>   map(null, doc);  
> }
> I get to see the following messages in the server log. Sometimes it works
> though, so it seems kind of arbitrary:
> -----
> [error] [emulator] Error in process <0.2776.1> with exit value:
> {{nocatch,{map_process_error,{exit_status,0}}},[{couch_query_servers,readline,2},{couch_query_servers,read_json,1},{couch_query_servers,'-map_docs/2-fun-0-',2},{lists,map,2},{lists,map,2},{couch_query_servers,map_docs...
> =ERROR REPORT==== 7-Mar-2008::15:45:48 ===
> Error in process <0.2776.1> with exit value:
> {{nocatch,{map_process_error,{exit_status,0}}},[{couch_query_servers,readline,2},{couch_query_servers,read_json,1},{couch_query_servers,'-map_docs/2-fun-0-',2},{lists,map,2},{lists,map,2},{couch_query_servers,map_docs...
> [info] [<0.2775.1>] HTTP Error (code 500): {obj,[{error,"map_process_error"},
>                              {reason,"{exit_status,0}"}]}
> [info] [<0.2775.1>] HTTP Response Code:500
> -----
> What version of the product are you using? On what operating system?
> This only occurs on the subversion trunk build on Ubuntu Linux 7.10. On the
> current release version it works fine.
> Please provide any additional information below.
> If you want the .couch files with which this happens, let me know.
> --
> Okay, can you make the DB file available somehow and send me a link to it to cmlenz at I think it 
> should compress fairly well BTW.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message