couchdb-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David Orrell (JIRA)" <>
Subject [jira] Created: (COUCHDB-964) Large memory usage downloading attachements
Date Thu, 25 Nov 2010 10:59:14 GMT
Large memory usage downloading attachements

                 Key: COUCHDB-964
             Project: CouchDB
          Issue Type: Bug
          Components: HTTP Interface
    Affects Versions: 1.0.1
         Environment: Linux, Erlang R14B
            Reporter: David Orrell

When downloading a large attachment the CouchDB process appears to load the entire attachment
in memory before data is sent to the client. I have a 1.5 GB attachment and the CouchDB process
grows by approximately this amount per client connection.

For example (as reported by Bram Nejit):
dd if=/dev/urandom of=/tmp/test.bin count=50000 bs=10240
Put test.bin as an attachment in a coucdb database
for i in {0..50};do curl http://localhost:5984/[test
database]/[doc_id]/test.bin > /dev/null 2>&1 & done

This will create 50 curl processes which download from your couchdb. Looking at the memory
consumption of couchdb, it seems like it is loading large parts of the file into memory.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message