couchdb-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tuyen Tran <itu...@gmail.com>
Subject View generation checkpointing on every update
Date Fri, 16 Jul 2010 05:22:18 GMT
We have a view that is checkpointing on every update and taking a long time to generate.

Here are the particulars:

* small database, only about 2500 documents. View takes 3+ minutes to generate.
* each document is pretty big, at about 300K, with 1000s of fields. Each field  though only
contains a small amount of data. A pretty print of the document JSON comes out to around 7000
lines.
* view is in its own design document
* no reduce, only the simplest of map functions:

function(doc) {
  emit(doc.hXML.form.dispositionDecision['#text'], null);
}

* CouchdDB 1.0 (Mac CouchDBx). I've also tried it on 0.10, and 0.10 checkpoints once every
10-15 updates, but it's not much faster.

The CouchDB 1.0 log shows:

...
1> [info] [<0.19698.3>] checkpointing view update at seq 1699 for test _temp
1> [info] [<0.19698.3>] checkpointing view update at seq 1700 for test _temp
1> [info] [<0.19698.3>] checkpointing view update at seq 1701 for test _temp
1> [info] [<0.19698.3>] checkpointing view update at seq 1702 for test _temp
1> [info] [<0.19698.3>] checkpointing view update at seq 1703 for test _temp
1> [info] [<0.19698.3>] checkpointing view update at seq 1704 for test _temp
1> [info] [<0.19698.3>] checkpointing view update at seq 1705 for test _temp
...

These log entries fly by at 10/second or so, never missing a sequence number.

Has anyone seen similar performance? Are my documents too big with too many fields?

Thanks,
-T






Mime
View raw message