couchdb-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From magnetpest2k5 <grittyg...@gmail.com>
Subject Re: python couchdb data collection stops
Date Mon, 21 Nov 2011 18:01:24 GMT
Thanks,

I am not a database guy I dont know much about couchdb either. But from what
I have found on the web is that each data base can go up to 7.5 GB with
512000, correct me if I am wrong. With that as threshold the couchdb stops
some time at 0.6gb, some time it goes till 3.8 gb. 

As mentioned in my previous post I use couchdb to store twitter data. I am
sure that the python program does not halt with any exception, the program
keeps running I confirmed this by stopping the storage to couchdb database
and instead storing the output in a CSV format. I found no problem in the
python program. But when I started storing the python dictionary in couchdb
I found that though the program keeps running the storage in couchdb has
stopped. 

I dont know what is happening in log but by just seeing I can find these
lines. I am storing the data on a database called "worldtweets4". Following
are few lines of log where the problem might be as you can see the storage
had stopped I dont get any more 'PUT" /databasename/ID.

Mon, 21 Nov 2011 14:57:35 GMT] [info] [<0.17870.56>] 127.0.0.1 - - 'PUT'
/worldtweets4/69084bd085994bc7b60ec8f586c69d8f 201 

[Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.27616.57>] 127.0.0.1 - - 'GET'
/_all_dbs 200 

[Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.23293.57>] 127.0.0.1 - - 'GET'
/_session 200 

[Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.27615.57>] 127.0.0.1 - - 'GET' /
200 

[Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.27617.57>] 127.0.0.1 - - 'GET'
/newdb/ 200 

[Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.27617.57>] 127.0.0.1 - - 'GET'
/worldtweets4/ 200 

[Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.23293.57>] 127.0.0.1 - - 'GET'
/worldtweets3/ 200 

[Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.27616.57>] 127.0.0.1 - - 'GET'
/_users/ 200

This same sequence gets repeated and then some where i get the following

[Mon, 21 Nov 2011 15:59:02 GMT] [info] [<0.28139.57>] 127.0.0.1 - - 'GET'
/worldtweets4/_all_docs?startkey=%22_design%2F%22&endkey=%22_design0%22&include_docs=true
200 

[Mon, 21 Nov 2011 15:59:02 GMT] [info] [<0.28140.57>] 127.0.0.1 - - 'GET'
/_config/query_servers/ 200 

[Mon, 21 Nov 2011 15:59:02 GMT] [info] [<0.27620.57>] 127.0.0.1 - - 'GET'
/worldtweets4/_all_docs?limit=11&descending=true 200

 
Do you want me to fill this issue as ticket? in the link you have provided?

Any help is greatly appreciated

--
View this message in context: http://couchdb-development.1959287.n2.nabble.com/python-couchdb-data-collection-stops-tp7015488p7017272.html
Sent from the CouchDB Development mailing list archive at Nabble.com.

Mime
View raw message