Return-Path: X-Original-To: apmail-couchdb-dev-archive@www.apache.org Delivered-To: apmail-couchdb-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F209B75EC for ; Mon, 21 Nov 2011 18:24:18 +0000 (UTC) Received: (qmail 45400 invoked by uid 500); 21 Nov 2011 18:24:18 -0000 Delivered-To: apmail-couchdb-dev-archive@couchdb.apache.org Received: (qmail 45319 invoked by uid 500); 21 Nov 2011 18:24:18 -0000 Mailing-List: contact dev-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@couchdb.apache.org Delivered-To: mailing list dev@couchdb.apache.org Delivered-To: moderator for dev@couchdb.apache.org Received: (qmail 13049 invoked by uid 99); 21 Nov 2011 18:01:52 -0000 X-ASF-Spam-Status: No, hits=2.0 required=5.0 tests=FREEMAIL_FROM,SPF_NEUTRAL,URI_HEX X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: 216.139.236.26 is neither permitted nor denied by domain of grittygeek@gmail.com) Date: Mon, 21 Nov 2011 10:01:24 -0800 (PST) From: magnetpest2k5 To: dev@couchdb.apache.org Message-ID: <1321898484785-7017272.post@n2.nabble.com> In-Reply-To: References: <1321856067694-7015488.post@n2.nabble.com> Subject: Re: python couchdb data collection stops MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Thanks, I am not a database guy I dont know much about couchdb either. But from what I have found on the web is that each data base can go up to 7.5 GB with 512000, correct me if I am wrong. With that as threshold the couchdb stops some time at 0.6gb, some time it goes till 3.8 gb. As mentioned in my previous post I use couchdb to store twitter data. I am sure that the python program does not halt with any exception, the program keeps running I confirmed this by stopping the storage to couchdb database and instead storing the output in a CSV format. I found no problem in the python program. But when I started storing the python dictionary in couchdb I found that though the program keeps running the storage in couchdb has stopped. I dont know what is happening in log but by just seeing I can find these lines. I am storing the data on a database called "worldtweets4". Following are few lines of log where the problem might be as you can see the storage had stopped I dont get any more 'PUT" /databasename/ID. Mon, 21 Nov 2011 14:57:35 GMT] [info] [<0.17870.56>] 127.0.0.1 - - 'PUT' /worldtweets4/69084bd085994bc7b60ec8f586c69d8f 201 [Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.27616.57>] 127.0.0.1 - - 'GET' /_all_dbs 200 [Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.23293.57>] 127.0.0.1 - - 'GET' /_session 200 [Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.27615.57>] 127.0.0.1 - - 'GET' / 200 [Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.27617.57>] 127.0.0.1 - - 'GET' /newdb/ 200 [Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.27617.57>] 127.0.0.1 - - 'GET' /worldtweets4/ 200 [Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.23293.57>] 127.0.0.1 - - 'GET' /worldtweets3/ 200 [Mon, 21 Nov 2011 15:50:29 GMT] [info] [<0.27616.57>] 127.0.0.1 - - 'GET' /_users/ 200 This same sequence gets repeated and then some where i get the following [Mon, 21 Nov 2011 15:59:02 GMT] [info] [<0.28139.57>] 127.0.0.1 - - 'GET' /worldtweets4/_all_docs?startkey=%22_design%2F%22&endkey=%22_design0%22&include_docs=true 200 [Mon, 21 Nov 2011 15:59:02 GMT] [info] [<0.28140.57>] 127.0.0.1 - - 'GET' /_config/query_servers/ 200 [Mon, 21 Nov 2011 15:59:02 GMT] [info] [<0.27620.57>] 127.0.0.1 - - 'GET' /worldtweets4/_all_docs?limit=11&descending=true 200 Do you want me to fill this issue as ticket? in the link you have provided? Any help is greatly appreciated -- View this message in context: http://couchdb-development.1959287.n2.nabble.com/python-couchdb-data-collection-stops-tp7015488p7017272.html Sent from the CouchDB Development mailing list archive at Nabble.com.