Return-Path: Delivered-To: apmail-couchdb-dev-archive@www.apache.org Received: (qmail 71268 invoked from network); 19 Apr 2010 19:49:39 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 19 Apr 2010 19:49:39 -0000 Received: (qmail 53936 invoked by uid 500); 19 Apr 2010 19:49:38 -0000 Delivered-To: apmail-couchdb-dev-archive@couchdb.apache.org Received: (qmail 53869 invoked by uid 500); 19 Apr 2010 19:49:38 -0000 Mailing-List: contact dev-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@couchdb.apache.org Delivered-To: mailing list dev@couchdb.apache.org Received: (qmail 53858 invoked by uid 99); 19 Apr 2010 19:49:37 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Apr 2010 19:49:37 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of randall.leeds@gmail.com designates 209.85.160.52 as permitted sender) Received: from [209.85.160.52] (HELO mail-pw0-f52.google.com) (209.85.160.52) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Apr 2010 19:49:31 +0000 Received: by pwi1 with SMTP id 1so3495022pwi.11 for ; Mon, 19 Apr 2010 12:49:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:received:message-id:subject:from:to:content-type; bh=yXm4K09pJjdSUxqHrnVPcLhDany7JEaA+y1WvcLnl8Y=; b=oGboPSI5cd/vCn3JlyNVhkQRzmqkOO+JedfMd4EFOfIFmn1MTaUSJ2WMquX/nMjcnX DHFSfYih70dppkMlwz+lZVfk6qrBv+XDP9YbCf1mTa/nJLEqVQ8nAIbxeye+3USE2Dbt acfHCv+BMg0X32G6hqjXtklcURlwGOtIDNufo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=NEsc55pQ4K9nCZ3EPD1wFu2y/C+VEGXEd7ed5+mt1feTDGL1Z922hVw9UkUTfQzmBl /WbHMYxPjqYn376yjntN1LKiVKQJTPQ/HX/hVdBmNyf1Fu6kepX6AJmqH8DLeSMml4ji Y58NdioljfJNkVN/POoHLpai68aBy7zu/oGuM= MIME-Version: 1.0 Received: by 10.231.145.82 with HTTP; Mon, 19 Apr 2010 12:49:08 -0700 (PDT) Received: by 10.231.145.82 with HTTP; Mon, 19 Apr 2010 12:49:08 -0700 (PDT) In-Reply-To: References: <4EDCD199-A285-4510-B8F0-E6030BA9553D@apache.org> Date: Mon, 19 Apr 2010 20:49:08 +0100 Received: by 10.141.14.3 with SMTP id r3mr4774130rvi.28.1271706549292; Mon, 19 Apr 2010 12:49:09 -0700 (PDT) Message-ID: Subject: Re: Idea for View & Bulk Insert combination for ad-hoc database changes From: Randall Leeds To: dev@couchdb.apache.org Content-Type: multipart/alternative; boundary=000e0cd1170a210d5304849c417c X-Virus-Checked: Checked by ClamAV on apache.org --000e0cd1170a210d5304849c417c Content-Type: text/plain; charset=UTF-8 Ad-hoc db-wide transformations suddenly strike me as a generic form of the compactor. The compactor is an identity update function. It achieves a full scan of the db by putting results in a new .couch file. It runs until it has caught up to the tail of the current file (using a changes listener) and then swaps the files. I believe a good patch here is one that creates a code path the compactor can share. The side bonus is that this implementation is transactional. On Apr 19, 2010 2:51 PM, "Martin Murphy" wrote: I agree. Some format of bulk changes needs to be integrated into futon before the masses will adopt. On Mon, Apr 19, 2010 at 1:21 PM, Michael Genereux wrote: > Thanks! Okay, I need to reread "_changes" and the "all_or_nothing" on > the bulk_api. Also "Document Update Handlers" was way too complicated > and wanted a record id for what I was looking to do. I have a CouchDB > database holding a log and I want to chuck old data easily. Losing > quick manipulation when switching to CouchDB seems like a barrier of > entry. I don't know of any situation where I haven't used SQL > (database), sed (ascii document), or other ad hoc concepts to > manipulate records/files/documents. > > Thanks for the feedback and it was expedient so thanks for that too. > > On Mon, Apr 19, 2010 at 9:45 AM, J Chris Anderson > wrote: > > > > On Apr 18... -- Martin Murphy Whiteboard-it (205) 910-0720 --000e0cd1170a210d5304849c417c--