Mailing-List: contact dev-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@couchdb.apache.org
Received-SPF: pass (nike.apache.org: domain of randall.leeds@gmail.com
 designates 209.85.216.52 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=AU9tF6IML4ie3JIJWQpB2XqQOkac+TWy9yunXFNe7mn46kSkFBfeVPhN+aaRMu9b08
         4Iptr3qP+OfRb9UUuO2xCTTp8+ub1JlRgQ9rC+AW/V4ESwy/9zEyQV1M7MAvdRanoozL
         sIHS6Z0Xc2xegfAEC1wD95jWqTo7rS9+NhbfU=
MIME-Version: 1.0
In-Reply-To: <AANLkTinEZgrANCQOW4gCWVOU-GzZZzpttEuyK_xWBpwn@mail.gmail.com>
References: <8385F758-360B-425A-ACBD-03C898BFDA21@apache.org>
	<AANLkTik-b7ZRLh+mb1BhgupAEAGQ049o5F5AwPPVT3Qn@mail.gmail.com>
	<AANLkTikeG6apE8MNwwse26yHy1s4BiT_7vN-YqxKGWsS@mail.gmail.com>
	<AANLkTi=zPAbNxXv1J4D2WHjKQLCH_pD9pn0BvHs+jsaw@mail.gmail.com>
	<AANLkTim9md-HC+akByb7s3-QDUMvgY+L5UVbhqRJbyvg@mail.gmail.com>
	<AANLkTimcx+YVM3V9yWx3LrkBxoK-OjpkCpcFEz=p=QRv@mail.gmail.com>
	<AANLkTimQLCOR-=+VKEaRn86Zjfm_J3DVWvbAikUBM9Eh@mail.gmail.com>
	<AANLkTim-eGpRF6VSy7mLNZEMLUeN53CmtqRHtG_DSRt3@mail.gmail.com>
	<AANLkTincLdjDtZC8gD4_Xkk0XJNpO5aurnDCLQgc3=ik@mail.gmail.com>
	<1690416A-4C01-4756-9D3B-A256DC729813@apache.org>
	<154AD543-C787-441C-851B-D59CEA6765CC@apache.org>
	<5F47BBB4-9F58-4EFE-92C8-B0FEDA5B01B7@apache.org>
	<AANLkTimK-S_5uoBtq5Dmoy5iuH7RnZXs-XYsnntbDb=P@mail.gmail.com>
	<AANLkTikKEaMi=kdVKPjsqDpvwsMG7L8EvkM7xuNywvrM@mail.gmail.com>
	<AANLkTikqYQYrogoFLR8Sh0SOe1EjvJP=yRck698A=_kH@mail.gmail.com>
	<AANLkTikhWnQUr7-Hi+0aMdF5aT082-u-NZWvXK4bZ_KQ@mail.gmail.com>
	<AANLkTinEZgrANCQOW4gCWVOU-GzZZzpttEuyK_xWBpwn@mail.gmail.com>
Date: Tue, 10 Aug 2010 03:04:28 -0700
Message-ID: <AANLkTikaTLk=VaUGyFvnEe8EfeJhqMR+VJPEVZPh-E-v@mail.gmail.com>
Subject: Re: data recovery tool progress
From: Randall Leeds <randall.leeds@gmail.com>
To: dev@couchdb.apache.org
Content-Type: text/plain; charset=UTF-8

I just pushed some more changes to my branch at
http://github.com/tilgovi/couchdb/tree/db_repair

At this point the algorithm is parallelized to configurable degree
(right now defined as ?WORKERS at the top).
On testwritesdb it seems to stop around 32M of written docs but the
process keeps working for a long time after (I didn't let it finish).
I suspect this is due to having found all (or most of all) of our
documents by descending from the roots we've already seen. It could
also be that Adam's term checking code doesn't quite catch all the
cases where terms are split over block boundary markers.

Sleep time.

Randall