Mailing-List: contact dev-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@couchdb.apache.org
Received-SPF: pass (nike.apache.org: domain of fdmanana@gmail.com designates
 209.85.213.180 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:content-type;
        b=dTgOyIJI6HrnCWYUcwm2WC8iL2XWoazaTrhbWhtc4EDCLCMRmBF4tUgY1oR5ZJe3LP
         Oqrb04hDUpomofKaJVrrf32BoqBMGI8WLn1MgPlQS7/Cj4gObD0Cwk5mro6u4L2uu4rh
         WwRPKxKPADwVd1v7WDxpW1LlQT8oJ/Q6nay9c=
MIME-Version: 1.0
Sender: fdmanana@gmail.com
In-Reply-To: <AANLkTi=zPAbNxXv1J4D2WHjKQLCH_pD9pn0BvHs+jsaw@mail.gmail.com>
References: <8385F758-360B-425A-ACBD-03C898BFDA21@apache.org>
	<AANLkTik-b7ZRLh+mb1BhgupAEAGQ049o5F5AwPPVT3Qn@mail.gmail.com>
	<AANLkTikeG6apE8MNwwse26yHy1s4BiT_7vN-YqxKGWsS@mail.gmail.com>
	<AANLkTi=zPAbNxXv1J4D2WHjKQLCH_pD9pn0BvHs+jsaw@mail.gmail.com>
Date: Mon, 9 Aug 2010 19:53:07 +0100
Message-ID: <AANLkTim9md-HC+akByb7s3-QDUMvgY+L5UVbhqRJbyvg@mail.gmail.com>
Subject: Re: data recovery tool progress
From: Filipe David Manana <fdmanana@apache.org>
To: dev@couchdb.apache.org
Content-Type: multipart/alternative; boundary=000e0cd676a802fd4d048d68877f

--000e0cd676a802fd4d048d68877f
Content-Type: text/plain; charset=UTF-8

For the record (and people not on IRC), the code at:

http://github.com/fdmanana/couchdb/commits/db_repair

is working for at least simple cases. Use
couch_db_repair:repair(DbNameAsString).
There's one TODO:  update the reduce values for the by_seq and by_id BTrees.

If anyone wants to give some help on this, your welcome.

On Mon, Aug 9, 2010 at 6:12 PM, Mikeal Rogers <mikeal.rogers@gmail.com>wrote:

> I'm starting to create a bunch of test db files that expose this bug under
> different conditions like multiple restarts, across compaction, variances
> in
> updates the might cause conflict, etc.
>
> http://github.com/mikeal/couchtest
>
> The README outlines what was done to the db's and what needs to be
> recovered.
>
> -Mikeal
>
> On Mon, Aug 9, 2010 at 9:33 AM, Filipe David Manana <fdmanana@apache.org
> >wrote:
>
> > On Mon, Aug 9, 2010 at 5:22 PM, Robert Newson <robert.newson@gmail.com
> > >wrote:
> >
> > > Doesn't this bit;
> > >
> > > -        Db#db{waiting_delayed_commit=nil};
> > > +        Db;
> > > +        % Db#db{waiting_delayed_commit=nil};
> > >
> > > revert the bug fix?
> > >
> >
> > That's intentional, for my local testing.
> > That patch isn't obviously anything close to final, it's too experimental
> > yet.
> >
> > >
> > > B.
> > >
> > > On Mon, Aug 9, 2010 at 5:09 PM, Jan Lehnardt <jan@apache.org> wrote:
> > > > Hi All,
> > > >
> > > > Filipe jumped in to start working on the recovery tool, but he isn't
> > done
> > > yet.
> > > >
> > > > Here's the current patch:
> > > >
> > > > http://www.friendpaste.com/4uMngrym4r7Zz4R0ThSHbz
> > > >
> > > > it is not done and very early, but any help on this is greatly
> > > appreciated.
> > > >
> > > > The current state is (in Filipe's words):
> > > >  - i can detect that a file needs repair
> > > >  - and get the last btree roots from it
> > > >  - "only" missing: get last db seq num
> > > >  - write new header
> > > >  - and deal with the local docs btree (if exists)
> > > >
> > > > Thanks!
> > > > Jan
> > > > --
> > > >
> > > >
> > >
> >
> >
> >
> > --
> > Filipe David Manana,
> > fdmanana@apache.org
> >
> > "Reasonable men adapt themselves to the world.
> >  Unreasonable men adapt the world to themselves.
> >  That's why all progress depends on unreasonable men."
> >
>


-- 
Filipe David Manana,
fdmanana@apache.org

"Reasonable men adapt themselves to the world.
 Unreasonable men adapt the world to themselves.
 That's why all progress depends on unreasonable men."

--000e0cd676a802fd4d048d68877f--