Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (nike.apache.org: domain of Will.Perry@microsoft.com
 designates 207.46.163.206 as permitted sender)
From: Will Perry <Will.Perry@microsoft.com>
To: "user@couchdb.apache.org" <user@couchdb.apache.org>
Subject: RE: view_duplicate_id chaos
Thread-Topic: view_duplicate_id chaos
Thread-Index: AQHO4kaK1C5TSMnDpE6knS1PQLLxhpomz0YAgAACv0CAAB6XgIAAAqKQ
Date: Fri, 15 Nov 2013 23:39:49 +0000
Message-ID: 
 <09599584dbc6446cb33e45313946e61b@BLUPR03MB150.namprd03.prod.outlook.com>
References: 
 <9abf6d17bb994256b4e31064499eb87adfe430998c1240bb93756ee7796d6ee6@BLUPR03MB150.namprd03.prod.outlook.com>
	<CAGxYWpacx+d5NoYYQOsisqxN9xsS6WqnzGBjA3nBMzuycF7o-Q@mail.gmail.com>
	<4edb711538014126bccbabbb1f11f7fa@BLUPR03MB150.namprd03.prod.outlook.com>
 <CABvT1DFNprZFF4cF5hZL-oHy=4bC7BEtkyX3LRgS+PB_X6mfQA@mail.gmail.com>
In-Reply-To: 
 <CABvT1DFNprZFF4cF5hZL-oHy=4bC7BEtkyX3LRgS+PB_X6mfQA@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Awesome - thanks for the hint.

I'll give this a go over the weekend and let you know how it goes.

Cheers,

Will

-----Original Message-----
From: Robert Newson [mailto:rnewson@apache.org]=20
Sent: Friday, November 15, 2013 3:30 PM
To: user@couchdb.apache.org
Subject: Re: view_duplicate_id chaos

This is a bug fixed many releases ago, you need to compact your database, t=
hen delete your .view files and rebuild them. The release notes at the time=
 explained the procedure. I believe this is
COUCHDB-968 / COUCHDB-999.

https://issues.apache.org/jira/browse/COUCHDB-968

https://issues.apache.org/jira/browse/COUCHDB-999

B.

On 15 November 2013 21:44, Will Perry <Will.Perry@microsoft.com> wrote:
> I'm wondering how duplicate doc ids could have got there, tho- how is it =
even possible for 2 docs to have the same id? Shouldn't the second PUT resu=
lt in a 409?
>
> If the error message is correct (and lets just assume that it is) then=20
> we have duplicate doc ids. While we can delete and rebuild the views,=20
> this takes about 8 hours and isn't something we can afford to be doing=20
> continuously in production :)
>
> I'd like to try and figure out the root cause for this problem and try to=
 apply a fix to prevent it occurring again in the future - any pointers?
>
> Cheers,
>
> Will
>
> -----Original Message-----
> From: Tim Tisdall [mailto:tisdall@gmail.com]
> Sent: Friday, November 15, 2013 1:31 PM
> To: user@couchdb.apache.org
> Subject: Re: view_duplicate_id chaos
>
> Do you have duplicate doc ids in your data??
>
> I think the view is just corrupted and needs to be deleted and recreated =
from scratch.
>
> -Tim
>
> On Fri, Nov 15, 2013 at 4:17 PM, Will Perry <Will.Perry@microsoft.com> wr=
ote:
>> Hi Folks-
>>
>> In a fairly large DB (~8GB) we're seeing crashes, compaction failures an=
d index rebuilds as a result of duplicate doc ids. A selection of related t=
races includes:
>>
>> [error] [<0.2990.111>] Compaction daemon - an error ocurred while=20
>> compacting the view group `System` from database `servicebus`:=20
>> {view_duplicate_id,
>>
>> <<"test:-vM0xyKZdeSMCIukpTchI3ZeKhk">>}
>>
>> [error] [<0.7103.113>] Duplicate docid `test:-vM0xyKZdeSMCIukpTchI3ZeKhk=
` detected in view group `_design/System`, database `servicebus` - This vie=
w needs to be rebuilt.
>>
>>
>> Can anyone help me understand what's happening here? How can we avoid ge=
tting into this situation, and is there a best-practice to resolve it?
>>
>> Cheers,
>>
>> Will