Mailing-List: contact dev-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@couchdb.apache.org
Received-SPF: pass (athena.apache.org: domain of paul.joseph.davis@gmail.com
 designates 209.85.212.52 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <4F838202-5338-4021-9530-3A703D4EECD6@apache.org>
References: 
 <CAJ_m3YDr_G34C5SK=61hbkNWCP52=F46odGHn7wam7eU3cBktQ@mail.gmail.com>
 <CAL3q7H7PzRibp84usbU2ybSY5UOeFH+e8fVT8C+N3ZE3SFT9kg@mail.gmail.com>
 <CAJ_m3YBm6fu1EP8fZ9do8gj0kqgph04oR1-0_k1spMg4kF=-HA@mail.gmail.com>
 <CAJ_m3YBUOmZoGG1TTpiSum+83pFpsoiS670OBtjGoP4ofAeC3w@mail.gmail.com>
 <CAL3q7H5XS1e61dkUxY8thDy-L7FZgCbfNkwsAFqGAV2kD7xpug@mail.gmail.com>
 <CABvT1DF2CFfFppi=pmoNh7ynQ1marq-dZzQ5BEoWRikKja4mUQ@mail.gmail.com>
 <CAN-3CBKofp0EwGCtQAmYpwfQEfGcz90pHtG-LQLsqQMYTfzCOA@mail.gmail.com>
 <CAJ_m3YBQP1vn9=gdaSsfQWDdOYP-TKYf_=DMsEqC=fQ7+qLQCw@mail.gmail.com>
 <CAN-3CBK4_oFxLVHOSXrJE_rQnc_ywbC8jdn-o76QYX41uWqydg@mail.gmail.com>
 <CABvT1DHcY6n9tN3ecA_PYo_tmocmRcjBPFYb67=hN0+5vSMKXg@mail.gmail.com>
 <4F838202-5338-4021-9530-3A703D4EECD6@apache.org>
From: Paul Davis <paul.joseph.davis@gmail.com>
Date: Thu, 11 Aug 2011 11:48:45 -0500
Message-ID: 
 <CAJ_m3YCW47XQeTj8v5=iS5v_KXOtexBC558ZG2DTp3cqTjsJMw@mail.gmail.com>
Subject: Re: Futon Test Suite
To: dev@couchdb.apache.org
Content-Type: text/plain; charset=ISO-8859-1

>> The 'verify my install' on trunk strikes me as a bad idea. If someone
>> reports a bug and says that the verify passes, I'm always going to ask
>> them to run the test suite too.
>
> That is the intended way.

I agree with Jan on this one. Our test suite rarely finds a bug in the
wild compared to the number of times someone asks if the auth_cache
test should be failing. The bugs that it does turn up are quite often
the very same bugs for everyone, permissions problems, couchjs not
built correctly, etc etc.