Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (athena.apache.org: domain of jchris@gmail.com designates
 209.85.212.180 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=content-type:mime-version:subject:from:in-reply-to:date
         :content-transfer-encoding:message-id:references:to:x-mailer;
        b=hGbDG8RvwXMRsTm59eRJjNeUSSQIGaN0Iap3Mpe3zgGnDH6pSt2zgyBxpffLQsps8Y
         uD4TF+H97JdDj7bQgPUuWePZYAMJRy5hoM8G+E35slrKixgtlPbffGfXPUGqIKywWIat
         CSVFw7Q2kjAAmikBffB2XipnOPbRRZjK/iWTA=
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1081)
Subject: Re: Crash when using builtin reduce _stats
From: J Chris Anderson <jchris@gmail.com>
In-Reply-To: <AANLkTimB-aoobUybAyYkDt+BeiFn33zK0q2eWonVDWvN@mail.gmail.com>
Date: Fri, 6 Aug 2010 17:24:51 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <327C4C74-0F10-4F43-B18F-79BAD91717C1@gmail.com>
References: <AANLkTi=nOwSy1vqN_3s_8OdBXHfOtqen+pgT2SFH26Sw@mail.gmail.com>
 <AANLkTino6c7FmGXDtayarQHZCLbY26ffsc0C6L7XfNzQ@mail.gmail.com>
 <AANLkTikn5WOnrY7Oa8TgiQFjSpxUR9gQnGipFL2DZd=2@mail.gmail.com>
 <50582255-EA47-4DDA-A182-13F54F9B1BF6@apache.org>
 <AANLkTimB-aoobUybAyYkDt+BeiFn33zK0q2eWonVDWvN@mail.gmail.com>
To: user@couchdb.apache.org


On Aug 6, 2010, at 5:21 PM, Yue Chuan Lim wrote:

> I highly doubt it, modifying the function to:
>=20
> function(doc) {
>  if(doc.data[12] > 0) {
>    key =3D doc._id.split("|")[0];
>    emit(doc.data[12], doc.data[12]);
>  }
> }
>=20
> and sorting by key, it appears all the numbers are indeed numbers.
>=20
> function(doc) {
>  if(doc.data[12] > 0) {
>    key =3D doc._id.split("|")[0];
>    if(doc.data[12] !=3D parseInt(doc.data[12])) {
>      emit(doc.data[12], doc.data[12]);
>    }
>  }
> }
>=20
> Returns a empty set.
>=20
> On a hunch, I removed the doc.data[12] > 0 line, and the query seems =
to run
> fine
>=20
> (with group=3Dtrue)
>=20
> {"rows":[
> =
{"key":"gsc_test_01","value":{"sum":335168,"count":1000,"min":0,"max":389,=
"sumsqr":128263850}},
> =
{"key":"gsc_test_02","value":{"sum":381805,"count":1000,"min":0,"max":765,=
"sumsqr":176920147}},
> =
{"key":"gsc_test_03","value":{"sum":411391,"count":1000,"min":187,"max":76=
1,"sumsqr":178307983}}
> ]}
>=20
> So it appears that _stats doesn't like value sets without 0s :P (or =
maybe
> reduce + group=3Dtrue has something against unequal count values)
>=20
> Thanks for looking into this :)

Since there isn't an easy answer in sight, and I'm up to my neck in =
other patches right now, maybe the best thing to do is start a Jira =
ticket to record your observations while they are still fresh.

http://issues.apache.org/jira/browse/COUCHDB

Thanks,
Chris

> Yue Chuan
>=20
>=20
> On Sat, Aug 7, 2010 at 8:13 AM, J Chris Anderson <jchris@apache.org> =
wrote:
>=20
>>=20
>> On Aug 6, 2010, at 5:09 PM, Yue Chuan Lim wrote:
>>=20
>>> Further tested on the couch.io windows installer as well as a
>>> couch.ioinstance with the same results, works on a temp view, =
crashes
>>> on a actual
>>> view.
>>>=20
>>>=20
>> =
shasderias.couchone_remove_me_.com/_utils/database.html?gsc_lt2/_design/st=
ats/_view/active_power
>>>=20
>>> is the couchone instance.
>>=20
>> Is there any chance you have a few docs where the value is not a =
number? If
>> you remove the reduce function completely and query the map is every =
single
>> row's value a number?
>>=20
>> Thanks for helping us get to the bottom of this.
>>=20
>> Chris
>>=20
>>>=20
>>> On Fri, Aug 6, 2010 at 9:01 PM, Yue Chuan Lim <shasderias@gmail.com>
>> wrote:
>>>=20
>>>> And curiously enough, running it as a temp view works just fine.
>>>>=20
>>>> [info] [<0.1859.0>] 127.0.0.1 - - 'POST'
>>>> /gsc_lt2/_temp_view?limit=3D11&descending=3Dtrue&group=3Dtrue 200
>>>>=20
>>>>=20
>>>> On Fri, Aug 6, 2010 at 8:38 PM, Yue Chuan Lim <shasderias@gmail.com
>>> wrote:
>>>>=20
>>>>> Fairly standard map/reduce function, map looks something like
>>>>>=20
>>>>> function(doc) {
>>>>> if(doc.data[12] > 0) {
>>>>>   key =3D doc._id.split("|")[0];
>>>>>   emit(key, doc.data[12]);
>>>>> }
>>>>> }
>>>>>=20
>>>>> Data returned by map is along the lines of: ("test1", 123), =
("test1",
>>>>> 245).
>>>>>=20
>>>>> Reduce is just: _stats
>>>>>=20
>>>>> Crash log: http://pastebin.com/aX7jeeLm
>>>>> Platform: Windows 7 (32-bit)
>>>>>=20
>>>>> Using the installer by Mark Hammond. Incidentally, is the =
installer on
>>>>> couch.io the preferred one for windows deployment?
>>>>>=20
>>>>> Thanks
>>>>>=20
>>>>>=20
>>>>>=20
>>>>=20
>>=20
>>=20