Return-Path: Delivered-To: apmail-incubator-cassandra-user-archive@minotaur.apache.org Received: (qmail 80417 invoked from network); 22 Feb 2010 22:43:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 22 Feb 2010 22:43:32 -0000 Received: (qmail 11497 invoked by uid 500); 22 Feb 2010 22:43:31 -0000 Delivered-To: apmail-incubator-cassandra-user-archive@incubator.apache.org Received: (qmail 11462 invoked by uid 500); 22 Feb 2010 22:43:31 -0000 Mailing-List: contact cassandra-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cassandra-user@incubator.apache.org Delivered-To: mailing list cassandra-user@incubator.apache.org Received: (qmail 11451 invoked by uid 99); 22 Feb 2010 22:43:31 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Feb 2010 22:43:31 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jbellis@gmail.com designates 74.125.82.47 as permitted sender) Received: from [74.125.82.47] (HELO mail-ww0-f47.google.com) (74.125.82.47) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Feb 2010 22:43:23 +0000 Received: by wwb22 with SMTP id 22so467895wwb.6 for ; Mon, 22 Feb 2010 14:43:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :from:date:message-id:subject:to:content-type :content-transfer-encoding; bh=fSmkawBll5LdJISDFmumnI3AfYOA7rR/Fm3uu7O5/bk=; b=nSpguht+wLvL42fwqnPnM98bfib0fan/by738IQVxtRtxjdrI4RiPVL/RupYhsAdco IgwQ4fGKU6KXyDMPbD/17Z9amQh1ZDAREJmCpMTfaAVdMtISMNsuJH+/lFMfGsSdd9Lw P/Duez2RTWO7pKXRzWP+GuhFj3GN0jjh8PnDE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding; b=YI1cdE/IgZQY5TZiurPnYpOdX7eE7252zC8a4QgNMudUK7Dk/ErwLeRli8D06DZnHq 2Hwxt+fJyCVs8tV3ZPm0FNSsJ6CkS7yreAxn54cRzs+px3PjeRUmGpJr7C0oLiNfiWsH MwEA/Dzdr1ibJg41CJWFIpikLzUMnWelg0rIs= MIME-Version: 1.0 Received: by 10.216.171.7 with SMTP id q7mr1202439wel.40.1266878582136; Mon, 22 Feb 2010 14:43:02 -0800 (PST) In-Reply-To: <991ae7f81002221440x17cc62ak9ba6bf1d01c111b@mail.gmail.com> References: <991ae7f81002221140i58295305oceafab72824986d9@mail.gmail.com> <991ae7f81002221440x17cc62ak9ba6bf1d01c111b@mail.gmail.com> From: Jonathan Ellis Date: Mon, 22 Feb 2010 16:42:42 -0600 Message-ID: Subject: Re: Cassandra paging, gathering stats To: cassandra-user@incubator.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Breaking sooner rather than later is a feature, of sorts. You really do need to give a sane max. Remember that thrift must pull results into memory before giving them back to you, so allowing you to give it a max that cannot possibly fit in memory is not doing you a favor. -Jonathan On Mon, Feb 22, 2010 at 4:40 PM, Sonny Heer wrote: > Is this a bug? > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0ColumnParent columnParent =3D new ColumnPa= rent(cp, null); > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0SlicePredicate slicePredicate =3D new Slic= ePredicate(); > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0// Get all columns > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0SliceRange sliceRange =3D new SliceRange(n= ew byte[] {}, new > byte[] {}, false, Integer.MAX_VALUE); > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0slicePredicate.setSlice_range(sliceRange); > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0List columns; > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0try { > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0columns = =3D client.get_range_slice(keySpaceStr, columnParent, > slicePredicate, "STU", "T", 1000000, ConsistencyLevel.ONE); > > > the client.get_range_slice has ~100 rows returned. =A0when i change the > count above 1000000 (or some # below int max) it works fine. =A0 When I > change the value to Integer.MAX_VALUE it fails with the Java heap > space error. =A0I've tried upping the heap size to 1024 as well. =A0Even > though the total results returned is the same (~100) why would it not > work with int max? =A0Is something being built based on this count value > passed in? >