Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 28798 invoked from network); 24 Mar 2010 22:09:50 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 24 Mar 2010 22:09:50 -0000 Received: (qmail 22011 invoked by uid 500); 24 Mar 2010 22:09:49 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 21976 invoked by uid 500); 24 Mar 2010 22:09:49 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 21967 invoked by uid 99); 24 Mar 2010 22:09:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Mar 2010 22:09:49 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jesse.mcconnell@gmail.com designates 74.125.83.44 as permitted sender) Received: from [74.125.83.44] (HELO mail-gw0-f44.google.com) (74.125.83.44) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Mar 2010 22:09:44 +0000 Received: by gwj23 with SMTP id 23so1342271gwj.31 for ; Wed, 24 Mar 2010 15:09:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=LZxacDM3+ekD5S7AabAhx+jsnKytvb8+TgmVScUi8ws=; b=k+pwRNv2RQn48Y4Zd5fd0QO/I5pryrLEX2+xXdAHav0ZYA5o5Bnfm95vmDYY6omIVX 8BBK8ugud577zxiTU5IViRt3G4dWQgC+d8jPCutr3YWuzN/tWlJvsm+dDJ1OMGj39K+O CWLAwllQZMgtEEHBbNF7VQt3CebRosOR5EcrE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=GEH0zKouuizNPEP0TbamCmlKRxxZqmVPbytaANdNungcbufogi3mbKWCs5AkSSNaHL Lt24hOHrATdbuMcMx2MazgMAOIDOL6G1Q755Dvqtu+7U75DCwmhoxPWL62cJPsh419o8 MKt0PkcBMrvuhu8Avv4cXcZfkIN3cODhFWL2Q= MIME-Version: 1.0 Received: by 10.90.62.33 with SMTP id k33mr7730080aga.70.1269468562195; Wed, 24 Mar 2010 15:09:22 -0700 (PDT) In-Reply-To: <65AC5638854BD3459DA70DCE4B8FB4900510B4E237@corp-it-exch01.gridpoint.com> References: <65AC5638854BD3459DA70DCE4B8FB4900510B4E237@corp-it-exch01.gridpoint.com> Date: Wed, 24 Mar 2010 17:09:22 -0500 Message-ID: Subject: Re: Limit on number of columns From: Jesse McConnell To: user@cassandra.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable http://wiki.apache.org/cassandra/CassandraLimitations "Cassandra's compaction code currently deserializes an entire row (per columnfamily) at a time. So all the data from a given columnfamily/key pair must fit in memory. Fixing this is relatively easy since columns are stored in-order on disk so there is really no reason you have to deserialize row-at-a-time except that that is easier with the current encapsulation of functionality. This will be fixed in https://issues.apache.org/jira/browse/CASSANDRA-16" so yes, based on the amount of data you have in there and your memory allocated to cassandra there is a limit currently...hopefully gone in 0.7 I will note that another issue I run across with this is that get_count will not return within the rpc timeout after you get a certain amount of columns in there. cheers, jesse -- jesse mcconnell jesse.mcconnell@gmail.com On Wed, Mar 24, 2010 at 17:05, Davis, Jeremy wrote: > > > Hello, > > Is there a practical limit on the number of columns I put on a key? > > Obviously if I tried to grab the entire row at once I would have a proble= m. > > However, if I had an open ended row, with column names of =E2=80=9C1=E2= =80=9D to =E2=80=9C999999999=E2=80=9D > etc. And I only accessed ranges, would there be a practical limit I would= be > running up against? Performance degradation over time, etc? > > > > I=E2=80=99m running a little micro benchmark to see how well this works, = but just > curious if anyone has any insights. > > > > Many Thanks, > > -JD