Return-Path: Delivered-To: apmail-hadoop-hbase-user-archive@locus.apache.org Received: (qmail 8652 invoked from network); 27 Oct 2008 19:10:38 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 27 Oct 2008 19:10:38 -0000 Received: (qmail 41124 invoked by uid 500); 27 Oct 2008 19:10:42 -0000 Delivered-To: apmail-hadoop-hbase-user-archive@hadoop.apache.org Received: (qmail 41106 invoked by uid 500); 27 Oct 2008 19:10:42 -0000 Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-user@hadoop.apache.org Delivered-To: mailing list hbase-user@hadoop.apache.org Received: (qmail 41095 invoked by uid 99); 27 Oct 2008 19:10:42 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Oct 2008 12:10:42 -0700 X-ASF-Spam-Status: No, hits=-8.0 required=10.0 tests=RCVD_IN_DNSWL_HI,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of Jim.Kellerman@microsoft.com designates 131.107.115.215 as permitted sender) Received: from [131.107.115.215] (HELO smtp.microsoft.com) (131.107.115.215) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Oct 2008 19:09:28 +0000 Received: from TK5-EXHUB-C101.redmond.corp.microsoft.com (157.54.18.48) by TK5-EXGWY-E802.partners.extranet.microsoft.com (10.251.56.168) with Microsoft SMTP Server (TLS) id 8.1.291.1; Mon, 27 Oct 2008 12:09:50 -0700 Received: from NA-EXMSG-C103.redmond.corp.microsoft.com ([157.54.110.52]) by TK5-EXHUB-C101.redmond.corp.microsoft.com ([157.54.18.48]) with mapi; Mon, 27 Oct 2008 12:09:50 -0700 From: "Jim Kellerman (POWERSET)" To: "hbase-user@hadoop.apache.org" Date: Mon, 27 Oct 2008 12:09:52 -0700 Subject: RE: how many rows per GB memory Thread-Topic: how many rows per GB memory Thread-Index: Ack4Z01ZcqNCuWLIS4qX8pCZaMGu5gAAD3vA Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org The 64MB cache flush size is configurable. --- Jim Kellerman, Powerset (Live Search, Microsoft Corporation) > -----Original Message----- > From: news [mailto:news@ger.gmane.org] On Behalf Of Billy Pearson > Sent: Monday, October 27, 2008 12:07 PM > To: hbase-user@hadoop.apache.org > Subject: Re: how many rows per GB memory > > Is the 64MB changeable or is that a hard limit in the code? > Billy > > "Jim Kellerman (POWERSET)" > wrote in message > news:EAFDEC03CDA5D644878904F4A8F0158A5FE9070743@NA-EXMSG- > C103.redmond.corp.microsoft.com... > Each memcache will consume approximately > ((x bytes per key (HStoreKey =3D row + column + timestamp)) + > (avg value size)) > * (number of rows) > which is limited to 64MB per memcache. > > The heap size required is determined by: > (number of regions being hosted) * (number of families) * 64MB > > --- > Jim Kellerman, Powerset (Live Search, Microsoft Corporation) > > > > -----Original Message----- > > From: news [mailto:news@ger.gmane.org] On Behalf > > Of Billy Pearson > > Sent: Sunday, October 26, 2008 11:23 PM > > To: hbase-user@hadoop.apache.org > > Subject: how many rows per GB memory > > > > Is there some numbers I can figure on per GB of heap that I can get in > to > > a > > regionserver? > > > > say something like this: > > (x bytes avg per rowkey * max rows) / index interval =3D y GB Heap > > > > > > Billy > > > > > > > > > > >