Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of podsiadlowski@gmail.com
 designates 74.125.78.27 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=E45ab7Fq0+5awvpDzeB7krTwZBTcHva9GcmW2ogY/5dWysE/MbSLVnExi7e31N6IKu
         4zSNItfGoRPKGuwzlvS5QK0sf0/zkYx+vaKpW93Sgqk1iDjPC35NXhqnjPhtRxluKrQa
         vHeDNjYAaMgT7/APmrCWp8kswq1IrkSWssNsA=
MIME-Version: 1.0
In-Reply-To: <31a243e71002011011n275bad96g286aa122ee149991@mail.gmail.com>
References: <608b17ac1001290501r36d0e862xc24796a1c75569f6@mail.gmail.com>
	 <7c962aed1001301610l1859f8e9h1a746505c6421a5a@mail.gmail.com>
	 <608b17ac1002010759k4e28fb23r466fb2de416493ae@mail.gmail.com>
	 <31a243e71002011011n275bad96g286aa122ee149991@mail.gmail.com>
Date: Mon, 1 Feb 2010 19:54:03 +0100
Message-ID: <608b17ac1002011054v67e992d2kdbb16cbf9d50502b@mail.gmail.com>
Subject: Re: Hbase fails at moderate load.
From: =?ISO-8859-2?Q?Micha=B3_Podsiad=B3owski?= <podsiadlowski@gmail.com>
To: hbase-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001636c5b94a4f458a047e8e8226

--001636c5b94a4f458a047e8e8226
Content-Type: text/plain; charset=ISO-8859-1

 But if I get 130 tables out of 64 megs how many i will get after splinting
1gig? Can you tell me what triggers further splits. First one is triggered
by exceeding "split at" size what is expect but after this i should get 2 x
32 megs. And then after one of them will grow up again above max filesize
limit it should be splited. Am i right?

2010/2/1 Jean-Daniel Cryans <jdcryans@apache.org>

> From what you pasted:
>
> 2010-02-01 14:05:49,445 INFO
> org.apache.hadoop.hbase.regionserver.CompactSplitThread: region split,
> META updated, and report to master all successful. Old region=REGION
> => {NAME => 'oldWebSingleRowCacheStore,,1265029544146', STARTKEY =>
> '', ENDKEY => 'filmMenuEditions-not_selected\xC2\xAC1405', ENCODED =>
> 1899385768, OFFLINE => true, SPLIT => true, TABLE => {{NAME =>
> 'oldWebSingleRowCacheStore', MAX_FILESIZE => '64', FAMILIES => [{NAME
> => 'content', COMPRESSION => 'NONE', VERSIONS => '3', TTL =>
> '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE
> => 'true'}, {NAME => 'description', COMPRESSION => 'NONE', VERSIONS =>
> '3', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
> BLOCKCACHE => 'true'}]}}, new regions:
> oldWebSingleRowCacheStore,,1265029549167,
> oldWebSingleRowCacheStore,filmLastTopics\xC2\xAC1155,1265029549167.
> Split took 0sec
>
> I see MAX_FILESIZE => '64' which means you have set that table to
> split after 64 _bytes_ so either use the default value of 256MB
> (256*1024*1024) or even higher if you wish (I set usually set them to
> 1GB).
>
>

--001636c5b94a4f458a047e8e8226--