Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of saint.ack@gmail.com designates
 74.125.83.41 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:content-type
         :content-transfer-encoding;
        b=B0FlH8DRRe9o4+sQvsYAHInHYWrr74XKWt+RE2f9nGn4uNwWVEBHHN8qvxanShf1oG
         s/zyMSMJwPfT+DO9GtYRKJu0wQxOD/7/QMZ8a/paeH6t13m4h1YRthitP5wsbjhLu8hD
         GqxZwZyKa/zqN98e3195N7uMeI05PSXfUkDcg=
MIME-Version: 1.0
Sender: saint.ack@gmail.com
In-Reply-To: <AANLkTi=4Y4itL5yxwYRdxHZSxKmjPbuysLGjkBOGFAMB@mail.gmail.com>
References: <AANLkTikvqCMvV3KzT0rN=iQuR0BEUYNMMLyNhvuHXiXd@mail.gmail.com>
	<4CD1451C.3040802@gmail.com>
	<5A76F6CE309AD049AAF9A039A39242820F0C201E@sc-mbx04.TheFacebook.com>
	<AANLkTi=4Y4itL5yxwYRdxHZSxKmjPbuysLGjkBOGFAMB@mail.gmail.com>
Date: Wed, 3 Nov 2010 08:32:55 -0700
Message-ID: <AANLkTik389we8vOn-iV1CJpOGHA6sqCuSKitgRHkiOm3@mail.gmail.com>
Subject: Re: HBase as a versioned key/value store
From: Stack <stack@duboce.net>
To: user@hbase.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On Wed, Nov 3, 2010 at 7:15 AM, Wojciech Langiewicz
<wlangiewicz@gmail.com> wrote:
>
> I'm running latest version from Cloudera


Try a later version of the 0.89 series.  See the downloads page on our
site.   It has perf. improvements.


>> Each KV is a distinct Put operation? =A0Normally people get high through=
put
>> by batching many Puts at once.
>>
>
> Actually, here I'm asking about Get operations, because I don't know how =
to
> batch them (by design). But in case of Puts you are right.
>

There is a batch Get in TRUNK that should be available as 0.90.0RC0 soon.

> I'm rather asking what can I expect from my schema design and hardware by
> comparing other people solutions, right now I'm getting 10 times less
> performance that I initially wanted.
>
>
Well, if going to disk, reading we're talking 10-30ms a hit.  If you
are reading from cache, you should see 5ms and less.  Try upping
proportion of your heap given over to block cache; set
hfile.block.cache.size to 0.4 or 0.5 of heap (Writes should be going
in pretty fast -- ~5m or less).

What size your cells?  How many regions in your table?   How much RAM
have you given over to HBase?   Anything else running on these
machines?  You doing any wacky RAID'ing on those disks?

Good luck,
St.Ack