Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of bradfordstephens@gmail.com
 designates 209.85.217.215 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=jLxZDki9HVKS4ERli9vPvaWdb378yMfGJnVEai18JZLUR5iNZtItK7Q2vJ3oLRTOCq
         HnAa4qQ/p2fpf53x8z4A7C0ej9kb9VwzksERIf8WcJpZ9/bJL6AiFaKm5I00YpD0hZby
         MQgoraF7JHjTQ7MmAePCfgRwoGg1ZscLDBtQk=
MIME-Version: 1.0
In-Reply-To: <fa03480d0906131127p7d5f812dydb94c60516672782@mail.gmail.com>
References: <860544ed0906111810l2f80be29x8bc08a7463fc2b4b@mail.gmail.com>
	 <7c962aed0906112147i2cc699d3j8a193bc7c37d6255@mail.gmail.com>
	 <860544ed0906112219x8d10ab0p78287d2d5372ce06@mail.gmail.com>
	 <fa03480d0906131127p7d5f812dydb94c60516672782@mail.gmail.com>
Date: Mon, 15 Jun 2009 11:17:16 -0700
Message-ID: <860544ed0906151117l3ccad5ecxfb440386ca337c78@mail.gmail.com>
Subject: Re: HBase Write to Regionservers behavior
From: Bradford Stephens <bradfordstephens@gmail.com>
To: hbase-user@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Right now, we're storing the documents in HBase. The indices are
stored in HDFS and then 'sharded' to each node using Katta. Not sure
if there's much of an advantage to storing the index itself in HBase,
though I'd be interested to see some use cases for it.

On Sat, Jun 13, 2009 at 11:27 AM, zsongbo<zsongbo@gmail.com> wrote:
> Hi Bradford Stephens,
> Could you please share something about your practices on "Katta+HBase"?
> Do you store the documents or indexes in HBase?
>
> Schubert
>
> On Fri, Jun 12, 2009 at 1:19 PM, Bradford Stephens <
> bradfordstephens@gmail.com> wrote:
>
>> That actually make a lot of sense. Thanks, awesome people! Me and the
>> dev team are here to get Katta + HBase to play together, and it's
>> looking pretty nice.
>>
>> On Thu, Jun 11, 2009 at 9:47 PM, stack<stack@duboce.net> wrote:
>> > On Thu, Jun 11, 2009 at 6:10 PM, Bradford Stephens <
>> > bradfordstephens@gmail.com> wrote:
>> >
>> >>
>> >> What I'm noticing is that it's writing to mostly one or two regions o=
n
>> >> one box at a time, even though I have 7 reducers running. Monitoring
>> >> everything with dstat -v, I notice that only 2 of my servers are doin=
g
>> >> much. These boxes have very low CPU idling, and high disk output (a
>> >> few GB a minute).
>> >>
>> >
>> >
>> > How many regions in your table?
>> >
>> > At first, there is one. =A0All reducers will go against it. =A0 When i=
t
>> splits,
>> > then two regions field the 7 reducers and so on.
>> >
>> > You can manually split regions from the command-line. =A0See if that h=
elps:
>> >
>> > hbase> split_region 'REGIONNAME'
>> >
>> > (IIRC -- type 'tools' in shell for help on the admin facilities).
>> >
>> > St.Ack
>> >
>>
>