Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of magnito@gmail.com designates
 209.85.214.169 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=uwYBlQAhHgqil1hNidmCN67bAGqsnZrl3FJMPj39LTtf3RmBnU6v7WUeuK/OoZMu/5
         Z+T2+okjxE5ntoDjaPwEzNVllG/Rgz9FOLttGrNogRzHccJTvkttp0Pqf7SVuLT8Q6Fy
         MkoOC1MSsM+zHxHANT24VTyYyOs+Ac254ACv8=
MIME-Version: 1.0
In-Reply-To: <AANLkTinmwjufAY=yUzQtUYQr9Us7O+H8SsCCuP-esKQt@mail.gmail.com>
References: <AANLkTikJfDLfonOmrk6q_HAd4SJ7NmfU8wQA1qD0tCy2@mail.gmail.com>
	<AANLkTinmwjufAY=yUzQtUYQr9Us7O+H8SsCCuP-esKQt@mail.gmail.com>
Date: Fri, 17 Dec 2010 11:01:21 -0800
Message-ID: <AANLkTikFC359DUMO_miQ31oy03Ahc4r=tuJa24TJtFcQ@mail.gmail.com>
Subject: Re: question about multi-transaction queries
From: Jack Levin <magnito@gmail.com>
To: user@hbase.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Lets just say its one row key with two columns.  Non contiguous
records.  We want to read as fast as possible.  So we did some tests,
and with MongoDB the random reads of 1000 records is about 80ms.
While HBASE with jython is 400ms or so.
Question is, as we develop our applications what is the best method to
retrieve many rows the fastest way possible?  We are talking about 1
client here, not many clients.  For many clients, REST seems to be
appropriate, but here we have a Frontend server rendering content
quickly and we need to reduce the query overhead for HBASE and get
data fast.

-Jack

On Sat, Dec 11, 2010 at 10:55 AM, Stack <stack@duboce.net> wrote:
> How many columns? =A0Its columns right, and not column families?
>
> Are the 1k rows contiguous? =A0Can you Scan? =A0For insert of 1k rows, yo=
u
> know how to do that now, right? =A0Will they be substantial rows -- 10s
> to 100s of ks? -- or just small? =A0Do you have multiput available in
> the REST interface, I don't recall.
>
> Try REST since you know that interface. =A0Jython might be faster though
> a test done more than a year ago had jython as slow
> (http://ryantwopointoh.blogspot.com/2009/01/performance-of-hbase-importin=
g.html)
> but a bunch has changed since then -- hbase-wise and jython has
> probably gotten a lot better. =A0If jython route, make sure you keep the
> interpreter afloat rather than launch it per request (so yes, fastcgi
> would make sense).
>
> St.Ack
>
> On Fri, Dec 10, 2010 at 9:59 PM, Jack Levin <magnito@gmail.com> wrote:
>> Hello. =A0 We plan to run a set of queries on tables with multiple
>> columns. =A0What is the most efficient method to say, insert 1000 rows,
>> and/or read 1000 rows.
>> We are considering just using REST. =A0But what about jython? Will it be
>> faster? =A0Another way to have our apps talk to nginx and some sort of
>> app tier running via fast-cgi.
>>
>> Any ideas?
>>
>> -Jack
>>
>