Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type;
  b=kkWcANL8ZSPhtVSNkNEYwT+BoIRoeECEWijGrkE5eyu68YmxHQSBfAMskzhVqdLprKwR6TGHJicet9iHL2wB2dnccYff7FWMK1pIwy5ZabAulmdwrm8NaA1hEurpdDVjL1/jw+pilukED22135j/GpxAMXtEPKeGNnGWveCIFDU=;
Message-ID: <796649.40449.qm@web130107.mail.mud.yahoo.com>
References: <AANLkTimRYs0dXEmrx5DeokOuMtXMwdZnZdsk=cbgityo@mail.gmail.com>
 <AANLkTimSukRA0nJBLk0SS2F3599CFJgBw7=1O5PPWyNL@mail.gmail.com>
 <AANLkTi=D03ioQ2NKqPPVSx7wirJ1+6NsT0r=huDkeasE@mail.gmail.com>
 <AANLkTi=CERAVLp9bPZmzCJHHAiqmj8sT07xRtW8PLYkO@mail.gmail.com>
 <AANLkTinwJoHbmGShJGcHaNW66Guhcaa9KbcUK41aYobo@mail.gmail.com>
 <AANLkTinESmkLb77fecJOepvT4BddB3cz=0c=4YBERM6v@mail.gmail.com>
 <AANLkTi=LzqKUDpNaHcyZckJh6zSorsMxSGuBHAwyg2Jy@mail.gmail.com>
 <AANLkTi=eEv5GAkre4z4TFACPBwbdxQ+S3_-REbagf5cc@mail.gmail.com>
 <AANLkTimRRN6dj_9zNL_w=7Bk2wAHe3x4ZuOEs=d8K5SV@mail.gmail.com>
 <AANLkTinc00pBrqL_HA5-_GVj4=SVuZRHN7JDhiVuhHkL@mail.gmail.com>
 <AANLkTikKs8ykj2sgSqX0rBdNL2=gaxzSbjgV7BRuF3RN@mail.gmail.com>
Date: Sun, 16 Jan 2011 02:17:56 -0800 (PST)
From: Otis Gospodnetic <otis_gospodnetic@yahoo.com>
Subject: Re: HTable.put(List<Put> puts) perform batch insert?
To: user@hbase.apache.org
In-Reply-To: <AANLkTikKs8ykj2sgSqX0rBdNL2=gaxzSbjgV7BRuF3RN@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii

Hi,

Re HBaseHUT - Alex didn't mention it, but he did a really nice and clear writeup 
of it in this post:
http://blog.sematext.com/2010/12/16/deferring-processing-updates-to-increase-hbase-write-performance/


Otis
----
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/


----- Original Message ----
> From: Alex Baranau <alex.baranov.v@gmail.com>
> To: user@hbase.apache.org
> Sent: Tue, January 11, 2011 10:51:28 AM
> Subject: Re: HTable.put(List<Put> puts) perform batch insert?
> 
> Re HBaseHUT J-D was correct: you will gain speed with it in case you need
> Get  & Put operation to perform your updates.
> 
> Don't forget to play with  writeToWAL, writeBuffer (with autoFlush=false)
> attributes!
> 
> Alex  Baranau
> ----
> Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - Hadoop - HBase
> 
> On  Mon, Jan 10, 2011 at 10:45 PM, Weishung Chung <weishung@gmail.com> wrote:
> 
> >  Ok, i will test it, thanks again :)
> >
> > On Mon, Jan 10, 2011 at 1:53  PM, Jean-Daniel Cryans <jdcryans@apache.org
> >  >wrote:
> >
> > > Depending on the level of super fastness you  need, it may or may not
> > > be fast enough. Better to test it, as  usual.
> > >
> > > J-D
> > >
> > > On Mon, Jan 10,  2011 at 11:12 AM, Weishung Chung <weishung@gmail.com>
> > >  wrote:
> > > > Multiple batches of 10k *new/updated* rows at any time  to different
> > > tables
> > > > by different clients  simultaneously. I want these multiple batches of
> > > > insertions to  be done super fast. At the same time, I would like to be
> > >  able
> > > > to scale up to 100k rows at a time (the goal).  Now,  I am building a
> > > cluster
> > > > of size 6 to 7  nodes.
> > > >
> > > > On Mon, Jan 10, 2011 at 1:03 PM,  Jean-Daniel Cryans <
> > jdcryans@apache.org
> > >  >wrote:
> > > >
> > > >> lotsa rows? That's 1k or 1B?  Inside a OLTP system or OLAP?
> > > >>
> > > >>  J-D
> > > >>
> > > >> On Mon, Jan 10, 2011 at 10:58  AM, Weishung Chung <weishung@gmail.com>
> > >  >> wrote:
> > > >> > Jonathan, awesome, best of breed  APIs!
> > > >> > Jean, I would like to insert lotsa new rows  with many columns in a
> > > >> > particular column family*  **programmatically in batch just like the
> > > jdbc
> > >  >> > addBatch method.*
> > > >> > *Thanks  again.*
> > > >> >
> > > >> >
> > >  >>
> > > >
> > >
> >
>