Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
MIME-Version: 1.0
Sender: saint.ack@gmail.com
In-Reply-To: 
 <SN1PR0401MB17927691BD073AAF906A632CBAE60@SN1PR0401MB1792.namprd04.prod.outlook.com>
References: 
 <BY2PR0401MB1781F936B2375F144340FFE6BAE50@BY2PR0401MB1781.namprd04.prod.outlook.com>
	<CADcMMgFNogOC+=DSMHR8M1tOk7AAb0UkQD=5kCjjv6PAh+8dQA@mail.gmail.com>
	<SN1PR0401MB17927691BD073AAF906A632CBAE60@SN1PR0401MB1792.namprd04.prod.outlook.com>
Date: Wed, 23 Dec 2015 21:15:18 -0800
Message-ID: 
 <CADcMMgHSM5A0yY6T5wkYmFPhnDpRmPmuHeq+t7vqmObKGmQYig@mail.gmail.com>
Subject: Re: Put performance test
From: Stack <stack@duboce.net>
To: Hbase-User <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=001a1141b2c4bc705a05279dec49

--001a1141b2c4bc705a05279dec49
Content-Type: text/plain; charset=UTF-8

Looks like happybase has tuned down the retries. Is that possible? It
says:  Failed
1 action: IOException: 1 time. Can you up the retry count? Client probably
needs to ride over a region split or some such.

St.Ack

On Wed, Dec 23, 2015 at 9:47 AM, Kumiko Yada <Kumiko.Yada@ds-iq.com> wrote:

> It's crashing in the lib.
>
> happybase.hbase.ttypes.IOError:
> IOError(_message='org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException:
> Failed 1 action: IOException: 1 time, \n\tat
> org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.makeException(AsyncProcess.java:227)\n\tat
> org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.access$1700(AsyncProcess.java:207)\n\tat
> org.apache.hadoop.hbase.client.AsyncProcess.waitForAllPreviousOpsAndReset(AsyncProcess.java:1658)\n\tat
> org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:208)\n\tat
> org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183)\n\tat
> org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1496)\n\tat
> org.apache.hadoop.hbase.client.HTable.put(HTable.java:1119)\n\tat
> org.apache.hadoop.hbase.thrift.ThriftServerRunner$HBaseHandler.mutateRowsTs(ThriftServerRunner.java:1324)\n\tat
> org.apache.hadoop.hbase.thrift.ThriftServerRunner$HBaseHandler.mutateRows(ThriftServerRunner.java:1270)\n\tat
> sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source)\n\tat
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
> java.lang.reflect.Method.invoke(Method.java:606)\n\tat
> org.apache.hadoop.hbase.thrift.HbaseHandlerMetricsProxy.invoke(HbaseHandlerMetricsProxy.java:67)\n\tat
> com.sun.proxy.$Proxy13.mutateRows(Unknown Source)\n\tat
> org.apache.hadoop.hbase.thrift.generated.Hbase$Processor$mutateRows.getResult(Hbase.java:4386)\n\tat
> org.apache.hadoop.hbase.thrift.generated.Hbase$Processor$mutateRows.getResult(Hbase.java:4370)\n\tat
> org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)\n\tat
> org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)\n\tat
> org.apache.hadoop.hbase.thrift.TBoundedThreadPoolServer$ClientConnnection.run(TBoundedThreadPoolServer.java:289)\n\tat
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)\n\tat
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\n\tat
> java.lang.Thread.run(Thread.java:745)\n')
>
> -----Original Message-----
> From: saint.ack@gmail.com [mailto:saint.ack@gmail.com] On Behalf Of Stack
> Sent: Tuesday, December 22, 2015 1:07 PM
> To: Hbase-User <user@hbase.apache.org>
> Subject: Re: Put performance test
>
> Why the crash? Is it in the library or hbase?
> Thanks,
> St.Ack
>
> On Tue, Dec 22, 2015 at 11:00 AM, Kumiko Yada <Kumiko.Yada@ds-iq.com>
> wrote:
>
> > Hello,
> >
> > I wrote the python script w/ happybase library to do the performance
> > put test; however, this library is crashing when more than 900000 rows
> > are put.  I'd like to do 1/10/100 million rows put tests.  Is there
> > any tool that I can use for this?
> >
> > Thanks
> > Kumiko
> >
>

--001a1141b2c4bc705a05279dec49--