hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: How to improve HBase throughput with YCSB?
Date Thu, 02 Jun 2011 15:34:31 GMT
It looks like you are managing zk yourself?  Default is that zk only
allows 10 connections.  Up it to 1000 for now.  Its maxClientCnxns.
St.Ack

On Wed, Jun 1, 2011 at 11:42 PM, Harold Lim <rold_50@yahoo.com> wrote:
> I'm running HBase 0.90.2.
>
>
> -Harold
>
> --- On Thu, 6/2/11, Ted Dunning <tdunning@maprtech.com> wrote:
>
>> From: Ted Dunning <tdunning@maprtech.com>
>> Subject: Re: How to improve HBase throughput with YCSB?
>> To: user@hbase.apache.org
>> Date: Thursday, June 2, 2011, 2:34 AM
>> Zookeeper has an internal limit on
>> number of connections.
>>
>> Which version of hbase are you running?
>>
>> On Wed, Jun 1, 2011 at 11:20 PM, Harold Lim <rold_50@yahoo.com>
>> wrote:
>>
>> > Hi Ted,
>> >
>> > For some reason, when I try the forked version of
>> YCSB, I can't seem to
>> > launch more than 10 threads. I start getting the
>> following errors:
>> >
>> >
>> >
>> > 11/06/02 02:17:35 INFO zookeeper.ZooKeeper: Initiating
>> client connection,
>> > connectString=xxxxxx:2181 sessionTimeout=180000
>> watcher=hconnection
>> > 11/06/02 02:17:35 INFO zookeeper.ClientCnxn: Opening
>> socket connection to
>> > server xxxxxx:2181
>> > 11/06/02 02:17:35 INFO zookeeper.ClientCnxn: Socket
>> connection established
>> > to xxxxxx:2181, initiating session
>> > 11/06/02 02:17:35 WARN zookeeper.ClientCnxn: Session
>> 0x0 for server
>> > xxxxxx:2181, unexpected error, closing socket
>> connection and attempting
>> > reconnect
>> > java.io.IOException: Connection reset by peer
>> >        at
>> sun.nio.ch.FileDispatcher.read0(Native Method)
>> >        at
>> sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21)
>> >        at
>> sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:202)
>> >        at
>> sun.nio.ch.IOUtil.read(IOUtil.java:169)
>> >        at
>> sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:243)
>> >        at
>> >
>> org.apache.zookeeper.ClientCnxn$SendThread.doIO(ClientCnxn.java:858)
>> >        at
>> >
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1130)
>> >
>> >
>> > Thanks,
>> > Harold
>> > --- On Tue, 5/31/11, Ted Dunning <tdunning@maprtech.com>
>> wrote:
>> >
>> > > From: Ted Dunning <tdunning@maprtech.com>
>> > > Subject: Re: How to improve HBase throughput with
>> YCSB?
>> > > To: user@hbase.apache.org
>> > > Date: Tuesday, May 31, 2011, 2:22 AM
>> > > It may make it better.
>> > >
>> > > We should have an update shortly that will allow
>> multiple
>> > > machines to
>> > > participate in generating load.  A single
>> YCSB is
>> > > sufficient to stress a few
>> > > nodes but once you get to 10 or more (especially
>> with MapR
>> > > underneath) you
>> > > really need a cluster to generate the load.
>> > >
>> > > The synchronization strategy is very
>> simple.  We load
>> > > up as usual and wait
>> > > for a file to appear in Zookeeper.  When it
>> appears,
>> > > the load turns on.
>> > >
>> > > On Mon, May 30, 2011 at 10:08 PM, Harold Lim
>> <rold_50@yahoo.com>
>> > > wrote:
>> > >
>> > > > I also see that you have a forked version of
>> YCSB,
>> > > will that make my
>> > > > performance better?
>> > > >
>> > >
>> >
>>
>

Mime
View raw message