hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <tdunn...@maprtech.com>
Subject Re: How to improve HBase throughput with YCSB?
Date Thu, 02 Jun 2011 06:48:13 GMT
Yeah.. there is a bug on that.

I am spacing the number right now.  And I have to run.

On Wed, Jun 1, 2011 at 11:42 PM, Harold Lim <rold_50@yahoo.com> wrote:

> I'm running HBase 0.90.2.
>
>
> -Harold
>
> --- On Thu, 6/2/11, Ted Dunning <tdunning@maprtech.com> wrote:
>
> > From: Ted Dunning <tdunning@maprtech.com>
> > Subject: Re: How to improve HBase throughput with YCSB?
> > To: user@hbase.apache.org
> > Date: Thursday, June 2, 2011, 2:34 AM
> > Zookeeper has an internal limit on
> > number of connections.
> >
> > Which version of hbase are you running?
> >
> > On Wed, Jun 1, 2011 at 11:20 PM, Harold Lim <rold_50@yahoo.com>
> > wrote:
> >
> > > Hi Ted,
> > >
> > > For some reason, when I try the forked version of
> > YCSB, I can't seem to
> > > launch more than 10 threads. I start getting the
> > following errors:
> > >
> > >
> > >
> > > 11/06/02 02:17:35 INFO zookeeper.ZooKeeper: Initiating
> > client connection,
> > > connectString=xxxxxx:2181 sessionTimeout=180000
> > watcher=hconnection
> > > 11/06/02 02:17:35 INFO zookeeper.ClientCnxn: Opening
> > socket connection to
> > > server xxxxxx:2181
> > > 11/06/02 02:17:35 INFO zookeeper.ClientCnxn: Socket
> > connection established
> > > to xxxxxx:2181, initiating session
> > > 11/06/02 02:17:35 WARN zookeeper.ClientCnxn: Session
> > 0x0 for server
> > > xxxxxx:2181, unexpected error, closing socket
> > connection and attempting
> > > reconnect
> > > java.io.IOException: Connection reset by peer
> > >        at
> > sun.nio.ch.FileDispatcher.read0(Native Method)
> > >        at
> > sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21)
> > >        at
> > sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:202)
> > >        at
> > sun.nio.ch.IOUtil.read(IOUtil.java:169)
> > >        at
> > sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:243)
> > >        at
> > >
> > org.apache.zookeeper.ClientCnxn$SendThread.doIO(ClientCnxn.java:858)
> > >        at
> > >
> > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1130)
> > >
> > >
> > > Thanks,
> > > Harold
> > > --- On Tue, 5/31/11, Ted Dunning <tdunning@maprtech.com>
> > wrote:
> > >
> > > > From: Ted Dunning <tdunning@maprtech.com>
> > > > Subject: Re: How to improve HBase throughput with
> > YCSB?
> > > > To: user@hbase.apache.org
> > > > Date: Tuesday, May 31, 2011, 2:22 AM
> > > > It may make it better.
> > > >
> > > > We should have an update shortly that will allow
> > multiple
> > > > machines to
> > > > participate in generating load.  A single
> > YCSB is
> > > > sufficient to stress a few
> > > > nodes but once you get to 10 or more (especially
> > with MapR
> > > > underneath) you
> > > > really need a cluster to generate the load.
> > > >
> > > > The synchronization strategy is very
> > simple.  We load
> > > > up as usual and wait
> > > > for a file to appear in Zookeeper.  When it
> > appears,
> > > > the load turns on.
> > > >
> > > > On Mon, May 30, 2011 at 10:08 PM, Harold Lim
> > <rold_50@yahoo.com>
> > > > wrote:
> > > >
> > > > > I also see that you have a forked version of
> > YCSB,
> > > > will that make my
> > > > > performance better?
> > > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message