hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Busbey <bus...@cloudera.com>
Subject Re: YCSB load data stucked
Date Wed, 22 Oct 2014 03:00:09 GMT
As an aside, if there are changes we'd like to see in YCSB upstream has
started taking patches again with a bit of prodding.

On Tue, Oct 21, 2014 at 9:23 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> Once you clone ycsb, you should build it with your choice of 0.98
>
> Here's thread where Andrew mentioned his ycsb repo:
>
>
> http://search-hadoop.com/m/DHED4NaxYb1/andrew+purtell+ycsb+2014&subj=Re+Performance+oddity+between+AWS+instance+sizes
>
> Cheers
>
> On Tue, Oct 21, 2014 at 7:15 PM, Qiang Tian <tianq01@gmail.com> wrote:
>
> > Thanks Ted.
> > do you mean I should rebuild the ycsb? could you point me Andrew's repo?
> >
> >
> > On Tue, Oct 21, 2014 at 5:37 PM, Ted Yu <yuzhihong@gmail.com> wrote:
> >
> > > Cycling bits:
> > > http://search-hadoop.com/m/DHED4N0syk1
> > >
> > > Andrew has his ycsb repo as well.
> > >
> > > Cheers
> > >
> > > On Oct 21, 2014, at 2:28 AM, Qiang Tian <tianq01@gmail.com> wrote:
> > >
> > > > Hi Guys,
> > > > I am running YCSB 0.1.4 against hbase 0.98.5,
> > > >
> > > > "bin/ycsb load hbase -P workloads/workloada -p columnfamily=f1 -p
> > > > recordcount=1000 -p threadcount=4 -s | tee -a workloada.dat" stucked
> as
> > > > below:
> > > >
> > > > 10 sec: 0 operations;
> > > > 20 sec: 0 operations;
> > > > 30 sec: 0 operations;
> > > > 40 sec: 0 operations;
> > > > 50 sec: 0 operations;
> > > > ...
> > > >
> > > > stacktrace shows YCSB is locating meta region:
> > > >
> > > > at java/lang/Object.wait(Object.java:201)
> > > > at
> > > >
> > >
> >
> org/apache/hadoop/hbase/zookeeper/ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:122)
> > > > (entered lock:
> > > >
> org/apache/hadoop/hbase/zookeeper/RootRegionTracker@0x00000000E01A02B0
> > ,
> > > > entry count: 1)
> > > > at
> > > >
> > >
> >
> org/apache/hadoop/hbase/zookeeper/RootRegionTracker.waitRootRegionLocation(RootRegionTracker.java:73)
> > > > at
> > > >
> > >
> >
> org/apache/hadoop/hbase/client/HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:786)
> > > > at
> > > >
> > >
> >
> org/apache/hadoop/hbase/client/HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:766)
> > > > at
> > > >
> > >
> >
> org/apache/hadoop/hbase/client/HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:895)
> > > > at
> > > >
> > >
> >
> org/apache/hadoop/hbase/client/HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:797)
> > > > at
> > > >
> > >
> >
> org/apache/hadoop/hbase/client/HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:766)
> > > > at
> > > >
> > >
> >
> org/apache/hadoop/hbase/client/HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:895)
> > > > at
> > > >
> > >
> >
> org/apache/hadoop/hbase/client/HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:801)
> > > > at
> > > >
> > >
> >
> org/apache/hadoop/hbase/client/HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:766)
> > > > at org/apache/hadoop/hbase/client/HTable.<init>(HTable.java:189)
> > > > at org/apache/hadoop/hbase/client/HTable.<init>(HTable.java:163)
> > > > at com/yahoo/ycsb/db/HBaseClient.getHTable(HBaseClient.java:111)
> > > > (entered lock: java/lang/Object@0x00000000E006AD20, entry count: 1)
> > > > at com/yahoo/ycsb/db/HBaseClient.update(HBaseClient.java:295)
> > > > at com/yahoo/ycsb/db/HBaseClient.insert(HBaseClient.java:350)
> > > > at com/yahoo/ycsb/DBWrapper.insert(DBWrapper.java:145)
> > > > at
> > com/yahoo/ycsb/workloads/CoreWorkload.doInsert(CoreWorkload.java:461)
> > > > at com/yahoo/ycsb/ClientThread.run(Client.java:269)
> > > >
> > > >
> > > > however looking at the RS log, the meta region is up successfully,
> > hbase
> > > > shell works fine. I can also see it in zk cli:
> > > >
> > > > [zk: localhost:2181(CONNECTED) 2] get /hbase/meta-region-server
> > > > ? regionserver:60020??|~md"PBUF
> > > >
> > > >  ihc028 ??  ?????)
> > > > cZxid = 0xc57
> > > > ctime = Tue Oct 21 16:23:41 CST 2014
> > > > mZxid = 0xc57
> > > > mtime = Tue Oct 21 16:23:41 CST 2014
> > > > pZxid = 0xc57
> > > > cversion = 0
> > > > dataVersion = 0
> > > > aclVersion = 0
> > > > ephemeralOwner = 0x0
> > > > dataLength = 71
> > > > numChildren = 0
> > > >
> > > >
> > > > is it a configure issue? anything wrong with my steps?
> > > > 1. on hbase master node, download ycsb-0.1.4.tar.gz
> > > > 2. copy all jars in hbase lib dir to hbase-binding/lib
> > > > 3. copy hbase-site.xml to hbase-binding/conf
> > > > 4. create table in hbase shell: create 'usertable','f1','f2','f3'
> > > > 5. load data via above command.
> > > >
> > > > thanks.
> > >
> >
>



-- 
Sean

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message