Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 58F1CDB8F for ; Wed, 15 May 2013 04:59:05 +0000 (UTC) Received: (qmail 99169 invoked by uid 500); 15 May 2013 04:59:00 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 98844 invoked by uid 500); 15 May 2013 04:58:59 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 98816 invoked by uid 99); 15 May 2013 04:58:58 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 May 2013 04:58:58 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of manoj.sundaram21@gmail.com designates 209.85.215.51 as permitted sender) Received: from [209.85.215.51] (HELO mail-la0-f51.google.com) (209.85.215.51) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 May 2013 04:58:54 +0000 Received: by mail-la0-f51.google.com with SMTP id ep20so1352727lab.10 for ; Tue, 14 May 2013 21:58:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=dtoSnCFzlh2R3szNSTcyQ1U0/bXB1vmeAMr3+lbrdZY=; b=cDbPAnV3wRMA+1u5QZ8y4gBaLPT7RKrPf1fiemzLT9FU8tvO8gatOw/w/4YjSTDmG5 QI3pNUsgj4FYe+1S/rJ7kp9TXpImwXAo6IJsfKWVMZk6FpOAF3qIjLNJBPN+ljAKevp3 LIQ8rMImnsmWasgg8/g8X4cAW4SWhA6EDRL6PYNJR4KJ0O5ej3Gnno4ZjZolvb69PPSE pbaL/Oq1eH6jrUdJrQSjaZ5/pK1aRSTozt8qG3P/327GT1ZsCZArryyZ/eL9NAS5IRt2 qxn8Da4OMQDei0YIwrHZTjHEOGhkoMv+yrKCzMtFcosMDCDXrqCwpw8FUqh3092XFat3 Hxyg== MIME-Version: 1.0 X-Received: by 10.112.171.7 with SMTP id aq7mr17080880lbc.130.1368593913255; Tue, 14 May 2013 21:58:33 -0700 (PDT) Received: by 10.112.147.233 with HTTP; Tue, 14 May 2013 21:58:33 -0700 (PDT) In-Reply-To: References: Date: Wed, 15 May 2013 10:28:33 +0530 Message-ID: Subject: Re: YCSB on hbase fails with java.io.EOFException From: Manoj S To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c387720a9aaa04dcba9af5 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c387720a9aaa04dcba9af5 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Yes, it is running fine. I am using version 0.94. Thanks, Manoj On Wed, May 15, 2013 at 10:14 AM, Ted Yu wrote: > I assume region server was running fine on /:60020 > > BTW what HBase version are you using ? > > Thanks > > On Tue, May 14, 2013 at 8:49 PM, Manoj S wrot= e: > >> Hi, >> >> I am trying to benchmark hbase with YCSB. >> >> # ./bin/ycsb load hbase -p columnfamily=3Dfamily -P workloads/workloada= > >> /tmp/loaddata.tmp >> >> Loading workload... >> >> Starting test. >> >> SLF4J: The requested version 1.5.8 by your slf4j binding is not >> compatible with [1.6] >> >> SLF4J: See http://www.slf4j.org/codes.html#version_mismatch for further >> details. >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:zookeeper.version=3D3.4.3-1240972, built on 02/06/2012 10:48= GMT >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:host.name >> =3D >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.version=3D1.6.0_24 >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.vendor=3DSun Microsystems Inc. >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.home=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/j= re >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.class.path=3D//ycsb-0.1.4/hbase-binding/conf://ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar://ycsb-0.1.4= /core/lib/core-0.1.4.jar://ycsb-0.1.4/voldemort-binding/conf://= ycsb-0.1.4/jdbc-binding/conf://ycsb-0.1.4/infinispan-binding/conf >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.library.path=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.= x86_64/jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/= jre/lib/amd64:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/../lib/amd= 64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.io.tmpdir=3D/tmp >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.compiler=3D >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:os.name >> =3DLinux >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:os.arch=3Damd64 >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:os.version=3D2.6.32-279.el6.x86_64 >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:user.name >> =3Dhbase >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:user.home=3D/var/run/hbase >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:user.dir=3D//ycsb-0.1.4 >> >> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Initiating client connection= , >> connectString=3D:2181 sessionTimeout=3D180000 watcher=3Dhconne= ction >> >> 13/05/15 11:31:50 INFO zookeeper.RecoverableZooKeeper: The identifier of >> this process is 24314@ >> >> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Opening socket connection t= o >> server /:2181 >> >> 13/05/15 11:31:50 INFO client.ZooKeeperSaslClient: Client will not >> SASL-authenticate because the default JAAS configuration section 'Client= ' >> could not be found. If you are not using SASL, you may ignore this. On t= he >> other hand, if you expected SASL to work, please fix your JAAS >> configuration. >> >> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Socket connection >> established to /:2181, initiating session >> >> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Session establishment >> complete on server /:2181, sessionid =3D 0x3ea192c11c1bff, >> negotiated timeout =3D 180000 >> >> Error accessing HBase table: java.io.IOException: Call to >> /:60020 failed on local exception: java.io.EOFException >> >> >> >> HBase+Zookeeper are running fine and i am able to perform other >> operations on it. The problem arises only when i use YCSB. >> >> >> >> *Some background info:* >> >> # netstat -ntpl | grep 60020 >> >> tcp 0 0 ::ffff: :60020 :::* >> LISTEN 115262/java >> >> >> >> # created user table with, >> >> # hbase org.apache.hadoop.hbase.util.RegionSplitter usertable >> UniformSplit -c 200 -f family >> >> Hbase related logs doesn't reveal anything. >> >> >> Can someone point me in the right direction? >> >> Thanks in advance for the help! >> >> -Manoj >> > > --001a11c387720a9aaa04dcba9af5 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Yes, it is running fine.

I am using vers= ion 0.94.

Thanks,
Manoj

On Wed, May 15, 2013 at 10:14 AM, Ted Yu <yuzhihong@gmail.com> wrote:
I assume region server was running fine on=A0<hostname>/<IP&g= t;:60020

BTW wh= at HBase version are you using ?

Thanks

On Tue, May 14= , 2013 at 8:49 PM, Manoj S <manoj.sundaram21@gmail.com> wrote:

Hi,

I am trying to benchmark hbase with YCSB.

#=A0 ./bin/ycsb load hbase -p columnfamily=3Dfamily -P workloads/workloada > /tmp/loaddata.tmp

Loading workload...

Starting test.

SLF4J: The requested version 1.5.8 by your slf4j binding is not compatible with [1.6]

SLF4J: See http://www.slf4j.org/codes.html#version_mismatch for further details.

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3D3.4.3-1240972, built on 02/06/2012 10:48 GM= T

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:host.name=3D= <hostname>

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.version=3D1.6.0_24

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.vendor=3DSun Microsystems Inc.

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.home=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre<= /p>

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.class.path=3D/<path>/ycsb-0.1.4/hbase-binding/conf:/= <path>/ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar:/<path= >/ycsb-0.1.4/core/lib/core-0.1.4.jar:/<path>/ycsb-0.1.4/voldemort-= binding/conf:/<path>/ycsb-0.1.4/jdbc-binding/conf:/<path>/ycsb-= 0.1.4/infinispan-binding/conf

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.library.path=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86= _64/jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre= /lib/amd64:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/../lib/amd64:= /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=3D/tmp

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.compiler=3D<NA>

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:os.name=3DLinu= x

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:os.arch=3Damd64

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:os.version=3D2.6.32-279.el6.x86_64

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:user.name=3D= hbase

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:user.home=3D/var/run/hbase

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:user.dir=3D/<path>/ycsb-0.1.4

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=3D<hostname>:2181 sessionTimeout=3D1= 80000 watcher=3Dhconnection

13/05/15 11:31:50 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 24314@<hostname>

13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Opening socket connection to server /<IP>:2181

13/05/15 11:31:50 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ign= ore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.

13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Socket connection established to <hostname>/<IP>:2181, initiating sess= ion

13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Session establishment complete on server <hostname>/<IP>:2181, sessioni= d =3D 0x3ea192c11c1bff, negotiated timeout =3D 180000

=A0Error accessing HBase table: java.io.IOException: Call to <hostname>/<IP>:60020 failed on local exception: java.io.EOFException

=A0

HBase+Zookeeper are running fine and i am able to perform other operations on it. The problem arises only when i use YCSB.

=A0

Some background info:

# netstat -ntpl | grep 60020

tcp=A0=A0=A0=A0=A0=A0=A0 0=A0=A0=A0=A0=A0 0 ::ffff: <IP>:60020=A0 :::*=A0=A0=A0=A0 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0LISTEN=A0=A0=A0=A0= =A0 115262/java

=A0

# created user table with,

# hbase org.apache.hadoop.hbase.util.RegionSplitter usertable UniformSplit -c 200 -f family

Hbase related logs doesn't reveal anything.


Can someone point me in the right direction?

Thanks in advance for the help!

-Manoj



--001a11c387720a9aaa04dcba9af5--