Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 62A00DD23 for ; Fri, 17 May 2013 01:32:43 +0000 (UTC) Received: (qmail 59260 invoked by uid 500); 17 May 2013 01:32:38 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 59120 invoked by uid 500); 17 May 2013 01:32:38 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 59113 invoked by uid 99); 17 May 2013 01:32:38 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 May 2013 01:32:38 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW X-Spam-Check-By: apache.org Received-SPF: error (nike.apache.org: local policy) Received: from [209.85.220.169] (HELO mail-vc0-f169.google.com) (209.85.220.169) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 May 2013 01:32:32 +0000 Received: by mail-vc0-f169.google.com with SMTP id kw10so3244638vcb.14 for ; Thu, 16 May 2013 18:31:51 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type:x-gm-message-state; bh=qvWXPNNX1VENwoYhP7wpN6b8IcV2us46HvOgg6EEAsQ=; b=S99aM3UNSZkburbwAvl8mO3X9/xvbPESM8lO27uEEOnhBCQNxKoSo6ki4M/gfAQgPI tHSvWZDl27pLGjBXhnydzdghnaQe+4y+VoDx7Y7lTRdbaJ7QqzxYn4dX5plQKW3mJhTn 6XwLCzpNUekGjSzgaugXTpARZpJ06wdtFHkvilYAb0rvFLz7yZe3GItuzD6yTjy1MNVU NRjw1b3RT8VWcxhZXrCgTtjGzN5LZ9lFL0PQw6ComojvrMRsqwLpY3Oh7cnPN7OLUQMy PvcWwUubtlZOUaa7jkQzttKkd1bt6rSk5U7aYydXnMF095Y8PXxWe8kiPPOCtKfgNDx+ q62g== X-Received: by 10.220.202.197 with SMTP id ff5mr28765242vcb.3.1368754311280; Thu, 16 May 2013 18:31:51 -0700 (PDT) MIME-Version: 1.0 Received: by 10.52.165.45 with HTTP; Thu, 16 May 2013 18:31:31 -0700 (PDT) In-Reply-To: References: <28FB997138213643B5B0DE2FB8392A230155FC17@BGSMSX103.gar.corp.intel.com> From: Jean-Marc Spaggiari Date: Thu, 16 May 2013 21:31:31 -0400 Message-ID: Subject: Re: YCSB on hbase fails with java.io.EOFException To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=089e0158a8888253ab04dcdff27d X-Gm-Message-State: ALoCoQkhi+8sYF0xqw+3jFnACJotqTn228WZCnpWd6B3L/CL9BgUhtcZn6Gy3MFaGB9lXGSkV40N X-Virus-Checked: Checked by ClamAV on apache.org --089e0158a8888253ab04dcdff27d Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Manoj, I installed 0.94.1 and YCSB and everything is working fine. Which YCSB version are you using? Can you try to export the one from GitHub= ? JM 2013/5/15 Jean-Marc Spaggiari > No worries. I will prepare a VM and install 0.94.1 on it. > > I will let you know when it's done. > > > JM > > 2013/5/15 Manoj S > >> Jean, >> >> Unfortunately, I will not be able to install a newer version of HBase an= d >> test :( >> >> It is a production environment. >> >> Appreciate your help! >> >> -Manoj >> >> On May 16, 2013 8:46 AM, "Jean-Marc Spaggiari" >> wrote: >> > >> > Hi Manoj, >> > >> > Is it a production environment? Or a test environment? If it's a test >> one, can you try with a recent versoin like 0.94.7? >> > >> > Else I will try to instal 0.94.1 locally... >> > >> > JM >> > >> > >> > 2013/5/15 Manoj S >> >> >> >> Hi Jean, >> >> >> >> I am using 0.94.1 >> >> >> >> -Manoj >> >> >> >> On May 15, 2013 8:05 PM, "Jean-Marc Spaggiari" < >> jean-marc@spaggiari.org> wrote: >> >> > >> >> > Regarding the version, which 0.94 are you using? 0.94.1? Or 0.94.7? >> I will install it locally and give it a try... >> >> > >> >> > 2013/5/15 S, Manoj >> >> > >> >> >> Hi Jean, >> >> >> >> >> >> Yeah. All these operations work fine. >> >> >> >> >> >> Thanks, >> >> >> Manoj >> >> >> >> >> >> >> >> >> >> >> >> -----Original Message----- >> >> >> From: Jean-Marc Spaggiari [jean-marc@spaggiari.org] >> >> >> Sent: Wednesday, May 15, 2013 07:58 PM Malay Peninsula Standard Ti= me >> >> >> To: user@hadoop.apache.org >> >> >> Subject: Re: YCSB on hbase fails with java.io.EOFException >> >> >> >> >> >> Hi Manoj, >> >> >> >> >> >> Are you able to do basic operations with HBase shell? Like scan, >> put, get, etc.? >> >> >> >> >> >> WebUI is show tables correctly too? >> >> >> >> >> >> 2013/5/15 Manoj S >> >> >>> >> >> >>> Yes, it is running fine. >> >> >>> >> >> >>> I am using version 0.94. >> >> >>> >> >> >>> Thanks, >> >> >>> Manoj >> >> >>> >> >> >>> On Wed, May 15, 2013 at 10:14 AM, Ted Yu >> wrote: >> >> >>>> >> >> >>>> I assume region server was running fine on /:60020 >> >> >>>> >> >> >>>> BTW what HBase version are you using ? >> >> >>>> >> >> >>>> Thanks >> >> >>>> >> >> >>>> On Tue, May 14, 2013 at 8:49 PM, Manoj S < >> manoj.sundaram21@gmail.com> wrote: >> >> >>>>> >> >> >>>>> Hi, >> >> >>>>> >> >> >>>>> I am trying to benchmark hbase with YCSB. >> >> >>>>> >> >> >>>>> # ./bin/ycsb load hbase -p columnfamily=3Dfamily -P >> workloads/workloada > /tmp/loaddata.tmp >> >> >>>>> >> >> >>>>> Loading workload... >> >> >>>>> >> >> >>>>> Starting test. >> >> >>>>> >> >> >>>>> SLF4J: The requested version 1.5.8 by your slf4j binding is not >> compatible with [1.6] >> >> >>>>> >> >> >>>>> SLF4J: See http://www.slf4j.org/codes.html#version_mismatch for >> further details. >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:zookeeper.version=3D3.4.3-1240972, built on 02/06/2012 10:48= GMT >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment: >> host.name=3D >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.version=3D1.6.0_24 >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.vendor=3DSun Microsystems Inc. >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.home=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/j= re >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.class.path=3D//ycsb-0.1.4/hbase-binding/conf://ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar://ycsb-0.1.4= /core/lib/core-0.1.4.jar://ycsb-0.1.4/voldemort-binding/conf://= ycsb-0.1.4/jdbc-binding/conf://ycsb-0.1.4/infinispan-binding/conf >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.library.path=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.= x86_64/jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/= jre/lib/amd64:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/../lib/amd= 64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.io.tmpdir=3D/tmp >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:java.compiler=3D >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment: >> os.name=3DLinux >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:os.arch=3Damd64 >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:os.version=3D2.6.32-279.el6.x86_64 >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment: >> user.name=3Dhbase >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:user.home=3D/var/run/hbase >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client >> environment:user.dir=3D//ycsb-0.1.4 >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Initiating client >> connection, connectString=3D:2181 sessionTimeout=3D180000 >> watcher=3Dhconnection >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.RecoverableZooKeeper: The >> identifier of this process is 24314@ >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Opening socket >> connection to server /:2181 >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO client.ZooKeeperSaslClient: Client will >> not SASL-authenticate because the default JAAS configuration section >> 'Client' could not be found. If you are not using SASL, you may ignore >> this. On the other hand, if you expected SASL to work, please fix your J= AAS >> configuration. >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Socket connection >> established to /:2181, initiating session >> >> >>>>> >> >> >>>>> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Session >> establishment complete on server /:2181, sessionid =3D >> 0x3ea192c11c1bff, negotiated timeout =3D 180000 >> >> >>>>> >> >> >>>>> Error accessing HBase table: java.io.IOException: Call to >> /:60020 failed on local exception: java.io.EOFException >> >> >>>>> >> >> >>>>> >> >> >>>>> >> >> >>>>> HBase+Zookeeper are running fine and i am able to perform other >> operations on it. The problem arises only when i use YCSB. >> >> >>>>> >> >> >>>>> >> >> >>>>> >> >> >>>>> Some background info: >> >> >>>>> >> >> >>>>> # netstat -ntpl | grep 60020 >> >> >>>>> >> >> >>>>> tcp 0 0 ::ffff: :60020 :::* >> LISTEN 115262/java >> >> >>>>> >> >> >>>>> >> >> >>>>> >> >> >>>>> # created user table with, >> >> >>>>> >> >> >>>>> # hbase org.apache.hadoop.hbase.util.RegionSplitter usertable >> UniformSplit -c 200 -f family >> >> >>>>> >> >> >>>>> Hbase related logs doesn't reveal anything. >> >> >>>>> >> >> >>>>> >> >> >>>>> Can someone point me in the right direction? >> >> >>>>> >> >> >>>>> Thanks in advance for the help! >> >> >>>>> >> >> >>>>> -Manoj >> >> >>>> >> >> >>>> >> >> >>> >> >> >> >> >> > >> > >> > >> > > --089e0158a8888253ab04dcdff27d Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Manoj,

I installed 0.94.1 and YCSB and everything is working fine= .

Which YCSB version are you using? Can you try to export the one fr= om GitHub?

JM

2013/5/15 Jean-Marc = Spaggiari <jean-marc@spaggiari.org>
No worries. I will prepare a VM and install = 0.94.1 on it.

I will let you know when it's done.


JM

2013/5/15 Ma= noj S <manoj.sundaram21@gmail.com>

Jean,

Unfortunately, I will not be able to install a newer version of HBase an= d test :(

It is a production environment.

Appreciate your help!

-Manoj

On May 16, 2013 8:46 AM, "Jean-Marc Spaggiari" <jean-marc@spaggiari.org> wrote:
>
> Hi Manoj,
>
> Is it a production environment? Or a test environment? If it's a t= est one, can you try with a recent versoin like 0.94.7?
>
> Else I will try to instal 0.94.1 locally...
>
> JM
>
>
> 2013/5/15 Manoj S <manoj.sundaram21@gmail.com>
>>
>> Hi Jean,
>>
>> I am using 0.94.1
>>
>> -Manoj
>>
>> On May 15, 2013 8:05 PM, "Jean-Marc Spaggiari" <jean-marc@spaggiari= .org> wrote:
>> >
>> > Regarding the version, which 0.94 are you using? 0.94.1? Or 0= .94.7? I will install it locally and give it a try...
>> >
>> > 2013/5/15 S, Manoj <manoj.s@intel.com>
>> >
>> >> Hi Jean,
>> >>
>> >> Yeah. All these operations work fine.
>> >>
>> >> Thanks,
>> >> Manoj
>> >>
>> >>
>> >>
>> >> -----Original Message-----
>> >> From:=C2=A0Jean-Marc Spaggiari [jean-marc@spaggiari.org]
>> >> Sent:=C2=A0Wednesday, May 15, 2013 07:58 PM Malay Peninsu= la Standard Time
>> >> To:=C2=A0user@hadoop.apache.org
>> >> Subject:=C2=A0Re: YCSB on hbase fails with java.io.EOFExc= eption
>> >>
>> >> Hi Manoj,
>> >>
>> >> Are you able to do basic operations with HBase shell? Lik= e scan, put, get, etc.?
>> >>
>> >> WebUI is show tables correctly too?
>> >>
>> >> 2013/5/15 Manoj S <manoj.sundaram21@gmail.com>
>> >>>
>> >>> Yes, it is running fine.
>> >>>
>> >>> I am using version 0.94.
>> >>>
>> >>> Thanks,
>> >>> Manoj
>> >>>
>> >>> On Wed, May 15, 2013 at 10:14 AM, Ted Yu <yuzhihong@gmail.com&g= t; wrote:
>> >>>>
>> >>>> I assume region server was running fine on=C2=A0&= lt;hostname>/<IP>:60020
>> >>>>
>> >>>> BTW what HBase version are you using ?
>> >>>>
>> >>>> Thanks
>> >>>>
>> >>>> On Tue, May 14, 2013 at 8:49 PM, Manoj S <manoj.sundaram2= 1@gmail.com> wrote:
>> >>>>>
>> >>>>> Hi,
>> >>>>>
>> >>>>> I am trying to benchmark hbase with YCSB.
>> >>>>>
>> >>>>> #=C2=A0 ./bin/ycsb load hbase -p columnfamily= =3Dfamily -P workloads/workloada > /tmp/loaddata.tmp
>> >>>>>
>> >>>>> Loading workload...
>> >>>>>
>> >>>>> Starting test.
>> >>>>>
>> >>>>> SLF4J: The requested version 1.5.8 by your sl= f4j binding is not compatible with [1.6]
>> >>>>>
>> >>>>> SLF4J: See http://www.slf4j.org/codes.htm= l#version_mismatch for further details.
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:zookeeper.version=3D3.4.3-1240972, built on 02/06/2012 10= :48 GMT
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:host.name<= /a>=3D<hostname>
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:java.version=3D1.6.0_24
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:java.vendor=3DSun Microsystems Inc.
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:java.home=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_6= 4/jre
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:java.class.path=3D/<path>/ycsb-0.1.4/hbase-binding/= conf:/<path>/ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar:/&l= t;path>/ycsb-0.1.4/core/lib/core-0.1.4.jar:/<path>/ycsb-0.1.4/vold= emort-binding/conf:/<path>/ycsb-0.1.4/jdbc-binding/conf:/<path>= /ycsb-0.1.4/infinispan-binding/conf
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:java.library.path=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0= .0.x86_64/jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_= 64/jre/lib/amd64:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/../lib/= amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:java.io.tmpdir=3D/tmp
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:java.compiler=3D<NA>
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:os.name= =3DLinux
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:os.arch=3Damd64
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:os.version=3D2.6.32-279.el6.x86_64
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:user.name<= /a>=3Dhbase
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:user.home=3D/var/run/hbase
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: C= lient environment:user.dir=3D/<path>/ycsb-0.1.4
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: I= nitiating client connection, connectString=3D<hostname>:2181 sessionT= imeout=3D180000 watcher=3Dhconnection
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.RecoverableZ= ooKeeper: The identifier of this process is 24314@<hostname>
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: = Opening socket connection to server /<IP>:2181
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO client.ZooKeeperSaslCl= ient: Client will not SASL-authenticate because the default JAAS configurat= ion section 'Client' could not be found. If you are not using SASL,= you may ignore this. On the other hand, if you expected SASL to work, plea= se fix your JAAS configuration.
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: = Socket connection established to <hostname>/<IP>:2181, initiati= ng session
>> >>>>>
>> >>>>> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: = Session establishment complete on server <hostname>/<IP>:2181, = sessionid =3D 0x3ea192c11c1bff, negotiated timeout =3D 180000
>> >>>>>
>> >>>>> =C2=A0Error accessing HBase table: java.io.IO= Exception: Call to <hostname>/<IP>:60020 failed on local except= ion: java.io.EOFException
>> >>>>>
>> >>>>> =C2=A0
>> >>>>>
>> >>>>> HBase+Zookeeper are running fine and i am abl= e to perform other operations on it. The problem arises only when i use YCS= B.
>> >>>>>
>> >>>>> =C2=A0
>> >>>>>
>> >>>>> Some background info:
>> >>>>>
>> >>>>> # netstat -ntpl | grep 60020
>> >>>>>
>> >>>>> tcp=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0 ::ffff: <IP>:60020=C2=A0 :::*=C2= =A0=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0LISTEN=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 115262/java
>> >>>>>
>> >>>>> =C2=A0
>> >>>>>
>> >>>>> # created user table with,
>> >>>>>
>> >>>>> # hbase org.apache.hadoop.hbase.util.RegionSp= litter usertable UniformSplit -c 200 -f family
>> >>>>>
>> >>>>> Hbase related logs doesn't reveal anythin= g.
>> >>>>>
>> >>>>>
>> >>>>> Can someone point me in the right direction?<= br> >> >>>>>
>> >>>>> Thanks in advance for the help!
>> >>>>>
>> >>>>> -Manoj
>> >>>>
>> >>>>
>> >>>
>> >>
>> >
>
>



--089e0158a8888253ab04dcdff27d--