Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A22869294 for ; Thu, 16 May 2013 00:46:11 +0000 (UTC) Received: (qmail 57718 invoked by uid 500); 16 May 2013 00:46:06 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 57555 invoked by uid 500); 16 May 2013 00:46:06 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 57545 invoked by uid 99); 16 May 2013 00:46:06 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 May 2013 00:46:06 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW X-Spam-Check-By: apache.org Received-SPF: error (athena.apache.org: local policy) Received: from [209.85.128.178] (HELO mail-ve0-f178.google.com) (209.85.128.178) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 May 2013 00:46:02 +0000 Received: by mail-ve0-f178.google.com with SMTP id d10so1073467vea.9 for ; Wed, 15 May 2013 17:45:21 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type:x-gm-message-state; bh=llPmoWTMZrqNuYXjulOdlNGdyjuJavXnvefLIkmJHkQ=; b=A5fjd+mH9vBK4Omv72MvE9tgGwdOx1vw24CQHmd/yz9rC39W4TdMS32TVIZ8URi1l/ eKHK3oliqgqGLDUT4i23CwBXr8ugn3JXwn6e2t4ycjLyQw6CyZvXeNsdidS0WBKX7Ojv h4dmUNtioI9CqQZ4SRrPbjCSvz5VYjWV4i8XmRtxgKThJ8HrQPdLUAQGSo6n1IY4LEL+ NprhuOkQ23yUMz0xBM14oxCeMxh16CWeFzjCxUCTHmAhc7OgROWVBYnpXSRUuijB25Ey pOAk5RgxEhP/31GT56OcYhsLb+Vt+dPxK/MzUvBRAlBwJpuz3FEJW2TO1PrXEsLVCEWi 1jkg== X-Received: by 10.52.165.36 with SMTP id yv4mr22669082vdb.31.1368665121119; Wed, 15 May 2013 17:45:21 -0700 (PDT) MIME-Version: 1.0 Received: by 10.52.71.110 with HTTP; Wed, 15 May 2013 17:44:59 -0700 (PDT) In-Reply-To: References: <28FB997138213643B5B0DE2FB8392A230155FC17@BGSMSX103.gar.corp.intel.com> From: Jean-Marc Spaggiari Date: Wed, 15 May 2013 20:44:59 -0400 Message-ID: Subject: Re: YCSB on hbase fails with java.io.EOFException To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c2c0105cb9d604dccb2ed9 X-Gm-Message-State: ALoCoQmqyfCRMNvNQwdjrx8syhzmDjnWwBAY1i8pd33kmG7OxyvLVB3sB3kaQD0lw+cC/WkWiaAv X-Virus-Checked: Checked by ClamAV on apache.org --001a11c2c0105cb9d604dccb2ed9 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Manoj, Is it a production environment? Or a test environment? If it's a test one, can you try with a recent versoin like 0.94.7? Else I will try to instal 0.94.1 locally... JM 2013/5/15 Manoj S > Hi Jean, > > I am using 0.94.1 > > -Manoj > > On May 15, 2013 8:05 PM, "Jean-Marc Spaggiari" > wrote: > > > > Regarding the version, which 0.94 are you using? 0.94.1? Or 0.94.7? I > will install it locally and give it a try... > > > > 2013/5/15 S, Manoj > > > >> Hi Jean, > >> > >> Yeah. All these operations work fine. > >> > >> Thanks, > >> Manoj > >> > >> > >> > >> -----Original Message----- > >> From: Jean-Marc Spaggiari [jean-marc@spaggiari.org] > >> Sent: Wednesday, May 15, 2013 07:58 PM Malay Peninsula Standard Time > >> To: user@hadoop.apache.org > >> Subject: Re: YCSB on hbase fails with java.io.EOFException > >> > >> Hi Manoj, > >> > >> Are you able to do basic operations with HBase shell? Like scan, put, > get, etc.? > >> > >> WebUI is show tables correctly too? > >> > >> 2013/5/15 Manoj S > >>> > >>> Yes, it is running fine. > >>> > >>> I am using version 0.94. > >>> > >>> Thanks, > >>> Manoj > >>> > >>> On Wed, May 15, 2013 at 10:14 AM, Ted Yu wrote: > >>>> > >>>> I assume region server was running fine on /:60020 > >>>> > >>>> BTW what HBase version are you using ? > >>>> > >>>> Thanks > >>>> > >>>> On Tue, May 14, 2013 at 8:49 PM, Manoj S > wrote: > >>>>> > >>>>> Hi, > >>>>> > >>>>> I am trying to benchmark hbase with YCSB. > >>>>> > >>>>> # ./bin/ycsb load hbase -p columnfamily=3Dfamily -P > workloads/workloada > /tmp/loaddata.tmp > >>>>> > >>>>> Loading workload... > >>>>> > >>>>> Starting test. > >>>>> > >>>>> SLF4J: The requested version 1.5.8 by your slf4j binding is not > compatible with [1.6] > >>>>> > >>>>> SLF4J: See http://www.slf4j.org/codes.html#version_mismatch for > further details. > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client > environment:zookeeper.version=3D3.4.3-1240972, built on 02/06/2012 10:48 = GMT > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment: > host.name=3D > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client > environment:java.version=3D1.6.0_24 > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client > environment:java.vendor=3DSun Microsystems Inc. > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client > environment:java.home=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jr= e > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client > environment:java.class.path=3D//ycsb-0.1.4/hbase-binding/conf://ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar://ycsb-0.1.4/= core/lib/core-0.1.4.jar://ycsb-0.1.4/voldemort-binding/conf://y= csb-0.1.4/jdbc-binding/conf://ycsb-0.1.4/infinispan-binding/conf > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client > environment:java.library.path=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x= 86_64/jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/j= re/lib/amd64:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/../lib/amd6= 4:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client > environment:java.io.tmpdir=3D/tmp > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client > environment:java.compiler=3D > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment: > os.name=3DLinux > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client > environment:os.arch=3Damd64 > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client > environment:os.version=3D2.6.32-279.el6.x86_64 > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment: > user.name=3Dhbase > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client > environment:user.home=3D/var/run/hbase > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client > environment:user.dir=3D//ycsb-0.1.4 > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Initiating client > connection, connectString=3D:2181 sessionTimeout=3D180000 > watcher=3Dhconnection > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.RecoverableZooKeeper: The > identifier of this process is 24314@ > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Opening socket > connection to server /:2181 > >>>>> > >>>>> 13/05/15 11:31:50 INFO client.ZooKeeperSaslClient: Client will not > SASL-authenticate because the default JAAS configuration section 'Client' > could not be found. If you are not using SASL, you may ignore this. On th= e > other hand, if you expected SASL to work, please fix your JAAS > configuration. > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Socket connection > established to /:2181, initiating session > >>>>> > >>>>> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Session establishment > complete on server /:2181, sessionid =3D 0x3ea192c11c1bff, > negotiated timeout =3D 180000 > >>>>> > >>>>> Error accessing HBase table: java.io.IOException: Call to > /:60020 failed on local exception: java.io.EOFException > >>>>> > >>>>> > >>>>> > >>>>> HBase+Zookeeper are running fine and i am able to perform other > operations on it. The problem arises only when i use YCSB. > >>>>> > >>>>> > >>>>> > >>>>> Some background info: > >>>>> > >>>>> # netstat -ntpl | grep 60020 > >>>>> > >>>>> tcp 0 0 ::ffff: :60020 :::* > LISTEN 115262/java > >>>>> > >>>>> > >>>>> > >>>>> # created user table with, > >>>>> > >>>>> # hbase org.apache.hadoop.hbase.util.RegionSplitter usertable > UniformSplit -c 200 -f family > >>>>> > >>>>> Hbase related logs doesn't reveal anything. > >>>>> > >>>>> > >>>>> Can someone point me in the right direction? > >>>>> > >>>>> Thanks in advance for the help! > >>>>> > >>>>> -Manoj > >>>> > >>>> > >>> > >> > > > --001a11c2c0105cb9d604dccb2ed9 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Manoj,

Is it a production environment? Or a test environment? If = it's a test one, can you try with a recent versoin like 0.94.7?

= Else I will try to instal 0.94.1 locally...

JM

2013/5/15 Manoj S <manoj.sundaram21@gmail.com>
<= blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px= #ccc solid;padding-left:1ex">

Hi Jean,

I am using 0.94.1

-Manoj

On May 15, 2013 8:05 PM, "Jean-Marc Spaggiari" <jean-marc@spaggiari.org> wrote:
>
> Regarding the version, which 0.94 are you using? 0.94.1? Or 0.94.7? I = will install it locally and give it a try...
>
> 2013/5/15 S, Manoj <manoj.s@intel.com>
>
>> Hi Jean,
>>
>> Yeah. All these operations work fine.
>>
>> Thanks,
>> Manoj
>>
>>
>>
>> -----Original Message-----
>> From:=C2=A0Jean-Marc Spaggiari [jean-marc@spaggiari.org]
>> Sent:=C2=A0Wednesday, May 15, 2013 07:58 PM Malay Peninsula Standa= rd Time
>> To:=C2=A0user@hadoop.apache.org
>> Subject:=C2=A0Re: YCSB on hbase fails with java.io.EOFException >>
>> Hi Manoj,
>>
>> Are you able to do basic operations with HBase shell? Like scan, p= ut, get, etc.?
>>
>> WebUI is show tables correctly too?
>>
>> 2013/5/15 Manoj S <manoj.sundaram21@gmail.com>
>>>
>>> Yes, it is running fine.
>>>
>>> I am using version 0.94.
>>>
>>> Thanks,
>>> Manoj
>>>
>>> On Wed, May 15, 2013 at 10:14 AM, Ted Yu <yuzhihong@gmail.com> wrote:<= br> >>>>
>>>> I assume region server was running fine on=C2=A0<hostna= me>/<IP>:60020
>>>>
>>>> BTW what HBase version are you using ?
>>>>
>>>> Thanks
>>>>
>>>> On Tue, May 14, 2013 at 8:49 PM, Manoj S <manoj.sundaram21@gmail.c= om> wrote:
>>>>>
>>>>> Hi,
>>>>>
>>>>> I am trying to benchmark hbase with YCSB.
>>>>>
>>>>> #=C2=A0 ./bin/ycsb load hbase -p columnfamily=3Dfamily= -P workloads/workloada > /tmp/loaddata.tmp
>>>>>
>>>>> Loading workload...
>>>>>
>>>>> Starting test.
>>>>>
>>>>> SLF4J: The requested version 1.5.8 by your slf4j bindi= ng is not compatible with [1.6]
>>>>>
>>>>> SLF4J: See http://www.slf4j.org/codes.html#version= _mismatch for further details.
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:zookeeper.version=3D3.4.3-1240972, built on 02/06/2012 10:48 GMT >>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:host.name=3D<= ;hostname>
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:java.version=3D1.6.0_24
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:java.vendor=3DSun Microsystems Inc.
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:java.home=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:java.class.path=3D/<path>/ycsb-0.1.4/hbase-binding/conf:/<= ;path>/ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar:/<path>= ;/ycsb-0.1.4/core/lib/core-0.1.4.jar:/<path>/ycsb-0.1.4/voldemort-bin= ding/conf:/<path>/ycsb-0.1.4/jdbc-binding/conf:/<path>/ycsb-0.1= .4/infinispan-binding/conf
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:java.library.path=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64= /jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/li= b/amd64:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/../lib/amd64:/us= r/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:java.io.tmpdir=3D/tmp
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:java.compiler=3D<NA>
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:os.name=3DLinux >>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:os.arch=3Damd64
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:os.version=3D2.6.32-279.el6.x86_64
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:user.name=3Dhba= se
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:user.home=3D/var/run/hbase
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client env= ironment:user.dir=3D/<path>/ycsb-0.1.4
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Initiating= client connection, connectString=3D<hostname>:2181 sessionTimeout=3D= 180000 watcher=3Dhconnection
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.RecoverableZooKeeper:= The identifier of this process is 24314@<hostname>
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Opening s= ocket connection to server /<IP>:2181
>>>>>
>>>>> 13/05/15 11:31:50 INFO client.ZooKeeperSaslClient: Cli= ent will not SASL-authenticate because the default JAAS configuration secti= on 'Client' could not be found. If you are not using SASL, you may = ignore this. On the other hand, if you expected SASL to work, please fix yo= ur JAAS configuration.
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Socket co= nnection established to <hostname>/<IP>:2181, initiating sessio= n
>>>>>
>>>>> 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Session e= stablishment complete on server <hostname>/<IP>:2181, sessionid= =3D 0x3ea192c11c1bff, negotiated timeout =3D 180000
>>>>>
>>>>> =C2=A0Error accessing HBase table: java.io.IOException= : Call to <hostname>/<IP>:60020 failed on local exception: java= .io.EOFException
>>>>>
>>>>> =C2=A0
>>>>>
>>>>> HBase+Zookeeper are running fine and i am able to perf= orm other operations on it. The problem arises only when i use YCSB.
>>>>>
>>>>> =C2=A0
>>>>>
>>>>> Some background info:
>>>>>
>>>>> # netstat -ntpl | grep 60020
>>>>>
>>>>> tcp=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 0 ::ffff: <IP>:60020=C2=A0 :::*=C2=A0=C2=A0= =C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0LISTEN=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 115262/java
>>>>>
>>>>> =C2=A0
>>>>>
>>>>> # created user table with,
>>>>>
>>>>> # hbase org.apache.hadoop.hbase.util.RegionSplitter us= ertable UniformSplit -c 200 -f family
>>>>>
>>>>> Hbase related logs doesn't reveal anything.
>>>>>
>>>>>
>>>>> Can someone point me in the right direction?
>>>>>
>>>>> Thanks in advance for the help!
>>>>>
>>>>> -Manoj
>>>>
>>>>
>>>
>>
>


--001a11c2c0105cb9d604dccb2ed9--