Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DD5B4D5B3 for ; Wed, 15 May 2013 03:50:21 +0000 (UTC) Received: (qmail 35833 invoked by uid 500); 15 May 2013 03:50:17 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 35413 invoked by uid 500); 15 May 2013 03:50:16 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 35389 invoked by uid 99); 15 May 2013 03:50:16 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 May 2013 03:50:16 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of manoj.sundaram21@gmail.com designates 209.85.210.169 as permitted sender) Received: from [209.85.210.169] (HELO mail-ia0-f169.google.com) (209.85.210.169) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 May 2013 03:50:10 +0000 Received: by mail-ia0-f169.google.com with SMTP id k38so1634122iah.0 for ; Tue, 14 May 2013 20:49:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:date:message-id:subject:from:to :content-type; bh=1k1RQ6igERpyM7f04VpnFP0xiMb57sODpkgTFvj80zY=; b=bxDLn7+aq+nVHcWwCBxHng2BcxFH08u1D0ONKrGRCDRp+iRxXdB/uqsi9iQMaYfAUf urRPswgiAwvq+WxUw2kh94ghELsmpsCHeVd5NiY+zsyf7p5Zz+n7S3XaCQxDAosYdds4 Q9lekMFCn6WgOqRGfWAgTvRUGFpQZaylDmae98yVDtwjP4DoMDZUJ6u1W4u3cEo3b1el nI6pC7eBSnAi7Ffgn1LWnpkryRXsQzm13HwZ46pIYm6pIKn9h6NaOqr8Pjtj5ygb45Cd 6rUvTV3vhYOHQjMxfbnIxFxaOvSE7UM0qNySQlIFFWU5DNCpqCQ755zk/PU/f4M2DHhg oTpA== MIME-Version: 1.0 X-Received: by 10.50.114.161 with SMTP id jh1mr4235465igb.112.1368589789111; Tue, 14 May 2013 20:49:49 -0700 (PDT) Received: by 10.64.23.135 with HTTP; Tue, 14 May 2013 20:49:48 -0700 (PDT) Date: Wed, 15 May 2013 09:19:48 +0530 Message-ID: Subject: YCSB on hbase fails with java.io.EOFException From: Manoj S To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=089e0122ac44392b4e04dcb9a4b4 X-Virus-Checked: Checked by ClamAV on apache.org --089e0122ac44392b4e04dcb9a4b4 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi, I am trying to benchmark hbase with YCSB. # ./bin/ycsb load hbase -p columnfamily=3Dfamily -P workloads/workloada > /tmp/loaddata.tmp Loading workload... Starting test. SLF4J: The requested version 1.5.8 by your slf4j binding is not compatible with [1.6] SLF4J: See http://www.slf4j.org/codes.html#version_mismatch for further details. 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3D3.4.3-1240972, built on 02/06/2012 10:48 GM= T 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:host.name =3D 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.version=3D1.6.0_24 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.vendor=3DSun Microsystems Inc. 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.home=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.class.path=3D//ycsb-0.1.4/hbase-binding/conf:/= /ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar://ycsb-0.1.4/co= re/lib/core-0.1.4.jar://ycsb-0.1.4/voldemort-binding/conf://ycs= b-0.1.4/jdbc-binding/conf://ycsb-0.1.4/infinispan-binding/conf 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.library.path=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86= _64/jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre= /lib/amd64:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/../lib/amd64:= /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=3D/tmp 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.compiler=3D 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:os.name=3DLi= nux 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:os.arch=3Dam= d64 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:os.version=3D2.6.32-279.el6.x86_64 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:user.name =3Dhbase 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:user.home=3D/var/run/hbase 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:user.dir=3D//ycsb-0.1.4 13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=3D:2181 sessionTimeout=3D180000 watcher=3Dhconnecti= on 13/05/15 11:31:50 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 24314@ 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Opening socket connection to server /:2181 13/05/15 11:31:50 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration. 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Socket connection established to /:2181, initiating session 13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Session establishment complete on server /:2181, sessionid =3D 0x3ea192c11c1bff, negotiated timeout =3D 180000 Error accessing HBase table: java.io.IOException: Call to /:60020 failed on local exception: java.io.EOFException HBase+Zookeeper are running fine and i am able to perform other operations on it. The problem arises only when i use YCSB. *Some background info:* # netstat -ntpl | grep 60020 tcp 0 0 ::ffff: :60020 :::* LISTEN 115262/java # created user table with, # hbase org.apache.hadoop.hbase.util.RegionSplitter usertable UniformSplit -c 200 -f family Hbase related logs doesn't reveal anything. Can someone point me in the right direction? Thanks in advance for the help! -Manoj --089e0122ac44392b4e04dcb9a4b4 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

Hi,

I am trying to benchmark hbase with YCSB.

#=A0 ./bin/ycsb load hbase -p columnfamily=3Dfamily -P workloads/workloada > /tmp/loaddata.tmp

Loading workload...

Starting test.

SLF4J: The requested version 1.5.8 by your slf4j binding is not compatible with [1.6]

SLF4J: See http://www.slf4j.org/codes.html#version_mismatch for further details.

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3D3.4.3-1240972, built on 02/06/2012 10:48 GM= T

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:host.name=3D<hostname>

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.version=3D1.6.0_24

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.vendor=3DSun Microsystems Inc.

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.home=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre<= /p>

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.class.path=3D/<path>/ycsb-0.1.4/hbase-binding/conf:/= <path>/ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar:/<path= >/ycsb-0.1.4/core/lib/core-0.1.4.jar:/<path>/ycsb-0.1.4/voldemort-= binding/conf:/<path>/ycsb-0.1.4/jdbc-binding/conf:/<path>/ycsb-= 0.1.4/infinispan-binding/conf

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.library.path=3D/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86= _64/jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre= /lib/amd64:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/../lib/amd64:= /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=3D/tmp

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:java.compiler=3D<NA>

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:os.name=3DLinux

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:os.arch=3Damd64

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:os.version=3D2.6.32-279.el6.x86_64

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:user.name=3Dhbase

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:user.home=3D/var/run/hbase

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Client environment:user.dir=3D/<path>/ycsb-0.1.4

13/05/15 11:31:50 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=3D<hostname>:2181 sessionTimeout=3D1= 80000 watcher=3Dhconnection

13/05/15 11:31:50 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 24314@<hostname>

13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Opening socket connection to server /<IP>:2181

13/05/15 11:31:50 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ign= ore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.

13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Socket connection established to <hostname>/<IP>:2181, initiating sess= ion

13/05/15 11:31:50 INFO zookeeper.ClientCnxn: Session establishment complete on server <hostname>/<IP>:2181, sessioni= d =3D 0x3ea192c11c1bff, negotiated timeout =3D 180000

=A0Error accessing HBase table: java.io.IOException: Call to <hostname>/<IP>:60020 failed on local exception: java.io.EOFException

=A0

HBase+Zookeeper are running fine and i am able to perform other operations on it. The problem arises only when i use YCSB.

=A0

Some background info:

# netstat -ntpl | grep 60020

tcp=A0=A0=A0=A0=A0=A0=A0 0=A0=A0=A0=A0=A0 0 ::ffff: <IP>:60020=A0 :::*=A0=A0=A0=A0 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0LISTEN=A0=A0=A0=A0= =A0 115262/java

=A0

# created user table with,

# hbase org.apache.hadoop.hbase.util.RegionSplitter usertable UniformSplit -c 200 -f family

Hbase related logs doesn't reveal anything.


Can someone point me in the right direction?

Thanks in advance for the help!

-Manoj

--089e0122ac44392b4e04dcb9a4b4--