Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of ryanobjc@gmail.com designates
 209.85.214.169 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=vTA/4yL/SjX/9aADy/EkpNSlRZfcy57efKpmpsgjHUMdRlwdreKntD7VbDdkxM6pt1
         /bn/mX5ywo+qyXxN4zGpy8YkyoL1QNpIsNaBrK3EsZBzxtp0thdheJgndsPgW+pY6P+D
         oQAy/4C6CXV7Jfm9qEZMtQml1rLu/tdR+I0Us=
MIME-Version: 1.0
In-Reply-To: <AANLkTik9QDS6am-db2jvFZzv9EN_o=grKhqP9rXsSsWC@mail.gmail.com>
References: <AANLkTik9QDS6am-db2jvFZzv9EN_o=grKhqP9rXsSsWC@mail.gmail.com>
Date: Sun, 26 Sep 2010 13:38:25 -0700
Message-ID: <AANLkTikYR1nbhpq84KX+4W5X2H-h6FXKc+y-Em7UgKJj@mail.gmail.com>
Subject: Re: anybody running ycsb?
From: Ryan Rawson <ryanobjc@gmail.com>
To: user@hbase.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

hey,

there are a lot of settings which all affect speed, you might want to
make sure you are running the exact config the paper is. for example
"readallfields".. if you have a wide column setting it to 'true' will
go much slower (since you are returning a lot more data) than if you
set it to false.  Also there are known bottlenecks in our HTable
client, which exist to reduce the # of socket connections, but you can
get higher performance with multiple VMs, although that is more
complex.

Also dont forget hardware.. .make sure your HW is the same as the papers.

Good luck!
-ryan

On Sat, Sep 25, 2010 at 8:19 AM, Tao Xie <xietao.mailbox@gmail.com> wrote:
> I want to reproduce the results in the ycsb paper. I =A0run hbase 0.20.6 =
and
> hadoop 0.20.2. My cluster is like this:
>
> 1 Node as HMaster + ZK
>
> 6 Nodes as DN, RS
>
> 1 Node as Hbase client.
>
> I think this environment is something like the one used by the paper.
>
> When I run tests like workloadb with 100 threads, I get at most 2500 ops/=
sec
> throughput and read latency is about 40~50 ms, which is much higher than =
the
> paper results (about 10+ ms). I wonder if anybody is running ycsb too and
> can give me some hints.
>
>
>
> Thanks in advance.
>