Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of octo47@gmail.com designates
 209.85.161.41 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type;
        b=q+1gxy3lw/ebJtQdMBvxJ4qWDQYTsqvOQ228EbGNYAK/ij5LqPAN51+YqYOfY6saCN
         onopWOIjgnSGhxmeRgxgUQYpKR0u8gHBYc9GvbgNbgVgwsQxXVgqyzCJtbLGLsdjZMp0
         lyHb04MhljOv1arYsSC73H3b+ylhYKMsZjIzA=
MIME-Version: 1.0
In-Reply-To: <8A904C2E-F3BA-445C-91B3-29CC000A3F7B@gmail.com>
References: <8A904C2E-F3BA-445C-91B3-29CC000A3F7B@gmail.com>
From: Andrey Stepachev <octo47@gmail.com>
Date: Thu, 23 Dec 2010 10:14:18 +0300
Message-ID: <AANLkTin=oB065P-c_2zwK9JXCDNuVQomEF7xFWa4nFQw@mail.gmail.com>
Subject: Re: Insert into tall table 50% faster than wide table
To: user@hbase.apache.org
Content-Type: multipart/alternative; boundary=20cf3054a60b71d51f04980e9f7f

--20cf3054a60b71d51f04980e9f7f
Content-Type: text/plain; charset=UTF-8

I think row locks slows down here. Each row you inserted tries to aquire
lock, and then release it. Wide table has significally less rows, and much
less locks acquired during insert.


2010/12/23 Bryan Keller <bryanck@gmail.com>

> I have been testing a couple of different approaches to storing customer
> orders. One is a tall table, where each order is a row. The other is a wide
> table where each customer is a row, and orders are columns in the row. I am
> finding that inserts into the tall table, i.e. adding rows for every order,
> is roughly 50% faster than inserts into the wide table, i.e. adding a row
> for a customer and then adding columns for orders.
>
> In my test, there are 10,000 customers, each customer has 600 orders and
> each order has 10 columns. The tall table approach results in 6 mil rows of
> 10 columns. The wide table approach results is 10,000 rows of 6,000 columns.
> I'm using hbase 0.89-20100924 and hadoop 0.20.2. I am adding the orders
> using a Put for each order, submitted in batches of 1000 as a list of Puts.
>
> Are there techniques to speed up inserts with the wide table approach that
> I am perhaps overlooking?
>
>

--20cf3054a60b71d51f04980e9f7f--