Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3F6B610B49 for ; Sat, 13 Apr 2013 16:02:02 +0000 (UTC) Received: (qmail 83288 invoked by uid 500); 13 Apr 2013 16:02:00 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 83118 invoked by uid 500); 13 Apr 2013 16:01:59 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 83109 invoked by uid 99); 13 Apr 2013 16:01:59 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 13 Apr 2013 16:01:59 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=FREEMAIL_REPLY,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of adrien.mogenet@gmail.com designates 209.85.217.176 as permitted sender) Received: from [209.85.217.176] (HELO mail-lb0-f176.google.com) (209.85.217.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 13 Apr 2013 16:01:55 +0000 Received: by mail-lb0-f176.google.com with SMTP id y8so3433039lbh.21 for ; Sat, 13 Apr 2013 09:01:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type; bh=sgq917IrztQeFI8F/lucnxvmla8efuc6SCuyxC7Zlhw=; b=H4CgrM7A2/oHwGLNCXAsd5KK1Lqk1HWx4z/dSl+TgPz5GU0h5e6sGw0G1KPA+4e7+E XX9taLpDhutdRbmcjai0xnzQtPZ/KrQwOJm5NbAzmnHi1GoT8pOduxyBOB0ySQaX9z30 uJPsSQBOln3Of8oxUjSzOOFt9oLTDXmgZ1Ea1DzDACPHhnnCMk2O5+oL0SsP1e4lGM3R dwdCCk2i2+vTicVZEfueu0OsR5qcUyXIN1bTUdQQ2+h8T2vIWm1DCXA8PWguXiHhMKD9 piOJkVgPmuE4Gp3OCsH23pAXJDzKY6nspn0rplqMBuyLZv995G3yrvzBWzHW41a3N3Cn f4UQ== X-Received: by 10.112.139.226 with SMTP id rb2mr7482989lbb.12.1365868893441; Sat, 13 Apr 2013 09:01:33 -0700 (PDT) MIME-Version: 1.0 Received: by 10.114.19.146 with HTTP; Sat, 13 Apr 2013 09:00:52 -0700 (PDT) In-Reply-To: References: From: Adrien Mogenet Date: Sat, 13 Apr 2013 18:00:52 +0200 Message-ID: Subject: Re: HBase random read performance To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=001a11c329e83416c604da402252 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c329e83416c604da402252 Content-Type: text/plain; charset=ISO-8859-1 Using bloom filter is almost mandatory there; You might also want to try Short Circuit Reads and be sure you get 100% data locality (major_compact your table first) On Sat, Apr 13, 2013 at 5:16 PM, Ted Yu wrote: > Did you enable bloom filters ? > See http://hbase.apache.org/book.html#schema.bloom > > Cheers > > On Fri, Apr 12, 2013 at 10:31 PM, Ankit Jain >wrote: > > > Hi All, > > > > We are using HBase 0.94.5 and Hadoop 1.0.4. > > > > We have HBase cluster of 5 nodes(5 regionservers and 1 master node). Each > > regionserver has 8 GB RAM. > > > > We have loaded 25 millions records in HBase table, regions are pre-split > > into 16 regions and all the regions are equally loaded. > > > > We are getting very low random read performance while performing multi > get > > from HBase. > > > > We are passing random 10000 row-keys as input, while HBase is taking > around > > 17 secs to return 10000 records. > > > > Please suggest some tuning to increase HBase read performance. > > > > Thanks, > > Ankit Jain > > iLabs > > > > > > > > -- > > Thanks, > > Ankit Jain > > > -- Adrien Mogenet http://www.borntosegfault.com --001a11c329e83416c604da402252--