Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3828810444 for ; Mon, 8 Jul 2013 11:36:36 +0000 (UTC) Received: (qmail 20899 invoked by uid 500); 8 Jul 2013 11:36:31 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 20746 invoked by uid 500); 8 Jul 2013 11:36:29 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 20737 invoked by uid 99); 8 Jul 2013 11:36:27 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Jul 2013 11:36:27 +0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests=SPF_PASS,UNPARSEABLE_RELAY X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of emelyanov@post.km.ru designates 217.197.114.159 as permitted sender) Received: from [217.197.114.159] (HELO postmx.kmyard.ru) (217.197.114.159) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Jul 2013 11:36:21 +0000 Received: from dummy.name; Mon, 08 Jul 2013 15:36:00 +0400 Message-ID: <51DAA420.40802@post.km.ru> Date: Mon, 08 Jul 2013 15:36:00 +0400 From: Boris Emelyanov User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130623 Thunderbird/17.0.7 MIME-Version: 1.0 To: user@hadoop.apache.org Subject: Hbase random read performance Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org I'm trying to configure hbase for fully random read performance, my cluster parameters are: 9 servers as slaves, each has two 1TB HDD as hadoop volumes; data: 800 millions 6-10 KB objects in hbase; HBase Version - 0.90.6-cdh3u5 HBASE_HEAPSIZE=12288; hfile.block.cache.size = 0.4 hfile.min.blocksize.size = 16384 hbase.regionserver.handler.count = 100 I used several recommended tuning solutions, such as * tunrning on bloom filters; * decreasing hbase block size to 16384. However, read performance is still poor, about 800-1000rps. What would you recommend to solve the problem? -- Best regards, Boris.