Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3078AE18C for ; Mon, 3 Dec 2012 22:04:14 +0000 (UTC) Received: (qmail 10118 invoked by uid 500); 3 Dec 2012 22:04:12 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 10070 invoked by uid 500); 3 Dec 2012 22:04:12 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 10062 invoked by uid 99); 3 Dec 2012 22:04:12 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Dec 2012 22:04:12 +0000 X-ASF-Spam-Status: No, hits=2.9 required=5.0 tests=HTML_IMAGE_ONLY_28,HTML_MESSAGE,SPF_PASS,T_REMOTE_IMAGE X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of mlortiz@uci.cu designates 200.55.140.180 as permitted sender) Received: from [200.55.140.180] (HELO mx3.uci.cu) (200.55.140.180) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 03 Dec 2012 22:04:07 +0000 Received: (qmail 21612 invoked by uid 507); 3 Dec 2012 22:03:42 -0000 Received: from 10.0.0.184 by ns3.uci.cu (envelope-from , uid 501) with qmail-scanner-2.01st (avp: 5.0.2.0. spamassassin: 3.0.6. perlscan: 2.01st. Clear:RC:1(10.0.0.184):. Processed in 0.828536 secs); 03 Dec 2012 22:03:42 -0000 Received: from unknown (HELO ucimail3.uci.cu) (10.0.0.184) by 0 with SMTP; 3 Dec 2012 22:03:41 -0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by ucimail3.uci.cu (Postfix) with ESMTP id 8F2A11E8C011 for ; Mon, 3 Dec 2012 17:03:41 -0500 (EST) X-Virus-Scanned: amavisd-new at uci.cu Received: from ucimail3.uci.cu ([127.0.0.1]) by localhost (ucimail3.uci.cu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7pMAs1Lv59uK; Mon, 3 Dec 2012 17:03:37 -0500 (EST) Received: by ucimail3.uci.cu (Postfix, from userid 101) id EE84C1E8C01B; Mon, 3 Dec 2012 17:03:37 -0500 (EST) Received: from [10.8.46.124] (unknown [10.8.46.124]) (Authenticated sender: mlortiz@uci.cu) by ucimail3.uci.cu (Postfix) with ESMTPSA id B53F41E8C01B; Mon, 3 Dec 2012 17:03:37 -0500 (EST) Message-ID: <50BD21C1.8050001@uci.cu> Date: Mon, 03 Dec 2012 17:03:45 -0500 From: Marcos Ortiz User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:16.0) Gecko/20121028 Thunderbird/16.0.2 MIME-Version: 1.0 To: Ishan Chhabra CC: user@hbase.apache.org Subject: Re: Multiple regionservers on a single node References: In-Reply-To: Content-Type: multipart/alternative; boundary="------------070303070208070408020201" X-Virus-Checked: Checked by ClamAV on apache.org --------------070303070208070408020201 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Regards, Ishan. On 12/03/2012 04:39 PM, Ishan Chhabra wrote: > Hi, > Has anybody tried to run multiple RegionServers on a single physical > node? Are there deep technical issues or minor impediments that would > hinder this? Can you provide more information about your setup? - Network - Disk schema - RAM > > We are trying to do this because we are facing a lot of GC pauses on the > large heap sizes (~70G) that we are using, which leads to a lot of timeouts > in our latency critical application. More processes with smaller heaps > would help in mitigating this issue. Have you read this, Ishan? http://www.cloudera.com/blog/2011/04/hbase-dos-and-donts/ This great post described the Long GC pauses problem. An another great post in the Sematex's blog, describe how Memstore works, which is a critical resource for HBase operations: http://blog.sematext.com/2012/07/16/hbase-memstore-what-you-should-know/ What is the value of: - dfs.balance.bandwidthPerSec - dfs.blocksize - hbase.hregion.memstore.flush.size - dfs.datanode.max.xcievers > > Any experience or thoughts on this would help. > Thanks! > -- Marcos Luis Ort�z Valmaseda about.me/marcosortiz @marcosluis2186 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS... CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION http://www.uci.cu http://www.facebook.com/universidad.uci http://www.flickr.com/photos/universidad_uci --------------070303070208070408020201--