Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5C39BD1C8 for ; Fri, 7 Dec 2012 06:59:01 +0000 (UTC) Received: (qmail 70533 invoked by uid 500); 7 Dec 2012 06:58:59 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 70470 invoked by uid 500); 7 Dec 2012 06:58:58 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 70439 invoked by uid 99); 7 Dec 2012 06:58:57 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 Dec 2012 06:58:57 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of dontariq@gmail.com designates 209.85.216.48 as permitted sender) Received: from [209.85.216.48] (HELO mail-qa0-f48.google.com) (209.85.216.48) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 Dec 2012 06:58:52 +0000 Received: by mail-qa0-f48.google.com with SMTP id l8so273848qaq.14 for ; Thu, 06 Dec 2012 22:58:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=WqRrNM5ktGRhsl9benDeU+l3euZtgyvDNjb5HUooiJI=; b=Azb78SO48KAtjVhWP6BHUAsJipq1WwFieFRiKmVFzCFgp3faYY+9/tSqociipeXMw4 7nHYWIelsmL5aPCIS378q99cxoIkyEBAxr1Ar0KHuZbd7YhPiXhVA0Tux0oWz3UWbwjm acc0KRy6IPwXtZNovuJQutQ0QpC8u/zUdMnmpQmgJBHp/IZmMSgcpO3vakj2tqauVQaO cHdxKTnNYFCJkoieYN2GW/N3MbSJmxskGtqTb64LvzbRNj6SOJ3k/43Wmb5RIdIRcDXS onmeL4vlmWjvLfcZgpMDiTKHVGC+9oezGHMqsbsDHKn8MawO+l/70aJR1wdY4VVpgzxF KKKA== Received: by 10.49.118.38 with SMTP id kj6mr7661081qeb.53.1354863512025; Thu, 06 Dec 2012 22:58:32 -0800 (PST) MIME-Version: 1.0 Received: by 10.229.126.165 with HTTP; Thu, 6 Dec 2012 22:57:51 -0800 (PST) In-Reply-To: References: From: Mohammad Tariq Date: Fri, 7 Dec 2012 12:27:51 +0530 Message-ID: Subject: Re: Multiple regionservers on a single node To: "user@hbase.apache.org" Content-Type: multipart/alternative; boundary=047d7b6d89e85a78e204d03dbeef X-Virus-Checked: Checked by ClamAV on apache.org --047d7b6d89e85a78e204d03dbeef Content-Type: text/plain; charset=ISO-8859-1 Hello all, I would like to add 2 cents from my side. Even if we have superior CPU, RAM and Disk, the IO still remains the bottleneck. The CPU would never have much impact on the overall performance, no matter how powerful it is, if there is no considerable evolution of IO. Also, if we have multiple RSs, our DN and TT may face memory issues. What do you guys say? Thank you. Regards, Mohammad Tariq On Fri, Dec 7, 2012 at 9:32 AM, Robert Dyer wrote: > I too am interested in running multiple RS on a single node. > > I have a very small cluster where all nodes are identical. However, I was > just given a very powerful node to add into this cluster which effectively > doubles the total CPUs, RAM, and HDDs in the cluster. > > As such, when I run a MR job half the jobs go to this single, new node yet > most of the data is not local due to HBase balancing the regions. > > Does it make sense for me to run multi-RS on this node? > > > On Mon, Dec 3, 2012 at 3:39 PM, Ishan Chhabra >wrote: > > > Hi, > > Has anybody tried to run multiple RegionServers on a single physical > > node? Are there deep technical issues or minor impediments that would > > hinder this? > > > > We are trying to do this because we are facing a lot of GC pauses on the > > large heap sizes (~70G) that we are using, which leads to a lot of > timeouts > > in our latency critical application. More processes with smaller heaps > > would help in mitigating this issue. > > > > Any experience or thoughts on this would help. > > Thanks! > > > > -- > > *Ishan Chhabra *| Rocket Scientist | Rocketfuel Inc. | *m *650 556 6803 > > > > > > -- > > Robert Dyer > rdyer@iastate.edu > --047d7b6d89e85a78e204d03dbeef--