Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1E06A10525 for ; Tue, 11 Feb 2014 13:24:25 +0000 (UTC) Received: (qmail 32997 invoked by uid 500); 11 Feb 2014 13:24:23 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 32010 invoked by uid 500); 11 Feb 2014 13:24:22 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 31990 invoked by uid 99); 11 Feb 2014 13:24:21 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Feb 2014 13:24:21 +0000 X-ASF-Spam-Status: No, hits=2.8 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,URI_HEX X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy includes SPF record at spf.trusted-forwarder.org) Received: from [209.85.128.182] (HELO mail-ve0-f182.google.com) (209.85.128.182) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Feb 2014 13:24:13 +0000 Received: by mail-ve0-f182.google.com with SMTP id jy13so6258504veb.27 for ; Tue, 11 Feb 2014 05:23:52 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=qXEvW0WkcocN1Lx8A399/VqJoo1+Sh9XHzPeudDT7IQ=; b=kFJAkM43gsIZBLGN/izoqVW4nKFBXZN5vIlxSN4rHg2YWxvfqP0K6amn0Msshgmhl7 jQsviDG5AIvzXYf3W2GZ0RDaUB4WZufDsKxs6xLOK/om3TlpK1pAdm0SfyqmjYhmcbXn JfvLCAioj1cxr0EegW0XvNhOkAqerhH49u4fPvDplMUjrQwQQO3xLNthjnDuNTqBjApu GSurJE7sG1eik+7LelPhENIj+EH/pDYBTMC4Efa/JCyQ8KB6LLHrJGedGaW7JWVHlFSv WrYFMMFxy1VJjiC9k0UWF53wSJUXxBtBwr8Mov8cBSZvwc+YgouJkIOY0lCA2g3UHlmM d5Tw== X-Gm-Message-State: ALoCoQnVoPBlFUV/Hex4vfoW+iJLNLb4tdCR2sBWazA/yeqgfV2HerGbZmYfci6uWF+QBQKzpnXq X-Received: by 10.58.48.133 with SMTP id l5mr210686ven.36.1392125032626; Tue, 11 Feb 2014 05:23:52 -0800 (PST) MIME-Version: 1.0 Received: by 10.52.227.8 with HTTP; Tue, 11 Feb 2014 05:23:32 -0800 (PST) In-Reply-To: <1392049605572-4055808.post@n3.nabble.com> References: <1392049605572-4055808.post@n3.nabble.com> From: Jean-Marc Spaggiari Date: Tue, 11 Feb 2014 08:23:32 -0500 Message-ID: Subject: Re: Hardware requirements for a development workstation To: user Content-Type: multipart/alternative; boundary=089e011844da0d8d7f04f2215efc X-Virus-Checked: Checked by ClamAV on apache.org --089e011844da0d8d7f04f2215efc Content-Type: text/plain; charset=UTF-8 Moving to user@, dev@ in bcc Hi, Calculation is pretty simple. Let's say you want to have at least 3 nodes in 3 VMs. And you local os. That's 4 computers in one hardware. You want to have AT LEAST 2 cores and 4GB per host, so you need a minimum or 16GB and 8 cores to host all of that in a single hardware. But for local dev, I don't think you need to run a local cluster. A pseudo dist might be plenty enough. Then just use 2 hardware to build a 4 nodes cluster for your next step testing. JM 2014-02-10 11:26 GMT-05:00 rkvirani : > Hi All, > > Im sorry if this question has been asked, search results didnt show > anything > and I cant seem to find much documentation out there. I am looking for > hardware reqruirements for developing a working model in HBase. > > I would like the development environment to support the following: > > 1) Small cluster in vmware player on the host (not psuedo cluster). > 2) Host small sample of the data maybe 100GB or so > 3) Develop, run and execute scripts in Jython for data loading and large > manipulation operations > 4) Able to run the web interface I have seen for hbase (dont know much > about > it) > 5) Support for an IDE such as Eclipse for example. > 6) I am looking at laptop hardware so please keep that in mind. > > Currently I have an i3 with 4GB Ram, I am guessing this may not be > sufficicent, there are no RAM requirements but I can see that when hbase is > executed it uses as much ram is available and as much CPU as available. > > It would be helpfull if someone could offer insight on the hardware > required > for development and whether or not CPU or RAM is more important, so far as > I > can tell it would be CPU as everytime I try and execute a script the CPU > usage goes through the roof (probably the JVM chugging away compiling the > bite code...) > > Please help, Im a newb, sorry if these kinds of questions have been asked > before. > > R > > I a > > > > -- > View this message in context: > http://apache-hbase.679495.n3.nabble.com/Hardware-requirements-for-a-development-workstation-tp4055808.html > Sent from the HBase Developer mailing list archive at Nabble.com. > --089e011844da0d8d7f04f2215efc--