Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 349B8180C7 for ; Thu, 20 Aug 2015 15:42:25 +0000 (UTC) Received: (qmail 52871 invoked by uid 500); 20 Aug 2015 15:42:23 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 52788 invoked by uid 500); 20 Aug 2015 15:42:23 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 52776 invoked by uid 99); 20 Aug 2015 15:42:23 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Aug 2015 15:42:23 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id BA71619B31B for ; Thu, 20 Aug 2015 15:42:22 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 4.193 X-Spam-Level: **** X-Spam-Status: No, score=4.193 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URI_HEX=1.313] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id Odhn_lpj4XHF for ; Thu, 20 Aug 2015 15:42:15 +0000 (UTC) Received: from mail-yk0-f182.google.com (mail-yk0-f182.google.com [209.85.160.182]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 3D33521044 for ; Thu, 20 Aug 2015 15:42:15 +0000 (UTC) Received: by ykdt205 with SMTP id t205so41799210ykd.1 for ; Thu, 20 Aug 2015 08:42:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=99Pn0xoYxcV2ExDacI395FafG+v7h1OBJhaer0zgIBE=; b=J8urQiwLD9oMEaO2+j4eSRst3Hd5nNOxht69FDbvqsySmuysAtgQYKtvbU3GaJQTWc Zyn0ezhztLIBxbrKvb3aw+ulMS7ucO+971Hqtx9mQz6ivqA290wBmyHKqN3NaPlvpFGB tFgra/6huFYcSIU4MiSvQaHjdrRetiSeSkZ/HN6TrVMOWGqtUqt5qwj4LCrQISEeQVuu sZWy0uPXubunUpfRwvZX28ShNUeaGSjjzz6GvKKCfuhfFGvSyWzFhdklzdgHNbnY4U30 XrKya2j9yt2sz8aRrFEEVM9J6c5QcA8JCoPCJGp0LgdHX7p4/s9zYF0n+fTpykxtwUkq iTNQ== MIME-Version: 1.0 X-Received: by 10.13.233.133 with SMTP id s127mr4421227ywe.154.1440085334521; Thu, 20 Aug 2015 08:42:14 -0700 (PDT) Received: by 10.37.208.208 with HTTP; Thu, 20 Aug 2015 08:42:14 -0700 (PDT) In-Reply-To: <1440084728694-4074047.post@n3.nabble.com> References: <1440084728694-4074047.post@n3.nabble.com> Date: Thu, 20 Aug 2015 08:42:14 -0700 Message-ID: Subject: Re: HBase on HDFS: proper way to setup From: Ted Yu To: "user@hbase.apache.org" Content-Type: multipart/alternative; boundary=94eb2c0736e4cf7edf051dbffe2e --94eb2c0736e4cf7edf051dbffe2e Content-Type: text/plain; charset=UTF-8 Whether having HBase instance on each data node depends on the amount of data you have and access pattern you expect. bq. Is it any useful to have more HBase nodes than HDFS nodes? I have never seen the above setup. Do you have an hdfs cluster already ? Can you let us know your use case ? Cheers On Thu, Aug 20, 2015 at 8:32 AM, MrE wrote: > Hello, > > I'm new to HBase, so pardon the stupid question. > Hbase is meant to run on HDFS I presume, although it is not the default on > the 'single host' setup. > > My question is: assuming I have a HDFS cluster setup for storage (just > HDFS) > > What is the rule of thumb for deployment of HBase instances: should I have > a > HBase instance on each HDFS node? > I assume the HBase instances should be close to the data to avoid network > latencies, but do I need a HBase instance on each datanode? > Is it any useful to have more HBase nodes than HDFS nodes? > > All the basic tutorials explain setting up HBase on local fs, and then > explain that to setup as a cluster 'just point to HDFS' for storage, but I > haven't found clear explanation of how all these nodes should be arranged > together to be efficient. > > Thanks for the help. > E > > > > -- > View this message in context: > http://apache-hbase.679495.n3.nabble.com/HBase-on-HDFS-proper-way-to-setup-tp4074047.html > Sent from the HBase User mailing list archive at Nabble.com. > --94eb2c0736e4cf7edf051dbffe2e--