Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of organicveggie@gmail.com
 designates 74.125.44.28 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:date:message-id:subject:from:to:content-type;
        b=TDayw1d98urpS8/12jQQ8M3ZII0fJj4aO24Zjp5U0TGyI2gNqlL79N3ep9Rlj5cr+j
         xf+1d8yui66q5hJNGIw19WhRdsBKfecwm/qX6ZKWETfm9wDvdjQz2sjijpOzLufQsFoQ
         1wsOHR0rBF2Y3GtsLBqF3L4jbjaBWFvGtJlUg=
MIME-Version: 1.0
Date: Tue, 3 Feb 2009 16:13:00 -0600
Message-ID: <fcb71e470902031413n7b042737xdbaa44940876507f@mail.gmail.com>
Subject: HBase and Hadoop MapReduce - Common setups?
From: Sean Laurent <organicveggie@gmail.com>
To: hbase-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001517510c2c6f90d004620af920

--001517510c2c6f90d004620af920
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

Howdy folks,
We're evaluating HBase and we're trying to get a good solid picture of how
everything fits together... specifically, we're wondering how people
commonly setup HBase. I'm imagining you typically run the region servers on
the same machines as the HDFS data nodes to gain data locality benefits. And
from what I've seen on the mailing list, it's typically recommended
(although it sounds like it's up for debate in terms of SPoF issues) to run
separate machines for the HBaseMaster and NameNode servers.

Is it something along the following lines?

1x HBaseMaster
1x HDFS NameNode
N machines with both HRegionServer and DataNode

Now what about Hadoop and task trackers? Do people typically run completely
separate clusters for their M/R tasks? Do they run task trackers along side
the region server and data nodes? Or add machines that run TaskTracker and
DataNode servers but ~not~ HRegionServer?

Any thoughts or opinions would be greatly appreciated!

-Sean

--001517510c2c6f90d004620af920--