hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Buttler, David" <buttl...@llnl.gov>
Subject RE: HBase best practice and Regions confusion
Date Tue, 13 Sep 2011 21:36:52 GMT
If you do that then all data access will be over the network.  Amazon's internal network is
very busy and you might see a lot of delays in processing data.  This would be partially alleviated
if you could run enough region servers to keep your entire table in memory in the block cache
-- but that is not a typical scenario, and will not help at all with writes (As they must
be flushed to disk (in the WAL) before writes complete.


-----Original Message-----
From: Ronen Itkin [mailto:ronen@taykey.com] 
Sent: Tuesday, September 13, 2011 8:24 AM
To: user@hbase.apache.org
Subject: Re: HBase best practice and Regions confusion


Thanks for the answer!
Another question is what should I take into account if I'll decide to run
HRegionServers on separated servers and not on the hdfs datanodes??


On Tue, Sep 13, 2011 at 3:26 PM, Doug Meil <doug.meil@explorysmedical.com>wrote:

> Hi there-
> Regarding EC2, see this in the Hbase book...
> http://hbase.apache.org/book.html#trouble.ec2
> Regarding ROOT/META, see this in the Hbase book
> http://hbase.apache.org/book.html#arch.catalog
> On 9/13/11 6:16 AM, "Ronen Itkin" <ronen@taykey.com> wrote:
> >Hi all,
> >How are you?
> >
> >I am new to hbase and all I have been doing for the past week is reading
> >information exists on the web.
> >My goal is to master HBase from the System Administrator point of view and
> >to setup an Cloudera HBase cluster relying on HDFS storage (Production on
> >AMAZON Web Services).
> >Hadoop HDFS is running over EC2 Large instances (2 Processing Units, 7.5G
> >ram * 3 data nodes).
> >I am about to have 4 tables in HBase, and I was wondering what is the best
> >practice for my situation?
> >How many HRegionServers should I use? will large AMAZON EC2 instances will
> >be enough?
> >
> >I have another confusion regarding -ROOT and .META. regions, and regarding
> >the process of a client approaching HBase.
> >Where do these regions are being stored? How do they structured (rows,
> >columns)?
> >A client first approaches the Zoo Keeper and asks for the -ROOT region
> >location? what happens next?
> >Please elaborate as much as you can.
> >
> >Thanks and Best Regards,
> >*Ronen Itkin*
> >
> ><http://www.taykey.com/>

Ronen Itkin*
Taykey | www.taykey.com

View raw message