Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of rmorgan466@gmail.com designates
 209.85.216.169 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAOF-KfibgVAD_wBKjiB7HmmsRcup_qFgx3TcSfgbnoaMbwTyEA@mail.gmail.com>
References: 
 <CAOF-Kfg7yYZpQOvuur18_7s5Oq91hDm+3s-SR2vqCsP--Jpx8A@mail.gmail.com>
	<BLU0-SMTP13110C69C476D86AD82C1DA8F170@phx.gbl>
	<CAOF-KfibgVAD_wBKjiB7HmmsRcup_qFgx3TcSfgbnoaMbwTyEA@mail.gmail.com>
Date: Fri, 18 May 2012 06:42:59 -0400
Message-ID: 
 <CAOF-Kfi=kr3OjxUH_1eTaw2ntqdzeYzCbN82tt642M-uEzcD-A@mail.gmail.com>
Subject: Re: large machine configuration
From: Rita <rmorgan466@gmail.com>
To: user@hbase.apache.org
Content-Type: multipart/alternative; boundary=20cf3074b1ae4ccc2404c04d37ad

--20cf3074b1ae4ccc2404c04d37ad
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Mike,

Where can I find your talk?

On Fri, May 11, 2012 at 7:51 AM, Rita <rmorgan466@gmail.com> wrote:

> most of the operations I do with MR are exporting tables and importing
> tables. Does that still require a lot of memory and does it help to
> allocate more memory for jobs like that?
>
> Yes, I have 12 cores also. Are there any HDFS/MR/Hbase tuning tips for
> this many processors?
>
> btw, 64GB is a lot for us :-)
>
>
>
> On Fri, May 11, 2012 at 7:29 AM, Michael Segel <michael_segel@hotmail.com=
>wrote:
>
>> Funny, but this is part of a talk that I submitted to Strata....
>>
>> 64GB and HBase isn't necessarily a 'large machine'.
>>
>> If you're running w 12 cores, you're talking about a minimum of 48GB jus=
t
>> for M/R.
>> (4GB a core is a good rule of thumb )
>>
>> Depending on what you want to do, you could set aside 8GB of heap and
>> tune that, but even that might not be enough...
>>
>>
>> On May 11, 2012, at 5:42 AM, Rita wrote:
>>
>> > Hello,
>> >
>> > While looking at,
>> http://hbase.apache.org/book.html#important_configurations,
>> > I noticed large machine configuration section still isnt completed.
>> > =A8Unfortunately=A8, I am running on a large machine which as 64gb of =
memory
>> > therefore I would need some help tuning my hbase/hadoop instance for
>> > maximum performance. Can someone please shed light on what I should lo=
ok
>> > into?
>> >
>> >
>> >
>> > --
>> > --- Get your facts first, then you can distort them as you please.--
>>
>>
>
>
> --
> --- Get your facts first, then you can distort them as you please.--
>


--=20
--- Get your facts first, then you can distort them as you please.--

--20cf3074b1ae4ccc2404c04d37ad--