Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: local policy includes SPF record at
 spf.trusted-forwarder.org)
MIME-Version: 1.0
In-Reply-To: <1400808832.84048.YahooMailNeo@web190104.mail.sg3.yahoo.com>
References: 
 <CAELUF_Dmsuixj-xsG3ASYkBf=S=JX-5hAu4ZZh7BdJX0DfkNuQ@mail.gmail.com>
 <1400286774.47005.YahooMailAndroidMobile@web190103.mail.sg3.yahoo.com>
 <CAELUF_A9vkY0HFQfgC+NPVQp=rb9ttiggOX_fJ8mu=cFwaK24w@mail.gmail.com>
 <1400808832.84048.YahooMailNeo@web190104.mail.sg3.yahoo.com>
From: Flavio Pompermaier <pompermaier@okkam.it>
Date: Fri, 23 May 2014 09:16:49 +0200
Message-ID: 
 <CAELUF_CtL1sZQGMm1r29J4OWh3NpnCWCojgVa-E8tDvE+uvL0w@mail.gmail.com>
Subject: Re: HBase cluster design
To: user@hbase.apache.org, Dhaval Shah <prince_mithibai@yahoo.co.in>
Content-Type: multipart/mixed; boundary=047d7bd6a90ea5b0cd04fa0c0427

--047d7bd6a90ea5b0cd04fa0c0427
Content-Type: multipart/alternative; boundary=047d7bd6a90ea5b0ca04fa0c0425

--047d7bd6a90ea5b0ca04fa0c0425
Content-Type: text/plain; charset=UTF-8

The hardware specs are: 4 nodes with 48g RAM, 24 cores and 1 TB disk each
server
Attached my hbase config files.

Thanks,
Flavio

On Fri, May 23, 2014 at 3:33 AM, Dhaval Shah <prince_mithibai@yahoo.co.in>wrote:

> Can you share your hbase-env.sh and hbase-site.xml? And hardware specs of
> your cluster?
>
>
>
>
> Regards,
> Dhaval
>
>
> ________________________________
>  From: Flavio Pompermaier <pompermaier@okkam.it>
> To: user@hbase.apache.org
> Sent: Saturday, 17 May 2014 2:49 AM
> Subject: Re: HBase cluster design
>
>
> Could you tell me please in detail the parameters you'd like to see so i
> can look for them and learn the important ones?i'm using cloudera, cdh4 in
> one cluster and cdh5 in the other.
>
> Best,
> Flavio
>
> On May 17, 2014 2:48 AM, "prince_mithibai@yahoo.co.in" <
> prince_mithibai@yahoo.co.in> wrote:
>
> > Can you describe your setup in more detail? Specifically the amount of
> > heap hbase region servers have and your GC settings. Is your server
> > swapping when your MR obs are running? Also do your regions go down or
> your
> > region servers?
> >
> > We run many MR jobs simultaneously on our hbase tables (size is in TBs)
> > along with serving real time requests at the same time. So I can vouch
> for
> > the fact that a well tuned hbase cluster definitely supports this use
> case
> > (well-tuned is the key word here)
> >
> > Sent from Yahoo Mail on Android
> >
> >
>

--047d7bd6a90ea5b0ca04fa0c0425
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><span style=3D"font-family:arial,sans-serif;font-size:13px=
">The hardware specs are: 4 nodes with 48g RAM, 24 cores and 1 TB disk each=
 server</span><div><font face=3D"arial, sans-serif">Attached my hbase confi=
g files.</font></div>

<div><font face=3D"arial, sans-serif"><br></font></div><div><font face=3D"a=
rial, sans-serif">Thanks,</font></div><div><font face=3D"arial, sans-serif"=
>Flavio<br></font><div class=3D"gmail_extra"><br><div class=3D"gmail_quote"=
>On Fri, May 23, 2014 at 3:33 AM, Dhaval Shah <span dir=3D"ltr">&lt;<a href=
=3D"mailto:prince_mithibai@yahoo.co.in" target=3D"_blank">prince_mithibai@y=
ahoo.co.in</a>&gt;</span> wrote:<br>

<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">Can you share your hbase-env.sh and hbase-si=
te.xml? And hardware specs of your cluster?<br>
<br>
<br>
=C2=A0<br>
<br>
Regards,<br>
Dhaval<br>
<br>
<br>
________________________________<br>
=C2=A0From: Flavio Pompermaier &lt;<a href=3D"mailto:pompermaier@okkam.it">=
pompermaier@okkam.it</a>&gt;<br>
To: <a href=3D"mailto:user@hbase.apache.org">user@hbase.apache.org</a><br>
Sent: Saturday, 17 May 2014 2:49 AM<br>
Subject: Re: HBase cluster design<br>
<div class=3D"HOEnZb"><div class=3D"h5"><br>
<br>
Could you tell me please in detail the parameters you&#39;d like to see so =
i<br>
can look for them and learn the important ones?i&#39;m using cloudera, cdh4=
 in<br>
one cluster and cdh5 in the other.<br>
<br>
Best,<br>
Flavio<br>
<br>
On May 17, 2014 2:48 AM, &quot;<a href=3D"mailto:prince_mithibai@yahoo.co.i=
n">prince_mithibai@yahoo.co.in</a>&quot; &lt;<br>
<a href=3D"mailto:prince_mithibai@yahoo.co.in">prince_mithibai@yahoo.co.in<=
/a>&gt; wrote:<br>
<br>
&gt; Can you describe your setup in more detail? Specifically the amount of=
<br>
&gt; heap hbase region servers have and your GC settings. Is your server<br=
>
&gt; swapping when your MR obs are running? Also do your regions go down or=
 your<br>
&gt; region servers?<br>
&gt;<br>
&gt; We run many MR jobs simultaneously on our hbase tables (size is in TBs=
)<br>
&gt; along with serving real time requests at the same time. So I can vouch=
 for<br>
&gt; the fact that a well tuned hbase cluster definitely supports this use =
case<br>
&gt; (well-tuned is the key word here)<br>
&gt;<br>
&gt; Sent from Yahoo Mail on Android<br>
&gt;<br>
&gt;</div></div></blockquote></div><div dir=3D"ltr"><p></p><p></p><p></p><p=
></p></div>
</div></div></div>

--047d7bd6a90ea5b0ca04fa0c0425--

--047d7bd6a90ea5b0cd04fa0c0427
Content-Type: application/x-sh; name="hbase-env.sh"
Content-Disposition: attachment; filename="hbase-env.sh"
Content-Transfer-Encoding: base64
X-Attachment-Id: f_hvj5mxvt0

ZXhwb3J0IEhCQVNFX09QVFM9Ii1YWDorSGVhcER1bXBPbk91dE9mTWVtb3J5RXJyb3IgLVhYOitV
c2VDb25jTWFya1N3ZWVwR0MgLVhYOitDTVNJbmNyZW1lbnRhbE1vZGUiCmV4cG9ydCBIQkFTRV9D
TEFTU1BBVEg9YGVjaG8gJEhCQVNFX0NMQVNTUEFUSCB8IHNlZCAtZSAic3wkWk9PS0VFUEVSX0NP
TkY6fHwiYAo=
--047d7bd6a90ea5b0cd04fa0c0427
Content-Type: text/xml; charset=US-ASCII; name="hbase-site.xml"
Content-Disposition: attachment; filename="hbase-site.xml"
Content-Transfer-Encoding: base64
X-Attachment-Id: f_hvj5mxwp1

PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0iVVRGLTgiPz4KCjwhLS1BdXRvZ2VuZXJhdGVk
IGJ5IENsb3VkZXJhIENNIG9uIDIwMTQtMDUtMjNUMDc6MzA6MjIuOTI4Wi0tPgo8Y29uZmlndXJh
dGlvbj4KICA8cHJvcGVydHk+CiAgICA8bmFtZT5oYmFzZS5yb290ZGlyPC9uYW1lPgogICAgPHZh
bHVlPmhkZnM6Ly9zZXJ2ZXI0OjgwMjAvaGJhc2U8L3ZhbHVlPgogIDwvcHJvcGVydHk+CiAgPHBy
b3BlcnR5PgogICAgPG5hbWU+aGJhc2UuY2xpZW50LndyaXRlLmJ1ZmZlcjwvbmFtZT4KICAgIDx2
YWx1ZT4yMDk3MTUyPC92YWx1ZT4KICA8L3Byb3BlcnR5PgogIDxwcm9wZXJ0eT4KICAgIDxuYW1l
PmhiYXNlLmNsaWVudC5wYXVzZTwvbmFtZT4KICAgIDx2YWx1ZT4xMDAwPC92YWx1ZT4KICA8L3By
b3BlcnR5PgogIDxwcm9wZXJ0eT4KICAgIDxuYW1lPmhiYXNlLmNsaWVudC5yZXRyaWVzLm51bWJl
cjwvbmFtZT4KICAgIDx2YWx1ZT4xMDwvdmFsdWU+CiAgPC9wcm9wZXJ0eT4KICA8cHJvcGVydHk+
CiAgICA8bmFtZT5oYmFzZS5jbGllbnQuc2Nhbm5lci5jYWNoaW5nPC9uYW1lPgogICAgPHZhbHVl
PjE8L3ZhbHVlPgogIDwvcHJvcGVydHk+CiAgPHByb3BlcnR5PgogICAgPG5hbWU+aGJhc2UuY2xp
ZW50LmtleXZhbHVlLm1heHNpemU8L25hbWU+CiAgICA8dmFsdWU+MTA0ODU3NjA8L3ZhbHVlPgog
IDwvcHJvcGVydHk+CiAgPHByb3BlcnR5PgogICAgPG5hbWU+aGJhc2Uuc2VjdXJpdHkuYXV0aGVu
dGljYXRpb248L25hbWU+CiAgICA8dmFsdWU+c2ltcGxlPC92YWx1ZT4KICA8L3Byb3BlcnR5Pgog
IDxwcm9wZXJ0eT4KICAgIDxuYW1lPnpvb2tlZXBlci5zZXNzaW9uLnRpbWVvdXQ8L25hbWU+CiAg
ICA8dmFsdWU+NjAwMDA8L3ZhbHVlPgogIDwvcHJvcGVydHk+CiAgPHByb3BlcnR5PgogICAgPG5h
bWU+em9va2VlcGVyLnpub2RlLnBhcmVudDwvbmFtZT4KICAgIDx2YWx1ZT4vaGJhc2U8L3ZhbHVl
PgogIDwvcHJvcGVydHk+CiAgPHByb3BlcnR5PgogICAgPG5hbWU+em9va2VlcGVyLnpub2RlLnJv
b3RzZXJ2ZXI8L25hbWU+CiAgICA8dmFsdWU+cm9vdC1yZWdpb24tc2VydmVyPC92YWx1ZT4KICA8
L3Byb3BlcnR5PgogIDxwcm9wZXJ0eT4KICAgIDxuYW1lPmhiYXNlLnpvb2tlZXBlci5xdW9ydW08
L25hbWU+CiAgICA8dmFsdWU+c2VydmVyMSxzZXJ2ZXIyPC92YWx1ZT4KICA8L3Byb3BlcnR5Pgog
IDxwcm9wZXJ0eT4KICAgIDxuYW1lPmhiYXNlLnpvb2tlZXBlci5wcm9wZXJ0eS5jbGllbnRQb3J0
PC9uYW1lPgogICAgPHZhbHVlPjIxODE8L3ZhbHVlPgogIDwvcHJvcGVydHk+CjwvY29uZmlndXJh
dGlvbj4K
--047d7bd6a90ea5b0cd04fa0c0427--