Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of apivovarov@gmail.com designates
 209.85.215.53 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <285b89b414575517a0181dae0f6dfd87@mail.eagleeyet.net>
References: 
 <CAGCH7McNMD=F7rTbiRJqWrDvNdVSfGw10u7HVAjGRm1YgzKaEg@mail.gmail.com>
	<0a49e536b65de41e39692a05333e8254@mail.eagleeyet.net>
	<CAGCH7McfP+qDbF9KZh+=Vf=NRxUsD+6Qcnx32au35khBmEhOww@mail.gmail.com>
	<285b89b414575517a0181dae0f6dfd87@mail.eagleeyet.net>
Date: Thu, 5 Mar 2015 17:11:49 -0800
Message-ID: 
 <CAKKt98QCrfvNqcM+DVWWFZciyE3GM-KmXNDwt2ypLVLrAa2KWQ@mail.gmail.com>
Subject: Re: t2.micro on AWS; Is it enough for setting up Hadoop cluster ?
From: Alexander Pivovarov <apivovarov@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a1134730e7150520510945ef9

--001a1134730e7150520510945ef9
Content-Type: text/plain; charset=UTF-8

What is the easiest way to assign names to aws ec2 computers?
I guess computer need static hostname and dns name before it can be used in
hadoop cluster.
On Mar 5, 2015 4:36 PM, "Jonathan Aquilina" <jaquilina@eagleeyet.net> wrote:

>  When I started with EMR it was alot of testing and trial and error. HUE
> is already supported as something that can be installed from the AWS
> console. What I need to know is if you need this cluster on all the time or
> this is goign ot be what amazon call a transient cluster. Meaning you fire
> it up run the job and tear it back down.
>
>
>
> ---
> Regards,
> Jonathan Aquilina
> Founder Eagle Eye T
>
>  On 2015-03-06 01:10, Krish Donald wrote:
>
>  Thanks Jonathan,
>
> I will try to explore EMR option also.
> Can you please let me know the configuration which you have used it?
> Can you please recommend for me also?
> I would like to setup Hadoop cluster using cloudera manager and then would
> like to do below things:
>
> setup kerberos
> setup federation
> setup monitoring
> setup hadr
> backup and recovery
> authorization using sentry
> backup and recovery of individual componenets
> performamce tuning
> upgrade of cdh
> upgrade of CM
> Hue User Administration
> Spark
> Solr
>
>
> Thanks
> Krish
>
>
> On Thu, Mar 5, 2015 at 3:57 PM, Jonathan Aquilina <jaquilina@eagleeyet.net
> > wrote:
>
>>  krish EMR wont cost you much with all the testing and data we ran
>> through the test systems as well as the large amont of data when everythign
>> was read we paid about 15.00 USD. I honestly do not think that the specs
>> there would be enough as java can be pretty ram hungry.
>>
>>
>>
>> ---
>> Regards,
>> Jonathan Aquilina
>> Founder Eagle Eye T
>>
>>   On 2015-03-06 00:41, Krish Donald wrote:
>>
>>  Hi,
>>
>> I am new to AWS and would like to setup Hadoop cluster using cloudera
>> manager for 6-7 nodes.
>>
>> t2.micro on AWS; Is it enough for setting up Hadoop cluster ?
>> I would like to use free service as of now.
>>
>> Please advise.
>>
>> Thanks
>> Krish
>>
>>

--001a1134730e7150520510945ef9
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<p dir=3D"ltr">What is the easiest way to assign names to aws ec2 computers=
?<br>
I guess computer need static hostname and dns name before it can be used in=
 hadoop cluster.</p>
<div class=3D"gmail_quote">On Mar 5, 2015 4:36 PM, &quot;Jonathan Aquilina&=
quot; &lt;<a href=3D"mailto:jaquilina@eagleeyet.net">jaquilina@eagleeyet.ne=
t</a>&gt; wrote:<br type=3D"attribution"><blockquote class=3D"gmail_quote" =
style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><u>=
</u>
<div style=3D"font-size:10pt;font-family:Verdana,Geneva,sans-serif">
<p>When I started with EMR it was alot of testing and trial and error. HUE =
is already supported as something that can be installed from the AWS consol=
e. What I need to know is if you need this cluster on all the time or this =
is goign ot be what amazon call a transient cluster. Meaning you fire it up=
 run the job and tear it back down.</p>
<p>=C2=A0</p>
<div>
<pre>---<br>Regards,
Jonathan Aquilina
Founder Eagle Eye T</pre>
</div>
<p>On 2015-03-06 01:10, Krish Donald wrote:</p>
<blockquote type=3D"cite" style=3D"padding-left:5px;border-left:#1010ff 2px=
 solid;margin-left:5px">
<div dir=3D"ltr">
<div>Thanks Jonathan,</div>
<div>=C2=A0</div>
<div>I will try to explore EMR option also.</div>
<div>Can you please let me know the configuration which you have used it?</=
div>
<div>Can you please recommend for me also?</div>
<div>I would like to setup Hadoop cluster using cloudera manager and then w=
ould like to do below things:</div>
<div>=C2=A0</div>
<div>setup kerberos<br>setup federation<br>setup monitoring<br>setup hadr<b=
r>backup and recovery<br>authorization using sentry<br>backup and recovery =
of individual componenets<br>performamce tuning<br>upgrade of cdh <br>upgra=
de of CM<br>Hue User Administration</div>
<div>Spark</div>
<div>Solr</div>
<div>=C2=A0</div>
<div>=C2=A0</div>
<div>Thanks</div>
<div>Krish</div>
<div>=C2=A0</div>
</div>
<div class=3D"gmail_extra"><br>
<div class=3D"gmail_quote">On Thu, Mar 5, 2015 at 3:57 PM, Jonathan Aquilin=
a <span>&lt;<a href=3D"mailto:jaquilina@eagleeyet.net" target=3D"_blank">ja=
quilina@eagleeyet.net</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><span style=3D"text-decoration:underline"></=
span>
<div style=3D"font-family:Verdana,Geneva,sans-serif;font-size:10pt">
<p>krish EMR wont cost you much with all the testing and data we ran throug=
h the test systems as well as the large amont of data when everythign was r=
ead we paid about 15.00 USD. I honestly do not think that the specs there w=
ould be enough as java can be pretty ram hungry.</p>
<p>=C2=A0</p>
<div>
<pre>---<br>Regards,
Jonathan Aquilina
Founder Eagle Eye T</pre>
</div>
<div>
<div>
<p>On 2015-03-06 00:41, Krish Donald wrote:</p>
<blockquote style=3D"padding-left:5px;margin-left:5px;border-left-color:#10=
10ff;border-left-width:2px;border-left-style:solid">
<div dir=3D"ltr">
<div>Hi,</div>
<div>=C2=A0</div>
<div>I am new to AWS and would like to setup Hadoop cluster using cloudera =
manager for 6-7 nodes.</div>
<div>=C2=A0</div>
<div>t2.micro on AWS; Is it enough for setting up Hadoop cluster ?</div>
<div>I would like to use free service as of now.</div>
<div>=C2=A0</div>
<div>Please advise.</div>
<div>=C2=A0</div>
<div>Thanks</div>
<div>Krish</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</blockquote>
</div>
</blockquote></div>

--001a1134730e7150520510945ef9--