hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Aquilina <jaquil...@eagleeyet.net>
Subject Re: t2.micro on AWS; Is it enough for setting up Hadoop cluster ?
Date Fri, 06 Mar 2015 00:36:27 GMT
 

When I started with EMR it was alot of testing and trial and error. HUE
is already supported as something that can be installed from the AWS
console. What I need to know is if you need this cluster on all the time
or this is goign ot be what amazon call a transient cluster. Meaning you
fire it up run the job and tear it back down. 

---
Regards,
Jonathan Aquilina
Founder Eagle Eye T

On 2015-03-06 01:10, Krish Donald wrote: 

> Thanks Jonathan, 
> 
> I will try to explore EMR option also. 
> Can you please let me know the configuration which you have used it? 
> Can you please recommend for me also? 
> I would like to setup Hadoop cluster using cloudera manager and then would like to do
below things: 
> 
> setup kerberos
> setup federation
> setup monitoring
> setup hadr
> backup and recovery
> authorization using sentry
> backup and recovery of individual componenets
> performamce tuning
> upgrade of cdh 
> upgrade of CM
> Hue User Administration 
> Spark 
> Solr 
> 
> Thanks 
> Krish 
> 
> On Thu, Mar 5, 2015 at 3:57 PM, Jonathan Aquilina <jaquilina@eagleeyet.net> wrote:
> 
> krish EMR wont cost you much with all the testing and data we ran through the test systems
as well as the large amont of data when everythign was read we paid about 15.00 USD. I honestly
do not think that the specs there would be enough as java can be pretty ram hungry. 
> 
> ---
> Regards,
> Jonathan Aquilina
> Founder Eagle Eye T
> 
> On 2015-03-06 00:41, Krish Donald wrote: 
> 
> Hi, 
> 
> I am new to AWS and would like to setup Hadoop cluster using cloudera manager for 6-7
nodes. 
> 
> t2.micro on AWS; Is it enough for setting up Hadoop cluster ? 
> I would like to use free service as of now. 
> 
> Please advise. 
> 
> Thanks 
> Krish
 
Mime
View raw message