Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7AFF617716 for ; Fri, 6 Mar 2015 00:36:59 +0000 (UTC) Received: (qmail 86453 invoked by uid 500); 6 Mar 2015 00:36:54 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 86336 invoked by uid 500); 6 Mar 2015 00:36:54 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 86326 invoked by uid 99); 6 Mar 2015 00:36:54 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Mar 2015 00:36:54 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [176.58.122.69] (HELO mail.eagleeyet.net) (176.58.122.69) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Mar 2015 00:36:29 +0000 Received: by mail.eagleeyet.net (Postfix, from userid 33) id 7F4711853E; Fri, 6 Mar 2015 00:36:27 +0000 (UTC) To: user@hadoop.apache.org Subject: Re: t2.micro on AWS; Is it enough for setting up Hadoop cluster =?UTF-8?Q?=3F?= X-PHP-Originating-Script: 0:rcube.php MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_cc74b73807c3c9c32118ed26f3cdf356" Date: Fri, 06 Mar 2015 01:36:27 +0100 From: Jonathan Aquilina In-Reply-To: References: <0a49e536b65de41e39692a05333e8254@mail.eagleeyet.net> Message-ID: <285b89b414575517a0181dae0f6dfd87@mail.eagleeyet.net> X-Sender: jaquilina@eagleeyet.net User-Agent: Roundcube Webmail/1.0.5 X-Virus-Checked: Checked by ClamAV on apache.org --=_cc74b73807c3c9c32118ed26f3cdf356 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII When I started with EMR it was alot of testing and trial and error. HUE is already supported as something that can be installed from the AWS console. What I need to know is if you need this cluster on all the time or this is goign ot be what amazon call a transient cluster. Meaning you fire it up run the job and tear it back down. --- Regards, Jonathan Aquilina Founder Eagle Eye T On 2015-03-06 01:10, Krish Donald wrote: > Thanks Jonathan, > > I will try to explore EMR option also. > Can you please let me know the configuration which you have used it? > Can you please recommend for me also? > I would like to setup Hadoop cluster using cloudera manager and then would like to do below things: > > setup kerberos > setup federation > setup monitoring > setup hadr > backup and recovery > authorization using sentry > backup and recovery of individual componenets > performamce tuning > upgrade of cdh > upgrade of CM > Hue User Administration > Spark > Solr > > Thanks > Krish > > On Thu, Mar 5, 2015 at 3:57 PM, Jonathan Aquilina wrote: > > krish EMR wont cost you much with all the testing and data we ran through the test systems as well as the large amont of data when everythign was read we paid about 15.00 USD. I honestly do not think that the specs there would be enough as java can be pretty ram hungry. > > --- > Regards, > Jonathan Aquilina > Founder Eagle Eye T > > On 2015-03-06 00:41, Krish Donald wrote: > > Hi, > > I am new to AWS and would like to setup Hadoop cluster using cloudera manager for 6-7 nodes. > > t2.micro on AWS; Is it enough for setting up Hadoop cluster ? > I would like to use free service as of now. > > Please advise. > > Thanks > Krish --=_cc74b73807c3c9c32118ed26f3cdf356 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

When I started with EMR it was alot of testing and trial and error. HUE = is already supported as something that can be installed from the AWS consol= e. What I need to know is if you need this cluster on all the time or this = is goign ot be what amazon call a transient cluster. Meaning you fire it up= run the job and tear it back down.

 

---
Regards,
Jonathan Aquilina
Founder Eagle Eye T

On 2015-03-06 01:10, Krish Donald wrote:

Thanks Jonathan,
 
I will try to explore EMR option also.
Can you please let me know the configuration which you have used it?
Can you please recommend for me also?
I would like to setup Hadoop cluster using cloudera manager and then w= ould like to do below things:
 
setup kerberos
setup federation
setup monitoring
setup = hadr
backup and recovery
authorization using sentry
backup a= nd recovery of individual componenets
performamce tuning
upgrade = of cdh
upgrade of CM
Hue User Administration
Spark
Solr
 
 
Thanks
Krish
 

On Thu, Mar 5, 2015 at 3:57 PM, Jonathan Aquilin= a <jaquilina@eagleeyet= =2Enet> wrote:

krish EMR wont cost you much with all the testing and data we ran throug= h the test systems as well as the large amont of data when everythign was r= ead we paid about 15.00 USD. I honestly do not think that the specs there w= ould be enough as java can be pretty ram hungry.

 

---
Regards,
Jonathan Aquilina
Founder Eagle Eye T

On 2015-03-06 00:41, Krish Donald wrote:

Hi,
 
I am new to AWS and would like to setup Hadoop cluster using cloudera = manager for 6-7 nodes.
 
t2.micro on AWS; Is it enough for setting up Hadoop cluster ?
I would like to use free service as of now.
 
Please advise.
 
Thanks
Krish
--=_cc74b73807c3c9c32118ed26f3cdf356--