Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 930AF1799C for ; Tue, 4 Nov 2014 20:05:04 +0000 (UTC) Received: (qmail 20457 invoked by uid 500); 4 Nov 2014 20:04:58 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 20329 invoked by uid 500); 4 Nov 2014 20:04:58 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 20319 invoked by uid 99); 4 Nov 2014 20:04:57 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Nov 2014 20:04:57 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jayunit100.apache@gmail.com designates 209.85.220.43 as permitted sender) Received: from [209.85.220.43] (HELO mail-pa0-f43.google.com) (209.85.220.43) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Nov 2014 20:04:53 +0000 Received: by mail-pa0-f43.google.com with SMTP id eu11so15136972pac.2 for ; Tue, 04 Nov 2014 12:03:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=S+FaDhYAOXUU9uysHyzN5jLNhBWqFOOiSHn9T3omfTU=; b=ze+CGzmMsM2FCEnshKABRvv2tJBgcoo5wEQkN4tCV0J57p+yTMLdmyCjaOtIlhB1QI QCdU98UqiFa7EveW785EUgk1yNrO9X5CPKeqOwHMwXZBrXS1YZt+LpMaLorv8vavg5yL MWmbMQYNbdqIp7HnQz/KV79ZxTcsbEjXEyk+cIM0DsnVy2JXoIiuSMYtUnyB5xRW69Bw wg3lu50eqU13Umr15wuY6fumYasLDm3gea5sDR0L7xot5VszCm1e3BC9tNWz4jBIrQrh hWPpq5MPRJoAIreqE3uq9M22GnCnNZANlTpBlqrecHi+0/XsaDL5+b56xER2oHSA7B+k jdAg== MIME-Version: 1.0 X-Received: by 10.70.42.175 with SMTP id p15mr862745pdl.53.1415131383543; Tue, 04 Nov 2014 12:03:03 -0800 (PST) Received: by 10.70.67.137 with HTTP; Tue, 4 Nov 2014 12:03:03 -0800 (PST) In-Reply-To: References: Date: Tue, 4 Nov 2014 15:03:03 -0500 Message-ID: Subject: Re: Hadoop Learning Environment From: jay vyas To: "common-user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=089e0103e18a6d3e6105070df3bb X-Virus-Checked: Checked by ClamAV on apache.org --089e0103e18a6d3e6105070df3bb Content-Type: text/plain; charset=UTF-8 Hi tim. Id suggest using apache bigtop for this. BigTop integrates the hadoop ecosystem into a single upstream distribution, packages everything, curates smoke tests, vagrant, docker recipes for deployment. Also, we curate a blueprint hadoop application (bigpetstore) which you build yourself, easily, and can run to generate, process, and visualize the bigdata ecosystem. You can also easily deploy bigtop onto ec2 if you want to pay for it . On Tue, Nov 4, 2014 at 2:28 PM, Tim Dunphy wrote: > Hey all, > > I want to setup an environment where I can teach myself hadoop. Usually > the way I'll handle this is to grab a machine off the Amazon free tier and > setup whatever software I want. > > However I realize that Hadoop is a memory intensive, big data solution. So > what I'm wondering is, would a t2.micro instance be sufficient for setting > up a cluster of hadoop nodes with the intention of learning it? To keep > things running longer in the free tier I would either setup however many > nodes as I want and keep them stopped when I'm not actively using them. Or > just setup a few nodes with a few different accounts (with a different > gmail address for each one.. easy enough to do). > > Failing that, what are some other free/cheap solutions for setting up a > hadoop learning environment? > > Thanks, > Tim > > -- > GPG me!! > > gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B > > -- jay vyas --089e0103e18a6d3e6105070df3bb Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi tim.=C2=A0 Id suggest using apache bigto= p for this.

BigTop integrates the hadoop ecosystem into a sing= le upstream distribution, packages everything, curates smoke tests, vagrant= , docker recipes for deployment.
Also, we curate a blueprint hadoo= p application (bigpetstore) which you build yourself, easily, and can run t= o generate, process, and visualize the bigdata ecosystem.

You = can also easily deploy bigtop onto ec2 if you want to pay for it .

=


On = Tue, Nov 4, 2014 at 2:28 PM, Tim Dunphy <bluethundr@gmail.com> wrote:
Hey all,

=C2=A0I want to setup an environment where I can teach myself hado= op. Usually the way I'll handle this is to grab a machine off the Amazo= n free tier and setup whatever software I want.=C2=A0

However I = realize that Hadoop is a memory intensive, big data solution. So what I'= ;m wondering is, would a t2.micro instance be sufficient for setting up a c= luster of hadoop nodes with the intention of learning it? To keep things ru= nning longer in the free tier I would either setup however many nodes as I = want and keep them stopped when I'm not actively using them. Or just se= tup a few nodes with a few different accounts (with a different gmail addre= ss for each one.. easy enough to do).

Failing that, what are som= e other free/cheap solutions for setting up a hadoop learning environment?<= /div>

Thanks,
Tim

--
GPG me!!

gpg --keyserver pool.sks-keyservers.net= --recv-keys F186197B




--
jay vyas
--089e0103e18a6d3e6105070df3bb--