hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sam Ritchie <sritchi...@gmail.com>
Subject Re: Automate Hadoop installation
Date Sat, 31 Dec 2011 05:57:09 GMT
Hey guys,

If you're okay with Clojure, I've put together a Hadoop deploy using
Pallet. Here's a demo project with instructions:

https://github.com/pallet/pallet-hadoop-example

I routinely boot and configure (from scratch) 50 node clusters on EC2 with
no issues.

Cheers,
Sam

On Thu, Dec 22, 2011 at 7:57 AM, Tom Wilcox <Tom.Wilcox@cse.org.uk> wrote:

> I'm interested in this too.
>
> You might find this article helpful:
> http://hstack.org/hstack-automated-deployment-using-puppet/
>
> Apparently the Adobe SaaS guys are responsible for creating a project for
> puppet-Hadoop stack deployments...
>
> -----Original Message-----
> From: warren [mailto:hadoop.com.cn@gmail.com]
> Sent: 22 December 2011 13:28
> To: common-user@hadoop.apache.org
> Subject: Re: Automate Hadoop installation
>
> if you use ubuntu,you can try ubuntu-orchestra-modules-hadoop
>
> On 2011年12月06日 03:20, Konstantin Boudnik wrote:
> > These that great project called BigTop (in the apache incubator) which
> > provides for building of Hadoop stack.
> >
> > The part of what it provides is a set of Puppet recipes which will allow
> you
> > to do exactly what you're looking for with perhaps some minor
> corrections.
> >
> > Serious, look at Puppet - otherwise it will be a living through
> nightmare of
> > configuration mismanagements.
> >
> > Cos
> >
> > On Mon, Dec 05, 2011 at 04:02PM, praveenesh kumar wrote:
> >> Hi all,
> >>
> >> Can anyone guide me how to automate the hadoop
> installation/configuration
> >> process?
> >> I want to install hadoop on 10-20 nodes which may even exceed to 50-100
> >> nodes ?
> >> I know we can use some configuration tools like puppet/or shell-scripts
> ?
> >> Has anyone done it ?
> >>
> >> How can we do hadoop installations on so many machines parallely ? What
> are
> >> the best practices for this ?
> >>
> >> Thanks,
> >> Praveenesh
>
>


-- 
Sam Ritchie, Twitter Inc
703.662.1337
@sritchie09

(Too brief? Here's why! http://emailcharter.org)

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message