hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rishi pathak <mailmaverick...@gmail.com>
Subject Re: Automate Hadoop installation
Date Wed, 07 Dec 2011 08:14:40 GMT
Hello Praveen,
      It might be an overkill but you can tweak HOD for the purpose. It is
already bundled with hadoop.
You will have to change the way node is allocated and commissioned , i.e.
replacing  torque resource manager interface with ssh(or other rsh's).

Other way would be use of postinstall in kickstart while node installation.
This would help if configuration files are mostly static and there are no
frequent hadoop upgrades.

On Mon, Dec 5, 2011 at 4:02 PM, praveenesh kumar <praveenesh@gmail.com>wrote:

> Hi all,
> Can anyone guide me how to automate the hadoop installation/configuration
> process?
> I want to install hadoop on 10-20 nodes which may even exceed to 50-100
> nodes ?
> I know we can use some configuration tools like puppet/or shell-scripts ?
> Has anyone done it ?
> How can we do hadoop installations on so many machines parallely ? What are
> the best practices for this ?
> Thanks,
> Praveenesh

Rishi Pathak
National PARAM Supercomputing Facility
C-DAC, Pune, India

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message