hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Philip Zeyliger <phi...@cloudera.com>
Subject Re: Tools to help administer a cluster?
Date Fri, 03 Jul 2009 18:04:48 GMT
We build (and use) RPM & deb packages for Hadoop.  See
http://cloudera.com/hadoop .  You can package up your config files
into an RPM too (see my.cloudera.com) or use rsync for those, and you
can distribute the binaries by pointing your machines to a yum/apt
repository.

Cheers,

-- Philip

On Fri, Jul 3, 2009 at 7:00 AM, tim robertson<timrobertson100@gmail.com> wrote:
> Thanks both.  I'll brush up on my scripting skills ;o)
>
>
> On Fri, Jul 3, 2009 at 2:08 PM, Bogdan M.
> Maryniuk<bogdan.maryniuk@gmail.com> wrote:
>> On Fri, Jul 3, 2009 at 6:06 PM, tim robertson<timrobertson100@gmail.com> wrote:
>>> I am looking for something that allows easy ability to copy over a new
>>> Hadoop distribution and sync all the config files etc.  I'm not very
>>> good at system admin, so hoping there is are some tools to help speed
>>> things up.
>>
>> HINT: Password-less here SSH is not just because Doug wanted so. :)
>> /bin/bash with SSH/scp are your very opensource friends, e.g.:
>>
>> for hostname in `cat $HADOOP/slaves`;
>> do
>>   echo "Doing stuff on $hostname";
>>   scp /local/file.txt $hostname:/path/on/remote/host/;
>>   ssh $hostname cat /path/on/remote/host/file.txt;
>> done
>>
>>
>> P.S. Make sure "slaves" does not contains local host's IP. :-)
>>
>> --
>> HTH, BM
>>
>> Things, that are stupid at the beginning, rarely ends up wisely.
>>
>

Mime
View raw message