Return-Path: Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: (qmail 27022 invoked from network); 3 Jul 2009 14:00:33 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 3 Jul 2009 14:00:33 -0000 Received: (qmail 14229 invoked by uid 500); 3 Jul 2009 14:00:43 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 14139 invoked by uid 500); 3 Jul 2009 14:00:43 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 14129 invoked by uid 99); 3 Jul 2009 14:00:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Jul 2009 14:00:43 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of timrobertson100@gmail.com designates 209.85.219.219 as permitted sender) Received: from [209.85.219.219] (HELO mail-ew0-f219.google.com) (209.85.219.219) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Jul 2009 14:00:35 +0000 Received: by ewy19 with SMTP id 19so2820440ewy.29 for ; Fri, 03 Jul 2009 07:00:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=p+kDVoFeAa52X2zs5fb/+IZua5rrkvD0fNvvq5uk/y0=; b=E+ZG+gQdmg7/VvV+4rFqHBgTKotS8xEaRXK6s0Facyvn3QIS4bPnVLx7mpuZ12NwFb hMJsmb7Tj7wIGPe9QqpCKFlHIIRH14LnXeXE2S75nB1WIB81Ip349WMOxOiUnLe7CF5v etHdFr2ZfzJdyonvknlFUxwCFG7MwKsNbm9fk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=pDGN07cG1cqHt7yRJRqcZHiSLwIg7WxROnEa+DQLK79UdZMY3wJjX4i+HAK1IHeJLk GOntf55m8gLKnXoTm1CLveY+NydSwq3JxvgNPQmXF5AP4/PThEc7NfAQRD9YyYNnWaog Fw+6MHhOJYbV1gTEOkOsD03OqDG9WL389bvuk= MIME-Version: 1.0 Received: by 10.216.16.208 with SMTP id h58mr360607weh.60.1246629613821; Fri, 03 Jul 2009 07:00:13 -0700 (PDT) In-Reply-To: References: <32120a6a0907030206l77a30d41yef2704e176f6d90f@mail.gmail.com> Date: Fri, 3 Jul 2009 16:00:13 +0200 Message-ID: <32120a6a0907030700i12876a6dld5a6b6b3c76b30f9@mail.gmail.com> Subject: Re: Tools to help administer a cluster? From: tim robertson To: general@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Thanks both. I'll brush up on my scripting skills ;o) On Fri, Jul 3, 2009 at 2:08 PM, Bogdan M. Maryniuk wrote: > On Fri, Jul 3, 2009 at 6:06 PM, tim robertson = wrote: >> I am looking for something that allows easy ability to copy over a new >> Hadoop distribution and sync all the config files etc. =A0I'm not very >> good at system admin, so hoping there is are some tools to help speed >> things up. > > HINT: Password-less here SSH is not just because Doug wanted so. :) > /bin/bash with SSH/scp are your very opensource friends, e.g.: > > for hostname in `cat $HADOOP/slaves`; > do > =A0 echo "Doing stuff on $hostname"; > =A0 scp /local/file.txt $hostname:/path/on/remote/host/; > =A0 ssh $hostname cat /path/on/remote/host/file.txt; > done > > > P.S. Make sure "slaves" does not contains local host's IP. :-) > > -- > HTH, BM > > Things, that are stupid at the beginning, rarely ends up wisely. >