Return-Path: Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: (qmail 32133 invoked from network); 4 Jul 2009 03:40:13 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 4 Jul 2009 03:40:13 -0000 Received: (qmail 24945 invoked by uid 500); 4 Jul 2009 03:40:23 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 24797 invoked by uid 500); 4 Jul 2009 03:40:21 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 24787 invoked by uid 99); 4 Jul 2009 03:40:21 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 04 Jul 2009 03:40:21 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of bogdan.maryniuk@gmail.com designates 209.85.222.196 as permitted sender) Received: from [209.85.222.196] (HELO mail-pz0-f196.google.com) (209.85.222.196) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 04 Jul 2009 03:40:10 +0000 Received: by pzk34 with SMTP id 34so2449533pzk.5 for ; Fri, 03 Jul 2009 20:39:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=6ZpyywOLFlu2oxnXA/uX9HYBqj0tKcQE1itvG1lAC1A=; b=Rc9Nv/EGQ8D9SbznBAv9eH4SY7QdKBbunsUHL1n/AubkpPj6/rzCWx5VFHatsUtiuy 9SZKmqrAJZ7ofNsGRQUmZuC9qsPNTmPDazIyXvYytkkzGj1ueEpUHy3e+ymZaPyKv/8G 8Z7NTtjCerV40TqFK53cqb1PRjV+VnTun+Dv8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=bu/FEHJe/Pgl7PX0FvyX8OYCxz100cIFZJQNSAS6+/kgotvJcF8Lvu+RFIwpSy/xlz 13DynrL9/cCwq7XzdJP+PQHmUI3/obzQBp1APM1s6wANPn2bQlvIwxJI0iqFGHW+7y51 zeE5pKzk4V5H8NV8NBzRVAN9qxCCmha8Azxl8= MIME-Version: 1.0 Received: by 10.142.238.9 with SMTP id l9mr734011wfh.90.1246678790592; Fri, 03 Jul 2009 20:39:50 -0700 (PDT) In-Reply-To: <605941800907031501l756e3db5ud88da9f864f4de6e@mail.gmail.com> References: <32120a6a0907030206l77a30d41yef2704e176f6d90f@mail.gmail.com> <32120a6a0907030700i12876a6dld5a6b6b3c76b30f9@mail.gmail.com> <15da8a100907031104s5fc40245tca4ba09cb65e60e@mail.gmail.com> <605941800907031501l756e3db5ud88da9f864f4de6e@mail.gmail.com> Date: Sat, 4 Jul 2009 12:39:50 +0900 Message-ID: Subject: Re: Tools to help administer a cluster? From: "Bogdan M. Maryniuk" To: general@hadoop.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org On Sat, Jul 4, 2009 at 7:01 AM, RSD wrote: > I highly recommend investing the time with CFEngine Not sure how CFEngine can be better than simple script in bash for administering Hadoop in this case. But I am sure how it might be a disaster when you forget e.g. a semicolon in some certain place and run it. On Sat, Jul 4, 2009 at 3:04 AM, Philip Zeyliger wrote: > We build (and use) RPM & deb packages for Hadoop. In that case Tim has to decide messing up with http://rpm4darwin.sourceforge.net/ (read: seriously affect his infrastructure with rpm'ed Darwin ports) or not. I am not sure how your Linux-only packages will work on "rpmized" OSX either. > See http://cloudera.com/hadoop . You can package up your config files > into an RPM too (see my.cloudera.com) or use rsync for those, and you > can distribute the binaries by pointing your machines to a yum/apt > repository. Any plans to support IPS (http://opensolaris.org/os/project/pkg/)? C'mon, guys, Java on Solaris is still better and ZFS has much more advantage over standard POSIX bridges that are available on Linux at the moment. :-) I've got running Hadoop on Solaris and its zones finally good: just for some reason Hadoop disliked ZFS rpool within a zone, but asks for a real device mounted. Haven't figured out it yet by reading sources, since I am too new to Hadoop, but that's was the only issue so far (0.20 and 0.19.1 versions tried). -- BM