Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 59472 invoked from network); 5 Nov 2009 18:18:43 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 5 Nov 2009 18:18:43 -0000 Received: (qmail 83148 invoked by uid 500); 5 Nov 2009 18:18:41 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 83061 invoked by uid 500); 5 Nov 2009 18:18:40 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 83051 invoked by uid 99); 5 Nov 2009 18:18:40 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Nov 2009 18:18:40 +0000 X-ASF-Spam-Status: No, hits=-2.6 required=5.0 tests=AWL,BAYES_00,HTML_MESSAGE X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of markkerzner@gmail.com designates 216.239.58.184 as permitted sender) Received: from [216.239.58.184] (HELO gv-out-0910.google.com) (216.239.58.184) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Nov 2009 18:18:38 +0000 Received: by gv-out-0910.google.com with SMTP id e6so240339gvc.4 for ; Thu, 05 Nov 2009 10:18:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=HzEdfRiliFwNZXlCNEvG7mpvX9EwwoRveFKKz0Lno7g=; b=jkVCmPj4X6zQuo9e7cTSw0JthF7zEq3f1Y1Kjtn3E+aVeHSEo18Kv2Rl2Boq0l//TZ KLk+YS17L46xFr4e2YB1btwg2IIxzSfkVKd8iXFCwOGNh4EKBbn938zE4nO5tVYrBvIq 9n7qwgaxzUsVpy/qSp50Augdi119CE9sKjWMk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=UNrUSRXzvljeSfDMoz6MQ53pnvViPK0843nLdB+1jJ6/VyUhmKBA+VeXYhXKaPaXqo EQdhsCI9LcwJCdHwYpZA+34KnzIaA6er7uKwpd09H3nfrhO6l4Z6K5+5q3Yf3Fx3nCwC J2nCWiJyIWGee8W9bs50rvzpM4XU6lCUN1go4= MIME-Version: 1.0 Received: by 10.239.130.154 with SMTP id 26mr322901hbj.57.1257445095640; Thu, 05 Nov 2009 10:18:15 -0800 (PST) In-Reply-To: <32120a6a0911050915l4b55ffat571778ce9d866ca5@mail.gmail.com> References: <32120a6a0911050915l4b55ffat571778ce9d866ca5@mail.gmail.com> Date: Thu, 5 Nov 2009 12:18:15 -0600 Message-ID: Subject: Re: Time to build my own cluster - advice? From: Mark Kerzner To: common-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001485f5b0c04011bc0477a3c064 --001485f5b0c04011bc0477a3c064 Content-Type: text/plain; charset=ISO-8859-1 Tim, I have been using individual EC2, and my question really was about building your own Hadoop cluster on that, but the others have provided the links. I guess you are saying that I should just go ahead and do it; it's not that hard. In other words, kick that Elastic MapReduce habit :) Thank you, Mark On Thu, Nov 5, 2009 at 11:15 AM, Tim Robertson wrote: > Hi Mark, > > The amazon EC2 docs are really pretty good - It is really easy to > manage your own AMIs. > Just follow the tutorial and you'll have no issues. > > Cheers, > Tim > > > > On Thu, Nov 5, 2009 at 6:09 PM, Mark Kerzner > wrote: > > Hi, > > > > so far I've been using Amazon MapReduce. However, my app uses a growing > > number of Linux packages. I have been installing them on the fly, in the > > Mapper.configure(), but with OpenOffice this is hard, and I don't get a > > service connection even after local install. > > > > Therefore, my question is on the advice in creating my own Hadoop cluster > > out of EC2 machines. Are there instructions? How hard is it? What are > best > > practices? > > > > Thank you, > > Mark > > > --001485f5b0c04011bc0477a3c064--