Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 59003 invoked from network); 16 Apr 2008 02:22:43 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 16 Apr 2008 02:22:43 -0000 Received: (qmail 7807 invoked by uid 500); 16 Apr 2008 02:22:41 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 7764 invoked by uid 500); 16 Apr 2008 02:22:41 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 7755 invoked by uid 99); 16 Apr 2008 02:22:41 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Apr 2008 19:22:41 -0700 X-ASF-Spam-Status: No, hits=-1.0 required=10.0 tests=RCVD_IN_DNSWL_LOW,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [216.86.168.179] (HELO mxout-04.mxes.net) (216.86.168.179) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Apr 2008 02:21:55 +0000 Received: from [192.168.10.101] (unknown [24.6.146.30]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by smtp.mxes.net (Postfix) with ESMTP id 01E98D05A6 for ; Tue, 15 Apr 2008 22:22:06 -0400 (EDT) Message-Id: From: Chris K Wensel To: core-user@hadoop.apache.org In-Reply-To: <48055E85.9090703@u.washington.edu> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v919.2) Subject: Re: adding nodes to an EC2 cluster Date: Tue, 15 Apr 2008 19:22:05 -0700 References: <48055E85.9090703@u.washington.edu> X-Mailer: Apple Mail (2.919.2) X-Virus-Checked: Checked by ClamAV on apache.org Stephen Check out the patch in Hadoop-2410 to the contrib/ec2 scripts https://issues.apache.org/jira/browse/HADOOP-2410 (just grab the ec2.tgz attachment) these scripts allow you do dynamically grow your cluster plus some extra goodies. you will need to use them to build your own ami, they are not compatible with the hadoop-images amis. using them should be self explanatory. ckw On Apr 15, 2008, at 7:03 PM, Stephen J. Barr wrote: > Hello, > > Does anyone have any experience adding nodes to a cluster running on > EC2? If so, is there some documentation on how to do this? > > Thanks, > -stephen Chris K Wensel chris@wensel.net http://chris.wensel.net/ http://www.cascading.org/