Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CF1EB7EFB for ; Mon, 15 Aug 2011 20:06:42 +0000 (UTC) Received: (qmail 20029 invoked by uid 500); 15 Aug 2011 20:06:40 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 19835 invoked by uid 500); 15 Aug 2011 20:06:39 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 19826 invoked by uid 99); 15 Aug 2011 20:06:38 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Aug 2011 20:06:38 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of camechis@gmail.com designates 209.85.216.48 as permitted sender) Received: from [209.85.216.48] (HELO mail-qw0-f48.google.com) (209.85.216.48) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Aug 2011 20:06:33 +0000 Received: by qwj9 with SMTP id 9so3802247qwj.35 for ; Mon, 15 Aug 2011 13:06:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=HjNiVLYk6dGIJLH6Uhhf6wMCtma547FzNh+EcH6Gq54=; b=WqzwmcugxiioRUnlk2xvhUerpo+Empz3AivqV/E8lUUG2MNmL901LPorQlwZBh+pfe nhn9bSIRVXFckRb87/La0F6AU1lHETuneTfTFm8/FkEsL8UNOKNyJvtSxUDFYqRATVy3 foCJDkWNoxU+aVxiDjRlZFuhQiParJvBt6E+o= MIME-Version: 1.0 Received: by 10.229.106.30 with SMTP id v30mr2798417qco.113.1313438772974; Mon, 15 Aug 2011 13:06:12 -0700 (PDT) Received: by 10.229.29.213 with HTTP; Mon, 15 Aug 2011 13:06:12 -0700 (PDT) In-Reply-To: References: Date: Mon, 15 Aug 2011 16:06:12 -0400 Message-ID: Subject: Re: hadoop cluster on VM's From: Travis Camechis To: common-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=00235429d1d47f54ab04aa90cbc4 --00235429d1d47f54ab04aa90cbc4 Content-Type: text/plain; charset=ISO-8859-1 My suspicion is correct it is not a good idea but mainly I was talking about a Vmware VSphere setup with the whole vmotion thing. On Mon, Aug 15, 2011 at 4:03 PM, Liam Friel wrote: > On Mon, Aug 15, 2011 at 7:31 PM, GOEKE, MATTHEW (AG/1000) < > matthew.goeke@monsanto.com> wrote: > > > Is this just for testing purposes or are you planning on going into > > production with this? If it is the latter than I would STRONGLY advise to > > not give that a second thought due to how the framework handles I/O. > However > > if you are just trying to test out distributed daemon setup and get some > ops > > documentation then have at it :) > > > > Matt > > > > -----Original Message----- > > From: Travis Camechis [mailto:camechis@gmail.com] > > Sent: Monday, August 15, 2011 12:45 PM > > To: common-user@hadoop.apache.org > > Subject: hadoop cluster on VM's > > > > Is it recommended to install a hadoop cluster on a set of VM's that are > all > > connected to a SAN? > > > > > Could you expand on that? Do you mean multiple VMs on a single server are a > no-no? > Or do you mean running Hadoop on something like Amazon EC2 for production > is > also a no-no? > With some pointers to background if the latter please ... > > Just for my education. I have run some (test I guess you could call them) > Hadoop clusters on EC2 and it was working OK. > However I didn't have the equivalent pile of physical hardware lying around > to do a comparison ... which I guess is why EC2 is so attractive. > > Ta > Liam > --00235429d1d47f54ab04aa90cbc4--