Return-Path: Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: (qmail 1802 invoked from network); 1 Jul 2010 12:54:46 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 1 Jul 2010 12:54:46 -0000 Received: (qmail 76987 invoked by uid 500); 1 Jul 2010 12:54:45 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 76775 invoked by uid 500); 1 Jul 2010 12:54:43 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 76767 invoked by uid 99); 1 Jul 2010 12:54:43 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Jul 2010 12:54:43 +0000 X-ASF-Spam-Status: No, hits=-1.6 required=10.0 tests=RCVD_IN_DNSWL_MED,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [192.6.10.60] (HELO tobor.hpl.hp.com) (192.6.10.60) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Jul 2010 12:54:35 +0000 Received: from localhost (localhost [127.0.0.1]) by tobor.hpl.hp.com (Postfix) with ESMTP id 3AE25B7E61 for ; Thu, 1 Jul 2010 13:54:15 +0100 (BST) X-Virus-Scanned: amavisd-new at hplb.hpl.hp.com Received: from tobor.hpl.hp.com ([127.0.0.1]) by localhost (tobor.hpl.hp.com [127.0.0.1]) (amavisd-new, port 10024) with LMTP id KKVvML1LB8bR for ; Thu, 1 Jul 2010 13:54:14 +0100 (BST) Received: from 0-imap-br1.hpl.hp.com (0-imap-br1.hpl.hp.com [16.25.144.60]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by tobor.hpl.hp.com (Postfix) with ESMTPS id 5C5F3B7E28 for ; Thu, 1 Jul 2010 13:54:14 +0100 (BST) MailScanner-NULL-Check: 1278593641.86013@tyA6HuJyGJCRH4OiESj/vQ Received: from [16.25.175.158] (morzine.hpl.hp.com [16.25.175.158]) by 0-imap-br1.hpl.hp.com (8.14.1/8.13.4) with ESMTP id o61Cs0wC005866 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Thu, 1 Jul 2010 13:54:01 +0100 (BST) Message-ID: <4C2C8FE9.1040706@apache.org> Date: Thu, 01 Jul 2010 13:54:01 +0100 From: Steve Loughran User-Agent: Thunderbird 2.0.0.24 (X11/20100228) MIME-Version: 1.0 To: general@hadoop.apache.org Subject: Re: Hadoop Platform References: <30B5A69F3E33FE4C83F4C832F5D6E2CF0254F734@CINMLVEM12.e2k.ad.ge.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-HPL-MailScanner-Information: Please contact the ISP for more information X-MailScanner-ID: o61Cs0wC005866 X-HPL-MailScanner: Found to be clean X-HPL-MailScanner-From: stevel@apache.org X-Virus-Checked: Checked by ClamAV on apache.org Renato Marroqu�n Mogrovejo wrote: > Thanks everybody, > > I will definitely try to get in contact with OpenCirrus, and if not I can at > least test with some amazon hw so I can prove the application concept. There's a lot to be said for bringing up 3 or 4 virtualbox or vmware VMs and playing with that locally, as it does make sure that you have distribution right. CPU performance on VMs is pretty good, it's only disk IO that (currently) suffers. >And > the Whirr project is really interesting, I will give it a look specially > because we really don't want to depend on a single service provider. > Thanks again for the suggestions. I've been doing some work on GUIs/tooling too; this is something that could really front end what whirr does, though it also needs a cross-infrastructure HA story for managing the persistent data the tooling needs too -user accounts, current set of machines, etc etc. http://www.slideshare.net/steve_l/farming-hadoop-inthecloud > > > Renato M. > > > 2010/6/30 Jeff Hammerbacher > >> If you want to use an open API and be cloud-provider agnostic, check out >> Whirr: http://incubator.apache.org/projects/whirr.html. >> >> On Wed, Jun 30, 2010 at 10:52 AM, Yan, Weizhong (GE, Research) >> wrote: >> >>> Why don't you just simply try Amazon elastic MapReduce? >>> http://aws.amazon.com/elasticmapreduce/ >>> >>> -----Original Message----- >>> From: Renato Marroqu�n Mogrovejo [mailto:renatoj.marroquin@gmail.com] >>> Sent: Wednesday, June 30, 2010 11:47 AM >>> To: general@hadoop.apache.org >>> Subject: Hadoop Platform >>> >>> Hi everyone, >>> >>> I read a while ago that maybe IBM or Yahoo! were going to provide a >> "cloud" >>> for academic purposes. Does anybody know if those intentions >> materialised? >>> or if there any other ( free or not so expensive ) platform to test >> Hadoop >>> jobs??? I mean, obviously there would be several limitations on it, but I >>> don't have access to a cluster and I have some Hadoop jobs I need to test >>> them, so I can prove to my people the power of it (: >>> Thanks in advance. >>> >>> >>> Renato M. >>> >