From general-return-4137-apmail-hadoop-general-archive=hadoop.apache.org@hadoop.apache.org Tue Aug 2 19:03:02 2011 Return-Path: X-Original-To: apmail-hadoop-general-archive@minotaur.apache.org Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 063016B96 for ; Tue, 2 Aug 2011 19:03:02 +0000 (UTC) Received: (qmail 68283 invoked by uid 500); 2 Aug 2011 19:03:00 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 68202 invoked by uid 500); 2 Aug 2011 19:02:59 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 68194 invoked by uid 99); 2 Aug 2011 19:02:59 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Aug 2011 19:02:59 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of Milind.Bhandarkar@emc.com designates 128.222.32.20 as permitted sender) Received: from [128.222.32.20] (HELO mexforward.lss.emc.com) (128.222.32.20) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Aug 2011 19:02:52 +0000 Received: from hop04-l1d11-si04.isus.emc.com (HOP04-L1D11-SI04.isus.emc.com [10.254.111.24]) by mexforward.lss.emc.com (Switch-3.4.3/Switch-3.4.3) with ESMTP id p72J2TW2012529 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Tue, 2 Aug 2011 15:02:29 -0400 Received: from mailhub.lss.emc.com (mailhub.lss.emc.com [10.254.221.253]) by hop04-l1d11-si04.isus.emc.com (RSA Interceptor) for ; Tue, 2 Aug 2011 15:02:09 -0400 Received: from mxhub14.corp.emc.com (mxhub14.corp.emc.com [128.221.56.103]) by mailhub.lss.emc.com (Switch-3.4.3/Switch-3.4.3) with ESMTP id p72J28Ow013273 for ; Tue, 2 Aug 2011 15:02:09 -0400 Received: from mx21a.corp.emc.com ([169.254.1.227]) by mxhub14.corp.emc.com ([128.221.56.103]) with mapi; Tue, 2 Aug 2011 15:02:08 -0400 From: To: Date: Tue, 2 Aug 2011 15:01:59 -0400 Subject: Re: Hadoop build machine donations? Thread-Topic: Hadoop build machine donations? Thread-Index: AcxRRqQc3adC2IFKRFC3eYIHSD2LxA== Message-ID: In-Reply-To: <20110802183955.GB2875@linspire.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.12.0.110505 acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-EMM-MHVC: 1 X-Virus-Checked: Checked by ClamAV on apache.org That's good to know, Kos. Is there any place I can find the actual usage (in terms of utilization / memory-cpu-disk usage) of these build machines ? Based on the Amazon EC2 pricing (http://aws.amazon.com/ec2/pricing/), I would like to determine which type of instances would be adequate, and how much yearly budget would be needed. Since ASF is a 501(c)(3) non-profit, charitable organization, these donations would be tax deductible for U.S. Based individuals. (Plus for new AWS members, there is a free tier for 1 year.) Is there build infra in place that will allow these individually donated ec2 instances to be utilized ? - Milind --- Milind Bhandarkar Greenplum Labs, EMC (Disclaimer: Opinions expressed in this email are those of the author, and do not necessarily represent the views of any organization, past or present, the author might be affiliated with.) On 8/2/11 11:39 AM, "Konstantin Boudnik" wrote: >Milind. > >From about 30 boxes Y! gave to ASF at least (I believe there were more, >but at >least that much) 10 of them were used _exclusively_ as Hadoop build/test >machines (e.g. Hudson slaves) and a number of others (about 5 at least) >were >used for Hadoop deployment testing _exclusively_. So, I think the claim >above >doesn't reflect the real situation with hardware donation or perhaps is >missing some of the details ;). > >With that in mind I came across this article goo.gl/EVp5S and now I have a >bright idea! Shall the hardware donation be proportional to the proclaimed >market share (or installation base) of a particular commercial >distribution's >vendor? That'd be only fair I guess... Apache Hadoop is about 65% of the >installation and Y! brought in 30 machines. If a vendor A or C has say 30% >then may be they feel good by donating something like 15 boxes to the >cause? > >-- > Take care, > Konstantin (Cos) Boudnik > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622 > > Disclaimer: Opinions expressed in this email are those of the author, >and do > not necessarily represent the views of any company the author might be > affiliated with at the moment of writing. > > >On Tue, Aug 02, 2011 at 01:38PM, Milind.Bhandarkar@emc.com wrote: >> A couple of questions for Nigel and Andrew: >>=20 >> 1. What do you mean by "non-single-purpose machines" ? (I guess, >>machines >> they can use for non-Hadoop projects as well ?) >>=20 >> 2. Do these machines have to be physical boxes or virtual machines be >>okay >> too ? (sudo on virtual machines would be easier to sell than on physical >> boxes.) >>=20 >> 3. What's the process for donations ? >>=20 >> - milind >>=20 >> --- >> Milind Bhandarkar >> Greenplum Labs, >> EMC >>=20 >>=20 >>=20 >>=20 >> On 8/2/11 8:07 AM, "Andrew Bayer" wrote: >>=20 >> >FWIW, the ASF Infra guys aren't that keen on more machines they won't >>have >> >physical control of. There may be some wiggle room on that, but they'll >> >definitely need sudo and they would much prefer non-single-purpose >> >machines. >> >Just a heads up from my talks with Infra lately. >> > >> >A. >> > >> >On Mon, Aug 1, 2011 at 11:22 PM, Nigel Daley wrote: >> > >> >> Folks, >> >> >> >> Given the Hadoop build machines have been offline for a few day, this >> >>would >> >> be a good time to see if other companies can donate **access** to >>some >> >> build hardware to diversify our donors. Currently there are roughly >>30 >> >> machines donated by Yahoo! >> >> >> >> Ideally the hardware is: >> >> * hosted and OS managed by the donor, >> >> * publicly addressable on the internet, >> >> * running Ubuntu or CentOS, and >> >> * sudo access can be given to Apache's Jenkins admins so they can >>create >> >> accounts for committers as needed. >> >> >> >> Anyone? >> >> >> >> Thanks, >> >> Nige >> >> >>=20 >